Abstract: Bellwether - Surrogate Services for Popular Content

Ted Hardie, Equinix
Duane Wessels, IRCache


The presenters will describe the architecture and performance characteristics of an open source surrogate system called "bellwether," based on squid and zebra. This system implements an outward facing proxy (surrogate) that acts on behalf of a content source to handle requests for content that is experiencing a sudden spike in popularity due to a flash crowd or "CNN event."

As a brief overview, subscribed content sources activate a surrogate placed near a network border using a protocol based on NECP (Network Element Control Protocol). The surrogate then activates an overlay network, which uses standard IBGP and GRE tunnels to ensure that it is part of the data path for new requests for content.

This system is designed to reduce both load on content servers and on the networks hosting those servers. The presenters will discuss both how an outward-facing proxy's focus on data already known to be popular can improve cache performance and present data for the specific cache replacement policies which have been tested.


About the Presenters
Ted is currently Director of R & D for Equinix, Inc. Prior to Equinix, he worked on the NASA Science Internet project, where he led NASA's webmasters' working group and suffered many of the pains of dealing with popularity spikes and flash crowds. Ted is also an active contributor to the IETF efforts related to caching, content negotiation, and content distribution.

Duane has been working on Web caching and related topics since his time at the University of Colorado in 1994. At the University of California San Diego, Duane led the development of the Squid cache software. These days he works on Web cache benchmarking, Squid, and various other projects.


Powerpoint presentation
HTML presentation
RealVideo stream