Spike City

The biggest single issue facing internet TV is spikes.

A single server at a decent hosting facility can handle an extraordinary amount of traffic - around 200 simultaneous connections at 1Mbps. Say that the viewer watches for half an hour a day, that's 48 x 200, or almost 10,000 viewers a day. Fifty servers and you can handle half a million viewers a day, and only the top 1% of anything on the web achieves this kind of popularity.

But, the problem is that traffic isn't even. Most things that drive traffic to a website also cause spikes. For example, announcing a URL on a traditional broadcast channel will cause a huge immediate spike (showing how many people surf and view..).

There are a handful of companies - Akamai, Limelight, Mirror Image and Internap amongst them, who have made a virtue from this. P2P doesn't help much since the requests are unexpected and often relate to new content that hasn't been widely distributed.

Multicasting - the internet equivalent to broadcasting, where everyone sees the same stream is an option which may become more prevalent, but for the time being the only answer is over-capacity, which is expensive. Today, for example, I have struggled with Adobe and Radiotimes' websites, to the point where I gave up.

For internet TV services the problem is even more acute and the number of services I visit that simply don't work in a reliable way is becoming very annoying.

The valuations given to Limelight and Akamai (but not to mixed model providers such as Narrowstep) shows the value in this part of the market.

The net neutrality debate is likely to impact this in due course, but for the time being the clever money is with those that can handle the heat in spike city.


Have you looked at Amazon AWS and how it could scale to handle this sort of thing? Or do you know of anyone who has? It seems to have the potential to directly address spikes and I have been meaning myself to figure out how to use it for our pickaproxy.com and geospoofing.com sites to accommodate our expected huge demand.
Iolo said…
I haven't personally worked with Amazon AWS - when I last looked into it, it seemed very expensive.

There are a few other options: the usual CDNs - Limelight, Akamai, Internep; these generally appear cheaper than Amazon and are set up specifically for spiking.

Also new initiatives such as those from Rawflow to build P2P spiked networks seem interesting - since what we're talking about is a lot of people demanding the same content at the same time P2P would appear to be a promising technology for this.