Slashdot Mirror


Netflix Isn't Swamping the Internet

itwbennett writes "Remember the Sandvine report from earlier this week that said Netflix gobbles up 30% of Internet traffic during peak hours? It needs clarification on a couple of important points, says blogger Kevin Fogarty. First, yes, Netflix traffic spikes during prime time, but only across the last mile. Second, ISPs underestimate what a 'normal' level of Internet use really is. 'When AT&T announced its data caps – 150GB per month for DSL users and 250GB for broadband – it called the data levels generous and said limits would only affect 2 percent of its customers. It turns out Netflix users take up an average of 40GB per month just from streaming media, according to a different Sandvine report (PDF).'"

44 of 208 comments (clear)

  1. Re:lol wut by McGiraf · · Score: 2

    They must have many datacenters, and deals with ISP to host , or peer directly.

  2. Lies, damned lies, by Aldenissin · · Score: 3, Insightful

    And statistics. Even if it would only affect 2%, that won't be for long. They knew they had to put caps in now, because later it would cause too much backlash. Could it be that the "Internet" could be swamped by digital media? Perhaps, but they could always add more bandwidth. Although then that would hurt their earnings having to invest, much less being able to nickel and dime customers.

      I wish companies like All-tel wouldn't have sold out. Though they weren't perfect, they had a lot going on right, and that is why they were successful. On one hand I am glad I am still with them, on the other, the rest of the family was moved to Verizon, eliminating one of the great reasons to join the same network.... But the big boys gobble up anyone that comes close to doing things right, so I don't see any reason to have much hope.

    --
    Like a city whose walls are broken down is a man who lacks self-control.
    1. Re:Lies, damned lies, by fuzzyfuzzyfungus · · Score: 2

      The huge lie, of course, is visible in the fact that cable-based legacy services and fiber-based "triple play" internet/quasi-cableTV/telephone being rolled out by the telcos generally split the available downsteam bandwidth between the real, user-visible, internet bandwidth used for the internet connection part of things, and the non-user-visible bandwidth dedicated to sending digital media streams down the wire that are sold as "cable" rather than "internet streaming".

      For the traditional cable type stuff, at least, there is the argument to be made that, while it consumes massive downstream bandwidth, it imposes fairly limit load on the infrastructure one level up; because it is the same downstream feed for everybody in the service area. For pay-per-view, though, it is basically the same thing as an internet-based stream, except billed differently.

      With bittorrent, at least, while most of the ISP whining was disengenuous bullshit aimed at rationalizing the results of profits going to shareholders rather than better infrastructure, it was technically true that upstream bandwidth available to legacy cable-based systems was fairly tightly constrained. With something like Netflix, though, it's just stinginess about upgrading the head ends, and just-plain-anticompetitive desire to slice the available downsteam bandwidth into two artificially distinct types, "internet" which is billed one way(and they really don't want to be used for video) and "Cable" which is billed a different way, doesn't offer arbitrary IP data services; but is bundled with video on which a fat profit margin is made.

      Set them all on fire.

    2. Re:Lies, damned lies, by Skarecrow77 · · Score: 2

      Of course he isn't stumping up the cash by doubling his monthly ISP subscription.

      He's stumping up the cash in tax-based subsidiaries provided by the government to telcos in order to build infrastructure. Just like you (assuming you're in the USA) and me.

    3. Re:Lies, damned lies, by wagnerrp · · Score: 5, Informative

      fiber-based "triple play" internet/quasi-cableTV/telephone being rolled out by the telcos generally split the available downsteam bandwidth between the real, user-visible, internet bandwidth used for the internet connection part of things, and the non-user-visible bandwidth dedicated to sending digital media streams down the wire that are sold as "cable" rather than "internet streaming".

      Actually, the way Verizon FiOS is set up, you have one light carrier dedicated specifically for video broadcasting. It runs through an optical transducer, which outputs a real QAM modulated digital cable signal, directly usable by any TV or PC tuner card that supports QAM.

    4. Re:Lies, damned lies, by Aldenissin · · Score: 2

      Exactly. I'm well aware that it takes money and construction to up the "bandwidth". The coward probably doesn't realise that my point is valid, since he is only looking to make excuses. I mean really, who here thinks that it is automagically added using a slider? What a tool. As if we weren't overpaying already, but then again I don't think he read the last part of my post.

      --
      Like a city whose walls are broken down is a man who lacks self-control.
    5. Re:Lies, damned lies, by wagnerrp · · Score: 2

      It's the entire 800MHz or so of digital cable spectrum, and whatever content they are broadcasting in the roughly 5Gbps of bandwidth it provides. VOD channels are the exception, and they actually are IPTV streams, while on traditional cable they are simply a spare channel that is broadcast to everyone.

  3. Advertising is swamping the internet by digitaldc · · Score: 3, Insightful

    In my humble opinion.

    --
    He who knows best knows how little he knows. - Thomas Jefferson
    1. Re:Advertising is swamping the internet by Skarecrow77 · · Score: 4, Interesting

      Adblock/Adblock plus is your saviour. (or if you're super uber nerdy, a custom hosts file)

      On the one hand I feel bad that I know that I'm not contributing to the continued survival of some of my favorite websites by providing them with adviews impressions (and certainly not with click-throughs), but on the other hand I work in the business of, among many other things, saving PCs that have become corrupted by malware that likely showed up in a drive-by ad-based browser attack. I feel no need to risk it.

      On a somewhat related note, the sheer annoyance of today's ads have gone overboard. The days of a static tower jpg on the side of an article seem to be going the way of the dodo, where now everything is animated, full of sound, wants to jump out in front of the damn text I'm reading, or even replace the text itself (and often somehow take up an entire modern cpu core, wtf, I've got more processing power than nasa sent men to the moon with, and a "click-here-to-win-a-ps3!" ad is using all of it?!). When they have a custom "X" button on their ad that I have to click on to close the damn thing, I am ALWAYS wary, because I don't want to click on ANYTHING nonstandard. ever. That's just asking for trouble, even in today's modern sandboxed browsers.

      It is sad to say, but I personally am more concerned with keeping my own system safe and secure than I am with "supporting" my favorite websites by letting their ads rape my eyes and ears at the very least, and quite possibly my system as well. They'll have to depend on other people for that, just hopefully not people I personally support.

    2. Re:Advertising is swamping the internet by swalve · · Score: 2

      Bad programming (sorry, "architecting" or "designification" or whatever the 8 sigma full-spectrum belts are calling it now) is the reason. My company's stupid extranet page pulls down 8k to display 1k of information. See how much data is sucked down by the stupidest of pages and you'll see why the internet sucks.

    3. Re:Advertising is swamping the internet by Lord+Byron+II · · Score: 2

      It's no different than the games industry where DRM requires a phone-home activation, disc in the drive, no daemon tools running, and a CD-key, but the cracked version removes all of this and sometimes even fixes bugs the original developer never fixed.

      Or how hour-long TV shows have gone from being ~52 mins long in the 1960's to ~44 mins long today and in the process have alienated so many customers that they now turn to Hulu or pirating, where the profits are less.

      I could go on about "CD"s that don't meet Red Book specs or how newspaper's classified prices basically created Craigslist. Unfortunately, content creators always seem to find ways to hurt the ones who want to buy their stuff.

  4. Last mile by houstonbofh · · Score: 4, Interesting

    So the last mile is the tightest, and contended. And we now know the data caps are a joke. So, still a problem.

  5. DSL vs Broadband? by sosume · · Score: 2

    'When AT&T announced its data caps – 150GB per month for DSL users and 250GB for broadband"

    Sorry, I must be missing something. Here, east of the Atlantic, DSL is considered broadband - what is broadband in the US?

    1. Re:DSL vs Broadband? by cornjones · · Score: 4, Informative

      presumably, in poster's mind, broadband = cable. Maybe it means fiber but i would think cable. Most of the dsl implementations are pretty crappy around the states (based on setups around the east coast mainly, seattle was good). Because of this, most people think dsl is inherently inferior to cable broadband. having used some excellent dsl providers in london, it definitely comes down to the service provider.

    2. Re:DSL vs Broadband? by SilentChasm · · Score: 2

      from http://en.wikipedia.org/wiki/Broadband_Internet:

      the United States (US) Federal Communications Commission (FCC) as of 2010, defines "Basic Broadband" as data transmission speeds of at least 4 megabits per second (Mbps), or 4,000,000 bits per second, downstream (from the Internet to the userâ(TM)s computer) and 1 Mbit/s upstream (from the userâ(TM)s computer to the Internet)

      Personally I think my DSL 1.2Mbps is "broadband", just slow broadband. I don't quite agree with arbitrary raising of the bar but I see it useful for driving progress in speeds. Funny thing about the 150GB cap you mentioned for DSL users, even a slow connection like mine can double that in a month.

    3. Re:DSL vs Broadband? by LoganDzwon · · Score: 2

      anything over then the lowest tier, basic DSL gets a creative name. Instead of AT&T selling VDSL they sell U-Verse!

  6. For those that are confused by Sycraft-fu · · Score: 5, Interesting

    This is because Netflix hosts their shit with caching companies. You get people like Akamai that do data hosting. Now they have big data centers that hold lots of data as you'd expect, but they also have cache engines all over the place. They contact ISPs and say "Hey, we'd like to put cache engines in your data center. We'll provide you all the equipment, free of charge, and tell you how to configure it. This will reduce the amount of bandwidth you use."

    You can see why ISPs like this and go for it. Of course the other side of it, the reason Akamai does it, is because it reduces their bandwidth usage a lot. Win-win situation.

    This happened on campus like 8 years ago. Akamai gave us some cache engines and they got set up on the network. Now anything on them is just stupidly fast. Windows updates just fly down. It also made quite a noticeable dent in off campus bandwidth usage.

    I don't think Netflix uses Akamai themselves, but I do know they use a service like it.

    1. Re:For those that are confused by Aqualung812 · · Score: 4, Informative

      I don't think Netflix uses Akamai themselves, but I do know they use a service like it.

      They did use Akamai, then switched to Level3. Remember that whole fiasco with Level 3 and Comcast? That was because Akamai paid Comcast for some stupid reason to make it so Comcast had less load on their peering points, and Level 3 didn't pay. Comcast wanted them to pay, and they did in the end.
      Very stupid, I would have just let Comcast oversubscribe their peering points & come back when they wanted to get the load off for free.

      --
      Grammer Nazis - I mod you "troll" unless you actually add something on-topic. Yes, I know I have mispellings in my sig.
    2. Re:For those that are confused by spinkham · · Score: 2

      Using custom hardware, they could store about 120TB for ~$8,000.

      I base that on this article, assuming that they use 3 GB drives instead of the 1.5 they used a few years ago.
      http://blog.backblaze.com/2009/09/01/petabytes-on-a-budget-how-to-build-cheap-cloud-storage/

      Lets says they put two of these in an ISP, thats 240TB. Netflix streams at about 2GB/hour. That means they could store 120,000 hours of content for ~$16K per ISP. That's not their whole library by far, but I would be willing to bet that's enough to store the top 95% of requested media at least.

      --
      Blessed are the pessimists, for they have made backups.
    3. Re:For those that are confused by Comboman · · Score: 4, Interesting

      How many people are watching episode 20, season 2 of Rockford Files?

      A lot fewer than are watching The King's Speech or Little Fockers (unfortunately). Netflix doesn't has to cache their entire library to save bandwidth. Caching the top 50 or 100 downloads for that week would yield significant savings. Long Tail arguments aside, most people still watch whatever everyone else is watching.

      --
      Support Right To Repair Legislation.
  7. Re:40 GB? by dsleif · · Score: 2

    Because he partitions his hard drive in 10GB segments and multi-boots every build ever. It's the way of the future.

  8. obvious slant by digitalsushi · · Score: 4, Interesting

    "40 gig just from streaming data" with a lowball 150 gig allowance, with recent slashdot articles saying netflix is a large minority of people's traffic... sounds like the ISPs are correct, that 150 gig is generous.

    --
    slashdot: where everyone yells sarcastic metaphors to themselves to understand the issue
    1. Re:obvious slant by orbital3 · · Score: 2

      Only for now, and only if you're one of the people that hasn't cut cable TV service from their budgets. The average American watches 153 hours of TV every month. Netflix HD streams eat up approximately 2GB every hour (source: Netflix themselves and verified by watching my own router traffic while watching HD Netflix streams).

      Some simple arithmetic leads us to 153 hours * 2GB/hr = 306GB per month for an average American who gets their TV fix from Netflix streaming or another comparable service. And this is assuming that there's either only one person in the household, or at least that every person in the household is watching the same thing all of the time. Have a roommate who has completely different taste in television? Boom, 612GB/month. Household or family of four? Of six? Happen to lie on the upper half of the Bell curve? You're screwed. Nevermind the traffic used by, you know, actual internet usage.

      I'm sure there will be some replies saying "People should go outside or read a book", but the fact remains that they don't. Still think 150GB or even 250GB a month is all that generous?

  9. ISPs Underestimate? by geoffrobinson · · Score: 3, Interesting

    Full disclosure: I used to work for a group within Comcast that looked at network traffic to the user. Let's just say I have a really strong dislike of all things Comcast.

    With that said, not a chance that the ISPs are not estimating correctly. They aren't estimating. At least at Comcast, they have an incredibly good idea of how much network traffic is going through their system. And they build to a given percentile of busiest time in the entire month.

    The only way you can say they are miscalculating what is going across the network is if Sandvine is not properly analyzing network traffic and is associating it with an incorrect network protocol.

    --
    Except for ending slavery, the Nazis, communism, & securing American independence, war has never solved anything.
  10. Sandvine? where have I heard that before... by mounthood · · Score: 5, Informative
    http://en.wikipedia.org/wiki/Sandvine#Comcast_Controversy

    So a company that sells network control and monitoring software, and who has a dodgy past, says the bandwidth caps are OK.

    --
    tomorrow who's gonna fuss
  11. Re:People must PAY for abusive streaming. by smelch · · Score: 2

    More to the point, they do effectively charge more for people who have the internet access but not the cable TV access. It's called bundling. When you don't do it, you pay more for internet.

    --
    If I can just reach out with my words and touch a butthole, just one, it will all be worth it.
  12. Net neutrality debate by airfoobar · · Score: 2

    I strongly suspect that this whole "Netflix uses all the bandwidth" story was started by some ISP lobbyist somewhere, who wants to charge users more for certain services.

  13. Normal by fermion · · Score: 2
    Second, ISPs underestimate what a 'normal' level of Internet use really is. 'When AT&T announced its data caps – 150GB per month for DSL users and 250GB for broadband – it called the data levels generous and said limits would only affect 2 percent of its customers. It turns out Netflix users take up an average of 40GB per month just from streaming media

    Normal, at least in the free market, is a compromise between what retailers are willing to sell and users are willing to pay for. People complain about high gas prices, but it is only recently that, again, users are actually responding to the prices. Likewise, it may seem that $2 for a coke is high, but largely retailers sell quite a bit of product in that way.

    In this case, bandwidth retailers are largely setting caps based on price points that are attractive to consumers and still provide them a profitable situation. We can argue whether the profits are excessive, but the situation is what it is. Netflix is a new business model, and some costs may be externalized to third parties that do not directly benefit from the service. I think the point of the report is to illustrate this point, and question Netflix as a viable model. OTOH, 'the internet' like 'the roads' s becoming a public resource in which continuously increasing trafic capacity is considered in the public interest, and the telcos clearly benefit from more consumers buying product in part driven by the desire for high bandwidth streaming media.

    --
    "She's a scientist and a lesbian. She's not going to let it slide." Orphan Black
    1. Re:Normal by tepples · · Score: 2

      OTOH, 'the internet' like 'the roads' s becoming a public resource in which continuously increasing trafic capacity is considered in the public interest

      But even public highways are charged for based on heavy vs. light users. Tractor-trailers wear down a road far more than, say, bicycles. (Damage has been modeled as proportional to the fourth power of axle weight.) This is part of why owners of tractor-trailers pay far more per year for registration than owners of passenger cars.

  14. People don't know what it means by Sycraft-fu · · Score: 3

    In the minds of most people, including most geeks, broadband = really fast Internet, and the cutoff for that changes year to year and person to person.

    In reality broadband means, well, broadband, as in a service that is not baseband. So Ethernet, even 10G, is not broadband. However DSL, no matter how slow, is broadband.

    Unfortunately, this shit is going to keep happening particularly now that the FCC has an official definition for broadband and it includes a minimum speed. People are going to keep misusing the term until the meaning just changes to "fast internet, where fast is whatever I think it is."

    1. Re:People don't know what it means by shadowfaxcrx · · Score: 2

      For the same reason people say the 6-o'clock news comes out and films a story. Film? TV news hasn't used film in decades. Hell, a lot of them don't even use tape anymore. The proper term would be "record" or "shoot," but no one says that. Even people in the industry still say they're filming stuff.

      There are two tiers of language: Accurate, and common use. I usually find that advocates of both tiers are a little too passionate for their own good. Broadband in common use means fast internet because most consumers don't give a damn what the transmission technology is. You could transmit their data via ip-over-carrier-pigeon for all they care, as long as it gets there fast enough and the porn isn't overly pixelated. Back when 56k was the standard, "broadband" providers advertised that "broadband" is faster. So now broadband means fast internet. I don't see a major problem there.

      At the risk of making this post too long, here's an example from my psych major college days: Most people say that spanking a child is negative reinforcement. Psychologists say it's positive reinforcement because in psychological terms, the type of reinforcement refers to the action and not the interpretation of the action. Because you're adding stimulus (spanking) as opposed to withdrawing stimulus (silent treatment), it's positive, rather than negative reinforcement. The problem is that to understand (or care) the nuances of this, you pretty much have to have a background in psych. So the general public says that positive reinforcement is something the kid likes (candy) while negative reinforcement is something the kid doesn't like (spanking). As long as you're clear on whether you're using common language vs technical language, you can get the message across.

      --
      "I disagree with you" does not equal "flamebait."
  15. Re:lol wut by DeadCatX2 · · Score: 2

    You have a three digit slashdot ID and you don't know what "last mile" means?

    Did you phish someone's account or something?

    --
    :(){ :|:& };:
  16. DSL G.Bond ADSL2+ 48/6 and happy with it by Sami+Lehtinen · · Score: 2

    I'm happy with my G.Bond ADSL2+ connection which gives me full 48/6 Mbps pretty cheaply. With cable there are always problems with upstream performance and latency. Using DSL I get steady 10 ms round-trip latency (DSLAM).

  17. Re:lol wut by datapharmer · · Score: 4, Insightful

    They don't buy, they rent from limelight and level3. They used akamai before that as a cdn (and I think might still use it some). Between these 3 the backbone infrastructure is pretty well covered. If they really do make up 30% of peek traffic it is reasonable to imagine that netflix has localized storage of at least the most popular content at most of these nodes, and the fact that limelight specializes in video transfer (even before netflix) makes it even more likely.

    --
    Get a web developer
  18. Re:40 GB? by NevarMore · · Score: 2

    Switch from chubby chasing to the asian stuff, takes up less space.

  19. How are the ISPs underestimating? by flibbidyfloo · · Score: 3, Interesting

    I'm no lover of Comcast or AT&T, but I think the point about ISPs underestimating normal use is unfair.

    It says that Netflix users take up an average of 40GB per month just from streaming media. In my experience, your "average" user isn't doing anything that uses more bandwidth than Netflix. Even with the lower data cap of 150GB, that leaves room for a three-fold increase in streaming bandwidth before you come close to using your allocation, with room left over downlaoding 3 or 4 full-sized games a month. Even with the supposed doubling of that rate for console users (which I doubt), that leaves plenty of room. And Mr. Fogarty needs to check his math, as 80 150*2/3.

    Even if console Netflix users were averaging 100GB/mo for streaming, who can use 50GB/mo on email, web surfing, and youtube?

    I think the author is overestimating how much bandwidth average users need.

    Full disclosure: I am far from an average user. I have Netflix and DirecTV, both of which I use streaming video on. I also download a few DVD-sized images every month, and my wife practically lives on the web in the evenings. And yet according to my Tomato router stats, I've never even hit the halfway mark of my 250GB Comcast cap.

  20. Even more by sonicmerlin · · Score: 2

    What the summary fails to mention is that console Netflix users use even more data per month on average: 80 GB. That doesn't account for other forms of consumption, such as Hulu or downloaded games. There's a chart that shows PS3 users consume the most data of all.

  21. Re:40 GB? by Dishevel · · Score: 2

    Actually most of us dual booters use windows to fuck around an d play games and linux to do our work.
    Sorry. I had extra food and this troll looked a little hungry.

    --
    Why is it so hard to only have politicians for a few years, then have them go away?
  22. Re:AT&T's Estimate Seems Right from that. by The+Dawn+Of+Time · · Score: 2

    Populists are as good at math as they are at running things.

  23. Re:lol wut by sizzzzlerz · · Score: 2

    That is almost exactly how it works except that Netflix itself doesn't provide the caching of popular videos. Limelight and Level3 are actually the source of the video data and they will provide the storage and will serve it to the customers. When a customer requests something not in their cache, they'll go the Netflix server to obtain it and then serve that to the requestor.. That video will then be cached until such time as it ages out because there are no further requests.

  24. Re:40 GB? by Sectoid_Dev · · Score: 2

    Anorexic amputee midget masterbating (assuming one hand is available)
        Smaller file than an anorexic amputee midget gangbang.

  25. Re:lol wut by hairyfeet · · Score: 2

    I have a friend that works the local cabelco (pop 15,000) and assume what he told me is what they are doing nationwide. According to him Netflix is negotiating to set up severs that will host all of the popular content at the ISP, with only funky unpopular stuff hosted at Netflix. this way Netflix gets the customers without having to worry about the caps, the ISPs don't have to deal with PO'ed customers who hit the caps, everybody wins.

    Of course the downside is everyone who doesn't have the $$$ to set up such an arrangement is boned, but if there is one thing this country is for, it is for screwing the little guy in favor of the megacorp. Shame we don't have any choices in it, but that is what happens when the last miles are owned by a few megacorps who don't ever reinvest their profits in infrastructure. While the rest of the world ends up with 100Mbps pipes we get the short bus to the information superhighway. But at least we'll have the latest shitty Hollywood crap delivered for just $8 a month, right?

    --
    ACs don't waste your time replying, your posts are never seen by me.
  26. Data Caps Seems Pretty Generous by ffejie · · Score: 2
    I didn't get a chance to read either report yet, but it seems like 150GB would be pretty generous.

    it called the data levels generous and said limits would only affect 2 percent of its customers. It turns out Netflix users take up an average of 40GB per month just from streaming media, according to a different Sandvine report (PDF).

    So an Average Netflix user uses 40GB per month "just" for streaming media. However, that's easily the biggest chunk of the average user's usage. I can't imagine the average user is also pulling down another 40GB worth of webpages without streaming media. I would guess that if the average user is doing 40GB of Netflix, they're probably also only doing 10-20GB of everything else. Assuming various things about the distribution, it's not hard to imagine that only 2% of users are pulling down 150GB, which is more than double the average user.

    Yes, I know you can get to 150GB if you're legally downloading Linux torrents all day, but remember, we're talking about average people here.

    --
    Disagreeing with me does not mean you get to mod me troll.
  27. So they were right? by harlows_monkeys · · Score: 2

    When AT&T announced its data caps – 150GB per month for DSL users and 250GB for broadband – it called the data levels generous and said limits would only affect 2 percent of its customers. It turns out Netflix users take up an average of 40GB per month just from streaming media, according to a different Sandvine report

    So, basically, the thing that is by far the biggest use of bandwidth for most people uses between 16 and 26% of their cap? Based on this it appears AT&T was right--most people won't hit the cap.