Slashdot Mirror


Global "Last Mile" Performance Stats Going Public

Ookla, the company behind Speedtest.net, Pingtest.net, and the bandwidth testing apps deployed at many ISPs, has gone public with Net performance stats from 1.5 billion users (and counting). Their Net Index page displays download speed, upload speed, and connection "quality" from the EU and the G8, to countries, worldwide cities, and US states. Beginning today, the company is also making detailed (anonymized) data available to academics. "Ookla will also start surveying users about how much they pay for broadband and how much bandwidth they were promised by their ISPs. The results of those questions will go into building a Value Index, which will show how much people around the world pay per megabit-per-second for Internet access. In addition, by collecting postal codes from Speedtest users, Ookla hopes to map broadband service to local economic conditions, Apgar said. The Speedtest data could give the US government far more information to work with in setting priorities for its National Broadband Plan..."

45 of 233 comments (clear)

  1. Hmmmm... by OrwellianLurker · · Score: 4, Insightful

    The Speedtest data could give the US government far more information to work with in setting priorities for its National Broadband Plan..."

    I wonder if we'll give away billions to ISPs without getting anything in return again.

    --
    'Political power grows out of the barrel of a gun.' - Mao Tse-tung
    1. Re:Hmmmm... by corbettw · · Score: 2, Informative

      Why should ISPs be held to a higher standard than automobile manufacturers, banks, insurance companies, the health care system, defense contractors, oil companies, mortgage brokers, Wall St financiers, and "family" farmers like ADM?

      --
      God invented whiskey so the Irish would not rule the world.
    2. Re:Hmmmm... by hedwards · · Score: 3, Insightful

      That would be a false dilemma. They should all be held to higher standards than what they're held to presently. The reason they aren't is that right wing nutters cry ZOMG Washington elitzor controlling us whenever somebody proposes doing something about it. I swear this country has the worst blame the victim mentality of just about anywhere. What's worse is we actually have the things to actually fix it. But we won't because ZOMG Washington elitzors controlling us.

  2. Moldova? by oldhack · · Score: 2, Funny

    What's the story there?

    --
    Fuck systemd. Fuck Redhat. Fuck Soylent, too. Wait, scratch the last one.
    1. Re:Moldova? by Anonymous Coward · · Score: 2, Informative

      Few have Internet there and the ones that do probably live in the capital city. It's easy to get a good index with one heavily wired city. It was only a few years ago that people in the villages didn't have inside plumbing. Considering the amount of people *leaving* those villages (and even the country), I doubt there is much reason to wire up the villages. Many villages do have cell access and the limitations that come with it.

    2. Re:Moldova? by interkin3tic · · Score: 2, Funny

      I'm more interested in Tanzania. I'm not quite sure what the scale on either direction is, but it looks like it's zero to... something... halfway through. What, did the first person in Tanzania get broadband in the middle of the month?

      Anyway, cheers to all of us for being ahead of North Korea. At the end of the day, when we think our country has thoroughly embarrassed and disappointed us, we can still usually say "At least we're not in North Korea."

      I mean, in some contexts. Having a deity for a dear leader, for example, we're still trailing...

    3. Re:Moldova? by zill · · Score: 2, Funny

      I'm more interested in Tanzania. I'm not quite sure what the scale on either direction is, but it looks like it's zero to... something... halfway through. What, did the first person in Tanzania get broadband in the middle of the month?

      Must be one of those flights with on-board wifi passing through their airspace.

    4. Re:Moldova? by Xemu · · Score: 2, Funny

      . Having a deity for a dear leader, for example, we're still trailing...

      Not very far. Mr Jobs is very close to ascending.

      --
      Tell your friends about xenu.net
  3. The US looks pretty terrible. by Miros · · Score: 4, Interesting

    US is not in the top 10, couple of cities in the top 50 of those for download, none in upload? Is the USA really that far behind the curve, or is there another explanation?

    1. Re:The US looks pretty terrible. by drachenstern · · Score: 3, Insightful

      It's been my experience from various locales that the US really is that far behind the curve. I've friends around the world and when we discuss speeds/cost they seem amazed if they've never heard our rates before. Rather pathetic at times. Ah well, life goes on.

      Just remember, if this is what we have to complain about, are we doing so poorly? There are people around the world with no house at this very moment, due to lack of sufficient infrastructure, and our complaint is "my intertubes is too slows!"...

      --
      2^3 * 31 * 647
    2. Re:The US looks pretty terrible. by not+flu · · Score: 4, Insightful

      I was under the impression that there were people in the US with no house, too.

    3. Re:The US looks pretty terrible. by pesho · · Score: 4, Insightful

      Yes it is. Based on my experience in US and EU (including some of the East European countries that score high on the list), US is an expensive dump as far as internet access goes. The reason: there is competition and free enterprise out there unlike US. If you go in one of these eastern europe countries you get to choose from DSL, WiMAX, Cable and even ethernet cable strung from the local 'mom & pop' garage operation.

    4. Re:The US looks pretty terrible. by v1 · · Score: 4, Interesting

      The US's upload speed has always stunk. Makes it impractical for most casual admins to run a small private server for friends or even personal use. Stinks when you want to remote to your house to grab a file, where you have 20mbps downstream, and only 768kbps upstream and it just takes forever to grab the file.

      Or you can get your wallet totally shafted by your isp if they do offer higher tiers of upstream. Double your speed usually triples to quadruples your monthly cost, and you're usually starting from dirt. (256k to at best 2m)

      I pay three times the usual rate at my house because I want their "premium" 2mbps (1.5 actual) instead of the totally useless 384k. (and that's with 10-20m down being standard)

      That's an annoying racket they have going with upstream. Problem is, the majority of people that really need high upstream are businesses that need it for employee offsite email and remoting into work, uploading files to customers, etc. So ISPs milk you hard because they expect you to have money to burn.

      --
      I work for the Department of Redundancy Department.
    5. Re:The US looks pretty terrible. by 0racle · · Score: 3, Informative

      Verizon FIOS tops at 50Mbit/20Mbit down/up for $139/month according to their site.

      Now compare that to this from Japan.

      "KDDI Corp will launch a fiber-optic communications service with upload and download speeds each of up to one gigabit per second on Oct 1. ... KDDI will charge 5,985 yen in basic monthly fees for Internet and telephone services, down 1,155 yen from the current price."

      Yes, they said lowering the price. XE converts 5,985 yen to $66.29 USD. $66 for 1Gbit compared to $139 for 50Mbit.

      In everything, from the bottom all the way to the top, American internet speeds and price absolutely suck.

      --
      "I use a Mac because I'm just better than you are."
    6. Re:The US looks pretty terrible. by YrWrstNtmr · · Score: 2, Insightful

      But, if you take the EU in toto as a similar size to the US, they are virtually tied. 10.02 v 10.16. Some places great, some not so much.
      Could it be better? Hells yeah. But this is not the 3rd world backwater that many in here like to proclaim.

    7. Re:The US looks pretty terrible. by twoallbeefpatties · · Score: 4, Insightful

      The U.S. generally considers itself to be technologically advanced compared to other nations and believes that it helps to drive our economy and keep people in their houses. If it were to turn out that we actually aren't the best in the world at technological issues... well, actually, we'll probably just deny it and say that we are and whine about our lack of population density making it hard to build more infrastructure.

      --
      Libertarians somehow believe that private businesses should be stronger than governments but weaker than individuals.
    8. Re:The US looks pretty terrible. by drachenstern · · Score: 2, Insightful

      hehe, I actually thought it was by now well established that we're rather skewered on our technical prowess. We just happen to have a lot of servers in this country (so greater proportion of the internet than we deserve?), and we can play with the global monetary system since we control Wall Street. Otherwise, I see other countries out innovate us all the time. I'm rather afraid of our position slipping to number 6 or 15 or something globally before I retire (many years away).

      Oh and I should mention that it's our lack of population density that ... ;)

      --
      2^3 * 31 * 647
    9. Re:The US looks pretty terrible. by twoallbeefpatties · · Score: 2, Insightful

      Oh and I should mention that it's our lack of population density that ... ;)

      If there is a Discussion of U.S. Internet Drinking Game, rule #1 is, "Every time someone says the words 'population density,' take a shot."

      --
      Libertarians somehow believe that private businesses should be stronger than governments but weaker than individuals.
    10. Re:The US looks pretty terrible. by EdIII · · Score: 4, Insightful

      we'll probably just deny it and say that we are and whine about our lack of population density making it hard to build more infrastructure.

      What part about that is untrue though?

      People love to bring up Japan and South Korea and how fast their infrastructure is, but I don't see why it is not valid to bring up the disparities in size and population density.

      South Korea is about the size of Kentucky with much higher population density and Japan is 90% of the size of California with roughly about %50 more population density.

      Our Internet here is made up a number of competing telecoms and transit/peering agreements work great..... but when you have to keep putting fiber runs that are longer than the entire countries of South Korea and Japan why is it any big surprise that bandwidth costs more in the US?

      I think it is just a fact that in order to connect up our urban areas with fiber to each other we have to make significantly longer runs to pull it off with less potential sources of revenue per mile of fiber than countries that are apparently "better than us".

      It's not about national pride or some ego competition here. I just think you can't compare the US with other countries on a 1:1 basis. Especially when in some countries they are already started out with the new technology.

      I think for what we have to work with we are doing pretty damn good. Our big problems stem from corruption, lack of competition, and Big Media trying to own the pipes and the content being pushed on it.

      Even if all of "that" was fixed tomorrow we would still be faced with huge fiber runs all across the country that need to be made in order to keep up with demand.

      Internet is not just the only issue either. The fragile state of our Interstates and bridges also has size and density a factor in them too. I am much less impressed with Germany having an awesome Autobahn system given their size compared to us. Now if the US had an Autobahn system? Wow.

    11. Re:The US looks pretty terrible. by Shakrai · · Score: 2, Funny

      therwise, I see other countries out innovate us all the time.

      Yeah but we still out-innovate them in the blowing things up category. America, fuck yeah!

      --
      I want peace on earth and goodwill toward man.
      We are the United States Government! We don't do that sort of thing.
    12. Re:The US looks pretty terrible. by mcrbids · · Score: 5, Insightful

      Compare the United States to Canada, which has less population density than the United States and generally higher connection speeds.

      --
      I have no problem with your religion until you decide it's reason to deprive others of the truth.
    13. Re:The US looks pretty terrible. by EdIII · · Score: 2, Funny

      In all fairness half of Canada is drunk at one moment. Everything seems to be faster up there.

    14. Re:The US looks pretty terrible. by Shakrai · · Score: 2, Insightful

      Do you want a new line strung across your front yard everytime Joe Blow next door wants a new ISP?

      Yes. The utility easement should not be used for the exclusive benefit of three handpicked monopolies.

      --
      I want peace on earth and goodwill toward man.
      We are the United States Government! We don't do that sort of thing.
    15. Re:The US looks pretty terrible. by mikael_j · · Score: 3, Interesting

      Ok, so how come us Swedes mostly started to go online in the mid-90s (using regular old dialup), then everyone but the college students who were on 10 Mbps SUNET connections switched to ADSL (at that time mostly g.dmt) or DOCSIS connections, then "everyone" switched to ADSL2+ and the DOCSIS networks began to disappear (except ComHem who kept upping the speed of their network to stay competitive) and the whole time fiber connections have become more and more common (ten years ago 10/10 Mbps was the "standard" for what you could get with a fiber connection, today it's 100/100 Mbps with some people having access to 1000/1000 Mbps)?

      By your reasoning we should all still be stuck on dialup or first-gen (g.dmt) ADSL. Especially when you consider our low population density...

      --
      Greylisting is to SMTP as NAT is to IPv4
    16. Re:The US looks pretty terrible. by mikael_j · · Score: 3, Interesting

      The EU is not a nation, most ISPs do not freely operate across the borders of different European countries (although some do operate in neighboring countries, like Telenor in Sweden and Norway and TeliaSonera in Finland and Sweden).

      Also, by lumping all of Europe together you're basically trying to lower the higher speeds of some countries by throwing them in with low performers like Greece, Spain and Italy (I don't think most europeans needed netindex.com to know that these guys have fairly crappy internet infrastructure, anyone who's ever been there on vacation could tell you that, to paraphrase a description of Italy from a swede who went there a few years ago "Italy is like being in the dark ages with mopeds and indoor plumbing that occasionally works, I will never understand how these people made it into the G8").

      --
      Greylisting is to SMTP as NAT is to IPv4
    17. Re:The US looks pretty terrible. by The_countess · · Score: 2, Informative

      we'll probably just deny it and say that we are and whine about our lack of population density making it hard to build more infrastructure.

      What part about that is untrue though?

      People love to bring up Japan and South Korea and how fast their infrastructure is, but I don't see why it is not valid to bring up the disparities in size and population density.

      South Korea is about the size of Kentucky with much higher population density and Japan is 90% of the size of California with roughly about %50 more population density.

      Our Internet here is made up a number of competing telecoms and transit/peering agreements work great..... but when you have to keep putting fiber runs that are longer than the entire countries of South Korea and Japan why is it any big surprise that bandwidth costs more in the US?

      sorry but those costs are only a tiny tiny fraction of the cost of internet connections. and south korea for example has nothing to link up to at all without expensive undersea cables linking it to Japan Europe and the US. your real problem is a lack of competition at the last mile. What you have a many regional mini-monopolies you have a choice of what? 2, maybe 3 ISP? on ADSL i have so many choices i dont even know them all, but i could name 8 big ones off the top of my head available nation wide. on cable you only have one (for the moment) but with the competition from ADSL they are kept reasonably honest. al thou now that they have speeds for up to 120/10 (close to 10 times whats achievable on average on ADSL) that could change of course. why do we have so many? because the government stepped in and forced network operators to allow 3de parties on their network at reasonable rates. result : we (the Netherlands) are position 8, without a large amount of fibre connections compare that to Belgium. slight smaller country, similar wealth and population density. they are next to the US on the ranking. their government didn't step in, their speeds are much slower and maybe more importantly they still have (strict) download limits which we haven't had, (not even for the cheapest connection) for years.

    18. Re:The US looks pretty terrible. by Solandri · · Score: 4, Informative

      The vast majority of Canada is unpopulated or sparsely populated. 90% of Canadians live in a 200 km strip along the U.S. border. Distance from Vancouver to Halifax is 4443 km, giving a 200 km strip an area of 888,600 sq km (which includes a lot of water, but ignore that). Canada's population is 33.2 million, 90% of that is 29.8 million. So 90% of Canadians live in a population density of 33.5 ppl / sq km. The U.S. has a population density of 32.1 ppl / sq km.

      From net index site, the U.S. has an average connection speed of 10.16 Mbps. Canada has an average connection speed of 7.89 Mbps.

    19. Re:The US looks pretty terrible. by Anonymous Coward · · Score: 2, Insightful

      The U.S. has a population density of 32.1 ppl / sq km.

      Well, if you're excluding unpopulated or sparsely-populated regions in Canada, you should extend the same courtesy to the USA, though.

      Mean population density is meaningless for this sort of thing. What you really need is a median of sorts: for every citizen (or resident, or whatever), compute the population density of the area they live in, and then take the average (mean) of *those*.

      Of course, that's assuming you're not just looking for a way to pat yourself on the shoulder and being able to continue believing you're really number one, no matter what everyone is saying.

    20. Re:The US looks pretty terrible. by Chowderbags · · Score: 3, Insightful

      Then dump Alaska, Wyoming, Montana, the Dakotas, Idaho, large portions of Texas, some of the very large state and national parks, etc from the US estimates. If every city up and down the east and west coast were saturated with 100 Mb/s with most inland areas getting only 10 Mb/s with only the really remote and inhospitable areas not getting good service (yeah, you're probably not going to see great speed in inland Alaska for the foreseeable future), then we could say that we're doing really well. But we're not. We've got an aging infrastructure that didn't get updated due to all sorts of greed and we'll pay the price for it eventually.

  4. Re:Disclaimer: I am an unabashed American. by cruff · · Score: 3, Insightful

    Oh, yeah, we definitely won that Cold War.

    No, I think we lost the Corporate America looks only to squeeze the most profit out of consumers war. I expect the push for short term investor returns overrides the long term investment required for providing good service.

  5. Self-selection bias by NeutronCowboy · · Score: 2, Insightful

    I'm pretty sure this study wildly and unpredictably overestimates the average available broandband speed. Not too many people know how to test their download bandwidth, and only people with specific need to check their bandwidth will do so. It also doesn't differentiate between mobile and fixed broadband speeds, which should affect the numbers significantly.

    All in all, I really don't think this means anything. It could be possible to use it as a comparative tool by assuming that the proportion of internet savvy geeks is the same across the world, but I have no idea if that assumption is correct.

    I just hope that no politician is going to use this data for anything serious.

    --
    Those who can, do. Those who can't, sue.
    1. Re:Self-selection bias by jmrives · · Score: 2, Informative

      From what I can tell, the data they gathered is based on users around the world using their web site, Speedtest.net. So, there is no estimation on the part of the users. Also, the user who is testing their download and upload speeds does not have to be very tech savvy. All they have to do is open a browser, navigate to the site and click on a button to start the test.

    2. Re:Self-selection bias by talcite · · Score: 2, Informative

      It also doesn't differentiate between mobile and fixed broadband speeds, which should affect the numbers significantly.

      Why can't it differentiate between mobile and fixed broadband speeds? The user agent string from a mobile browser should be different from a desktop one. The only exception is if the mobile connection is tethered.

  6. Re:Good but still not complete by Kenoli · · Score: 4, Insightful

    $100/month apparently.

  7. Re:Disclaimer: I am an unabashed American. by WrongSizeGlass · · Score: 2, Informative

    The top 3 US States were:
    *Delaware (15.56)
    *Rhode Island (15.21)
    *Massachusetts (15.01)

    Bottom 3 US States:
    *Montana (5.02)
    *Idaho (4.29)
    *Alaska (2.27)

  8. NOT Speedtest.com, Pingtest.com by pgn674 · · Score: 4, Informative

    The addresses are Speedtest.net and Pingtest.net. And yeah, I checked to make sure I got the capitalization correct.

    speedtest.com is a squatter, and pingtest.com redirects to bandwidthplace.com, which looks awfully shady. Whois says it was registered by proxy, the Better Business Bureau has no record on that phone number, and neither does Google.

  9. the plural of "anecdote" by oliphaunt · · Score: 2, Interesting

    first a nugget of fact, then some commentary:

    1. When we moved to Portland, Oregon, we had Qwest come out to the house to rewire one of the phone jacks because the mooks who hooked it up to the outside world crosswired the connections- we didn't even have dial tone. After the tech fixed the problem, first thing he did after confirming DSL sync was to run a speed test. I asked him if that was SOP and he said that he was trained to always run a speed test for new customers- he suggested that it might be part of an upsell but that he doesn't like selling so he never comments (oh, you're only getting 750k down, but you're in an area where 7/1 MB service is available... did you know you can upgrade for just $3.50/month!???? ...). YMMV but if this is SOP for Qwest on installs, there is one population of regular testers.

    2. I agree with earlier commenters- there is probably a self-selecting sampling bias.

    3. Because of #2, any "data" they collect is probably very skewed towards computer-savvy users who are demanding higher-speed services and using their website to check if the service they're getting matches what they're paying for. Unless there are some details of the methodology that they're not telling us about, the survey probably reports higher bandwidth than actually is delivered to the majority of people with net access in those cities. If it's just a simple aggregation & average of whoever decides to click on speedtest.com from inside a given city's IP range, well, that probably tells you something... but it's probably not a good proxy for a complete picture of "last mile" connectivity.

    --




    Humpty Dumpty was pushed.
  10. Re:Sometimes by drachenstern · · Score: 2, Informative

    Eh, my iPhone gets better speeds in [45 miles nearby large town] than it does on my DSL. #JustSayin ...

    --
    2^3 * 31 * 647
  11. What cool content are you using bandwidth for? TV? by billstewart · · Score: 4, Insightful

    The reason to have high bandwidth is to do cool stuff with it. 14kbps was fine for email, then 384 for average web, then 1.5M for Napster and gaming, 3 Mbps seems to be plenty to run YouTube and BitTorrent.

    The carriers that want to sell me high-speed connections are doing it so they can sell me television, and I've got plenty of television already. When Napster was new, the public position of the cable modem companies was "Content Thieves are EEEVIL", but if you talked to them privately, most of them had enough clue to say "Dude, Napster's the reason people are buying cable modems, we love it!" But these days they don't have anything new and cool to offer, and they're cluelessly talking about bandwidth caps and no-servers-at-home policies to make sure nobody develops anything new or cool.

    So what are you doing with your bandwidth that's interesting? I've heard that old people in Korea can use it to look at video from their local grocery store to see what's on sale, but I haven't heard of anything else interesting.

    --

    Bill Stewart
    New Fast-Compression-only CPR http://preview.tinyurl.com/dy575ks
  12. Re:Mix of ADSL vs. Other Protocols by icebraining · · Score: 2, Insightful

    Well, maybe 3Mbps may be enough for Youtube, but it's not enough to preload a Youtube movie while I listen to KRTU and both Bittorrent and aptitude run in the background - especially if mine is not the only PC in the house.

    But my problem is not downstream (10 Mbps is enough for now), my problem is upstream; I have a home server that hosts my movies so I can watch them when I'm anywhere with my laptop, but my upstream can't even keep up with DVD quality playback. I always have to wait for it to download for a very long time before I can start playing, and meanwhile I'm killing all the internet access for people in my house.

  13. Re:What cool content are you using bandwidth for? by drachenstern · · Score: 2, Insightful

    That's some very excellent insight.

    - - + - + - - +

    I don't think you're asking me, but let's assume you are. Most of our family doesn't live here, so I would be using it to keep in touch with them. Additionally I do web development, and would love to be able to work from home.

    However, that doesn't fit the mold of what you're describing, because that's a consumer centric purpose. You're describing "what does the vendor get out of it". Because that's what they are everywhere but the US. Vendors. Here, they're providers. Slight difference of name, the difference being in other places the intent is to sell pipe, because there's lots of competition. I visited the south of France last year for two weeks, and I could tell that there was no dearth of competition for home IP service in that short time frame.

    However, here in the US, most localities are lucky to have two competing providers (granted, using separate tech often so that each tech only has one local provider).

    I like the point. I'm gonna have to remember to bring that up more often in this discussion when I have it with other people.

    --
    2^3 * 31 * 647
  14. What? by ratboy666 · · Score: 4, Insightful

    I keep having that reaction... Did you not READ the fine article?

    The speed test is pretty much "point to point". In my neighbourhood, it is between Scarborough Ontario and Markham Ontario (Canada).

    The speed tester automatically picks the nearest server for you, even.

    So, it DOESN'T MATTER HOW BIG THE COUNTRY IS. Peering arrangements shouldn't be coming into it either.

    By all that is holy, I would expect San Jose to have some damn fine speeds.

    I am embarrassed that the Scarborough speeds are so slow.

    --
    Just another "Cubible(sic) Joe" 2 17 3061
    1. Re:What? by EdIII · · Score: 2, Funny

      I keep having that reaction... Did you not READ the fine article?

      Just what website do you think this is?

      So, it DOESN'T MATTER HOW BIG THE COUNTRY IS. Peering arrangements shouldn't be coming into it either.

      If we are talking point to point, then yes you are correct. However, if that were really true than broadband companies would be lying to us and screwing us over. That clearly can't be true, so you must be wrong.

    2. Re:What? by $pace6host · · Score: 2, Interesting

      When I tried it, it misidentified my ISP, picked a server ~20 miles away, but only reported half the speed that dslreports.com shows when testing from a server 100 miles away (and the speed I get from dslreports.com is close to what I see when downloading files). I think maybe when it misidentifies the ISP, peering arrangements might come into play. I wonder how often it does that and how accurate the data really is.

  15. All right, let's do a fair comparison by Atmchicago · · Score: 4, Insightful

    So then compare Canada with the Northeast Corridor (Boston, New York City, New Jersey, Philadelphia, Delaware, Baltimore, DC, Richmond).

    --

    You can lead a horse to water, but you can't make it dissolve.