Global "Last Mile" Performance Stats Going Public
Ookla, the company behind Speedtest.net, Pingtest.net, and the bandwidth testing apps deployed at many ISPs, has gone public with Net performance stats from 1.5 billion users (and counting). Their Net Index page displays download speed, upload speed, and connection "quality" from the EU and the G8, to countries, worldwide cities, and US states. Beginning today, the company is also making detailed (anonymized) data available to academics. "Ookla will also start surveying users about how much they pay for broadband and how much bandwidth they were promised by their ISPs. The results of those questions will go into building a Value Index, which will show how much people around the world pay per megabit-per-second for Internet access. In addition, by collecting postal codes from Speedtest users, Ookla hopes to map broadband service to local economic conditions, Apgar said. The Speedtest data could give the US government far more information to work with in setting priorities for its National Broadband Plan..."
US is not in the top 10, couple of cities in the top 50 of those for download, none in upload? Is the USA really that far behind the curve, or is there another explanation?
first a nugget of fact, then some commentary:
1. When we moved to Portland, Oregon, we had Qwest come out to the house to rewire one of the phone jacks because the mooks who hooked it up to the outside world crosswired the connections- we didn't even have dial tone. After the tech fixed the problem, first thing he did after confirming DSL sync was to run a speed test. I asked him if that was SOP and he said that he was trained to always run a speed test for new customers- he suggested that it might be part of an upsell but that he doesn't like selling so he never comments (oh, you're only getting 750k down, but you're in an area where 7/1 MB service is available... did you know you can upgrade for just $3.50/month!???? ...). YMMV but if this is SOP for Qwest on installs, there is one population of regular testers.
2. I agree with earlier commenters- there is probably a self-selecting sampling bias.
3. Because of #2, any "data" they collect is probably very skewed towards computer-savvy users who are demanding higher-speed services and using their website to check if the service they're getting matches what they're paying for. Unless there are some details of the methodology that they're not telling us about, the survey probably reports higher bandwidth than actually is delivered to the majority of people with net access in those cities. If it's just a simple aggregation & average of whoever decides to click on speedtest.com from inside a given city's IP range, well, that probably tells you something... but it's probably not a good proxy for a complete picture of "last mile" connectivity.
Humpty Dumpty was pushed.
When I tried it, it misidentified my ISP, picked a server ~20 miles away, but only reported half the speed that dslreports.com shows when testing from a server 100 miles away (and the speed I get from dslreports.com is close to what I see when downloading files). I think maybe when it misidentifies the ISP, peering arrangements might come into play. I wonder how often it does that and how accurate the data really is.