Widespread Hijacking of Search Traffic In the US
Peter Eckersley writes "The Netalyzr research project from the ICSI networking group has discovered that on a number of U.S. ISPs' networks, search traffic for Bing, Yahoo! and sometimes Google is being redirected to proxy servers operated by a company called Paxfire. In addition to posing a grave privacy problem, this server impersonation is being used to redirect certain searches away from the user's chosen search engine and to affiliate marketing programs instead. Further analysis is available in a post at the EFF."
Or, if you don't like Google, use DuckDuckGo, which uses HTTPS by default with no need for a browser extension.
will using https://www.google.com help? (if you look at the certificate returned and make sure it's really Google)
For they aren't getting internet but just a subset. Last time I had that was with aol.
Site slashdotted in under 5 minutes.
Here is a list of the ISPs mentioned in the article:
Cavalier
Cincinnati Bell
Cogent
Frontier
Hughes
IBBS
Insight Broadband
Megapath
Paetec
RCN
Wide Open West
XO Communication
There is a war going on for your mind.
Don't use your ISP's DNS. Use Google DNS: 8.8.8.8 and 8.8.4.4. No way that's hijacked.
As I can't RTFA I do wonder if this explains some of the strangeness I see in doing searches between by work machine and my home machine. This really shouldn't surprise anyone as ISPs have been know to redirect DNS look up failures.
Time to offend someone
What I want to know is, can I tell if a visitor came from one of these hijacked searches? Maybe using javascript, and then warn them of the problem with their isp? I think it would be useful to tell them about using google over https, and maybe link them to the EFF article. Of course at the same time providing the same content, just with a warning.
... that's a fucking computer crime.
For once Comcast does good as my local ISP. All it does is hijack the page if the DNS doesn't resolve and then puts up its own results of what it thinks the domain should be.
I am Slashdot. Are you Slashdot as well?
List of ISPs that are redirecting some search queries
Cavalier
Cincinnati Bell
Cogent
Frontier
Hughes
IBBS
Insight Broadband
Megapath
Paetec
RCN
Wide Open West
XO Communication
Charter and Iowa Telecom were observed to be redirecting search terms, but have since ceased doing so. Iowa Telecom stopped its redirection between July and September 2010, and Charter stopped in March 2011.
Time to offend someone
For those interested, check out the book Googling Security: How Much Does Google Know About You. It provides a great deal of information on the implications of search query privacy.
anyway thats not a bad idea. In that case also an hijacked machine withing you own network plays a lesser role.
I am one of the Netalyzr developers involved in this work. I or my colleagues will answer questions in this thread, but I may be offline for a little while so responses may be somewhat delayed at times.
Test your net with Netalyzr
Make double-sure that your VPN also tunnels the DNS requests, by checking the configuration and/or by using TCPdump. EG, its pretty easy to accidentally set-up firefox through an SSH tunnel in a way where the DNS requests don't pass through the tunnel.
Test your net with Netalyzr
Comcast lets you turn that off. It's in your user control panel.
After the setting is on, they give you new DNS servers the next time you renew your DHCP lease. The new servers obey the spec and return NXDOMAIN rather than search results.
Assuming you have a browser capable of secure renegotiation (not IE on XP or older), your ISP would have to set up a certificate authority and someone would have to add the certificates into your browsers to bypass the giant red warnings.
Is there some easy way we can check for this, such as with a curl or wget command line script? A great way to defeat this practice would be to notify the businesses that are needlessly paying commissions out even though they are the first result.
Hijacking traffic like this is almost certainly a breach of RIPA and the Computer Misuse Act. This is before we get into issues like corporate governance and who is profiting from this.
Jail time for anyone involved in this. Now.
I live about 30 miles from the East Texas court most of these tech patent disputes take place at. The only (see: ONLY) high-speed service in my area is Suddenlink. The alternative sold out a few years ago. Well, lo-and-behold, everytime I mistype a URL I don't get a 404 -- I get a search result (all clad in ads) with "Suddenlink" across the top of the page. This is why so many people are worried about ISP's screwing up the Internet. First, even if Suddenlink argues they're doing me a favor, why do they get to decide which search engine my 404 is sent to? Second, that makes it awfully tempting for Suddenlink to monitor my Internet activity for targeted advertising in their 404 redirect page. And third, what the buggar are the data retention policies for the site they redirect to?
"Sorrow is better than laughter, for by sadness of face the heart is made glad." [Ecclesiastes 7:3]
Ok, I know this is just DNS and not some network-level hijacking, but crap like this is exactly why we need net neutrality. Capitalizing on customers' traffic by redirecting their searches (or otherwise interfering with customers' activities) is type of behavior net neutrality activists have claimed will happen for a long time, and that ISPs have claimed will never happen. Odd that the big players aren't the culprits for once (they're probably scared of regulation after the bittorrent scandal), but I'm sure if this is successful, or if a corrupt judge somewhere rules there is nothing wrong with what's going on, then we can expect to see all the big players stepping in and this will become a lot more widespread than it already is.
"... additional revenue through advertising based on mistyped URLs."
This is why perfect spelling is so important.
I don't see how Perspectives will help if the MITM is located in the hosting provider or its upstream ISP.
You do not have to be Google to run all your content over HTTPS.
But you do pay more per month for hosting if you run your hobby site on HTTPS. Name-based virtual hosting of HTTPS sites requires SNI, but Internet Explorer on Windows XP doesn't support SNI, nor does Android 2.x. So until IE on XP passes out of use and Android 4 (Ice Cream Sandwich) has been out for a couple years, HTTPS will still need a dedicated IPv4 address per certificate, which in practice means per domain. And now that all the /8 blocks are used up, hosting providers such as Go Daddy have started to charge per IP address.
Who makes theses decisions to hijack search traffic? Do any of theses corporation use there lawyers. I mean this is a no brainier stupid/illegal move and why did they think someone wouldn't find out? I have RCN i can say this hasn't happened to me but i don't use the search bar i search right from google.com.
Jack of all trades,master of none
Its not like its new, anyone using OpenDNS has been subjected to this bullshit since day one. And for some reasons unknown to me, half of the slashdot user base still thinks opendns is a god send. The same people who were bitching like crazy when Network Solutions started returning itself instead of NXDOMAIN for missing names, everyone was ranting about how OpenDNS is the way to go ... ignoring the fact that they do exactly the same thing ... and its a feature. Idiots.
Persistent Volume manager for Kubernetes - https://github.com/dwimsey/openshift-pvmanager
for hiring the ISP's to do their dirty work.
Is _*THIS*_ the same company that says redirecting analytics.google.com and ad.doubleclick.net to 127.0.0.1 is somehow BAD? WTF Netalyzr? get a grip or no one will take you seriously and someone will fork a similar service without giving out FUD!
Does anyone have a copy of the complaint filed?
Add Mediacom to the list. Their "search results" appear often, when not using Google, with "sponsored links" being the primary result. This sucks. Netalyzr confirmed the redirection and gave an excellent report as verification..
There's one CLEC in the western US that provides dialup service to ISP's that also intercepts search requests, forwards the search to Yahoo, etc., and alters the search engine returns by changing links and inserting ads. You'd never know what was happening unless you were watching the traffic on the port and noticed that DNS was returning the same IP address for all the search engines.
me. --a by-product of public education
I've experienced these hijacking redirects before and some were a bitch to get rid of once picked up. Not spotted this one yhet but will stay alert.
I knew there's something wrong with my Bing and yahoo search results! So how exactly are they doing that? Shaw Capital Management
A few years ago I had switched one of my private servers over to use OpenDNS instead of the ISP-provided servers, one day an automated ebay script I had mysteriously stopped working. The ebay cgi DNS A record via openDNS was now pointing to a non-ebay server, by manually running the query using wget and spoofing the browser ID (which is what my script did) I could get the page which was a redirect script that added an affiliate tag and then sent the query on it's way to the real ebay server. Needless to say I stopped using OpenDNS, I regret not making more of a stink about it at the time but I had other things on my mind. I should still have all of the intermediate files, logs and results, there isn't any point to OpenDNS denying that this happened and that they were doing it. So use OpenDNS at your own risk and realize that they might at any time also choose to hijack your traffic for their own gain.