Canadian ISP Hijacking DNS Lookup Errors
Freshly Exhumed tips us to news that Canadian ISP Rogers Cable appears to be redirecting invalid DNS requests to their own search and advertising page. Roadrunner got caught doing the same thing earlier this year. According to the article, "The hijacking appears to be an attempt by Rogers to use its Deep Packet Inspection (DPI) technology to cash in on the mistakes of its users." Freshly Exhumed also reminds us, "As IOActive security researcher Dan Kaminsky has warned in the past, this presents a very serious security problem."
I know one problem it can cause is for a number of spam tests which look for the message coming from a legitimate domain. When the DNS server says "yup, that resolves" even when there's actually no domain, the test is defeated.
The world's burning. Moped Jesus spotted on I50. Details at 11.
aaaa'rrrr!
This must be brand new. I did a test just now and a bad URL sends you here:
http://www20.search.rogers.com/search?
With appropriate variables substituted for what you were typing of course, like this:
Enter: http://www.rogersblowz.com and you get:
http://www20.search.rogers.com/search?qo=www.rogersblowz.com&rn=mEelOh0JrKFZejZ
Let the debate rage on!!!
Mark
http://www.opendns.com/
basically it is remove your ISP's dns#s and add these
208.67.222.222
208.67.220.220
Politics is Treachery, Religion is Brainwashing
If the ISP is messing with the DNS service, the best thing to do is to use a different service.
For Linux/Unix users, you can just run a caching-only server on the desktop system, and it will issue its own name requests from the root on down. I've been doing a slightly more complex version of this at home for VPN purposes. (Forward requests to my employer's net to the private internal DNS server (through the VPN), while querying the public internet for all other servers.)
I don't know it a similar option is available for Windows users w/o shelling out big bucks, but it is technically feasible
If you cannot run a caching-only server, another option is to use a third-party DNS server. The only problem here is that it would not be automagically configured by DHCP, and would have to be manually set up.
This type of behavior is wrong on so many levels so I wonder what would be the danger of having ICANN police this type of behavior? It seems that ISPs are doing more and more to circumvent "standards" for their own gain. Would it be too much to ask ICANN to come up with a set of rules that ALL ISPs must adhere to or risk losing their netblock? I'm not even sure ICANN would do anything but I'm just posing the question.
My ISP has been doing the same thing for a while now. It fucks with the stored history in my browser. I make a mistake and every time I'm typing in the correct URL later, my mistake is shown as an option from my history.
My ISP is the American ISP Charter. When I type in a bad url, I get a search page like this.
DNS is a distributed database and what these providers do is forgery of database records in the authority of the TLD registries.
I'm with Rogers too, and on my linux router "www.rogersviolatingnetneutrality.com" resolves to 8.15.7.107, 63.251.179.17, and 65.200.200.47, but on my LAN behind the same linux router, it does not resolve.
The LAN PCs' only DNS server is the linux router, which is running dnsmasq, and the linux router's primary DNS server is Rogers, and another 2 from the 4.2.2.x ones.
RCN in the Lehigh Valley (Pennsylvania) does the exact same thing. Just in the last month, they seemed to have stopped in our area... but maybe my incessant complaining did the trick. Although, who knows... maybe they just put me on a list of people who opt out, even though they told me such a list didn't exist.
I noticed this yesterday and asked about it a DSL Reports and got some interesting replies like this one:
"I've recently noticed this as well. I use rogers DNS as a secondary dns and 4.2.2.1 as my primary. Either way 30 seconds after seeing this I got annoyed and in firefox 3 typed in...
"about:config" in the address bar, accepted the "This will void warranty" message and proceeded to type in "browser.search.search" into the filter bar
you should see "browser.search.searchEnginesURL" come up after typing it, all i did was replaced the default value to "www.google.com" and instantly every time i type something in it will goto google instead wooo!!!"
read more at - http://www.dslreports.com/forum/remark,20813296
EarthLink has been doing this for years. They have a workaround using "unsupported" servers that maintains real DNS behavior.
http://blogs.earthlink.net/2006/09/more_info_on_dead_domain_handl.php
charter here in oregon does this too so I dont see what the big surprise is to everyone... its almost standard practice for ISPs... Open DNS.
Let me guess... They either already have, or soon will in a pitiful pretense of response to criticism, offer some sort of insanely weak opt-out mechanism.
I'm guessing one of two things:
Manually configure alternate DNS servers on a per device basis(a la Verizon's current setup, may they be thrice cursed)
or:
Something involving cookies, a la Phorm and friends.
For things like this, opt-out just isn't good enough.
If anyone is curious, one such Rogers DNS server is 64.71.255.198.
TDS Telecom has started doing this recently, as well. I'm not sure if their services are available in Canada, but I figure others should be made aware of it if they weren't already. Is there a list of ISP's and how they rank as far as net neutrality and subscriber privacy/rights are concerned? Not that the masses would care, but it would be nice to know which companies to avoid.
http://searchguide.tds.net/index.php?origURL=http://invalid.xyz
Another Canadian ISP, Manitoba Telecom Systems, has started doing the same thing as of a month ago. It's really scummy, but not unsurprising since they were recently privatized.
[This is Dan Kaminsky]
I took a look at what Rogers is doing. They're using PaxFire, who indeed was directly vulnerable to the attacks I described at Toorcon a few months ago. PaxFire fixed their stuff up, but yes, the security of the web at Rogers is limited to the security of those ad servers at PaxFire.
I've had to do this, and it works. No annoying Verizon snatching my failed DNS lookups!
Of course, if you try to get this out of their so-called "tech support", they will not know what you're asking for until you manage to get down to tier 2 or 3 or so. Amazing as it sounds, teir-one Verizon Fios tech support will glaze over at the mere mention of DNS, and will stupidly keep trying to get you to do inane things with your browser.
Ruby Neural Evolution of Augmenting Topologies
Verizon does the same thing. They have a howto page that tells you how to switch DNS if you do not want to see their DNS redirects page. Even if you follow their instructions and change the DNS values to the recommended ones, you still get redirected!
Only way around it is to use google to enter urls. It requires one extra step, but I do not have to see Verizon's crappy search page.
I guess the thought with the ISP's nowadays is that "everybody else is doing it, why can't we?"
09 F9 11 02 9D 74 E3 5B D8 41 56 C5 63 56 88 C0 is the magic number.
Where I live, Comcast started this a few days ago, as well. (a smaller company was sold to comcast last year, and so we were stuck with them). Oddly enough, however, instead of being redirected to a comcast page, we're being redirected to an earthlink ad page.
A spot of research brought up this Wired article from April on possible site hijacking through such error pages... http://blog.wired.com/27bstroke6/2008/04/isps-error-page.html
Not sure if it's related, but Comcast was recently in discussions to sell their rights up here (that they just bought), and one of the possible buyers, iirc, was Roger's (though am not in Canada, just very near).
This is typical of Rogers and the other government anointed monopolies. By barring foreign competition, these large businesses have no incentive to listen to customer demand and market forces. They are free to act with wanton disregard for anything, save the bottom line.
Other examples of broken laws regarding foreign competition in Canadian markets:
- The Rogers iPhone data gouging fiasco .25% interest rates on saving accounts(!!)
- Bell & Telus' plan to charge for incoming text messages
- Bell throttling its wholesale DSL customers, OUTSIDE of its network
- Expressvu (Bell again!) and Starchoice being able to package programming at inflated rates with no a-la-carte option
- Guelph Hydro taking deposits on which they 'give' customers an interest rate of prime MINUS two percent
- All Canadian banks CHARGING customers for the privilege of holding their money and paying
the list goes on. no competition = bad bad bad for consumers.
I'm a Rogers customer, and I noticed this earlier today, as I often use my Firefox address bar as a way to get to sites. What I used to be able to do is type a search term, and if the domain could not be resolved, it would do a Google search and open the first result â" which is the page I want, 90% of the time.
Suddenly, I got this Rogers (powered by Yahoo!) search page. Fortunately, I thought, there's a link to opt-out (by putting a cookie in the search.rogers.com domain). I did this, and I indeed no longer get the search page. Instead, when I type something that doesn't resolve, I'm sent to http://www20.search.rogers.com/not_found instead, which shows a broken IIS 404 (with a link to opt back in to their search program).
If they're going to provide this, it's not a big deal to me as long as I can opt out â" and truly opt out altogether.
I have Road Runner (prior Adelphia customer) and they had an opt-out mechanism, that seemed to work.
On roadrunner's business product (at my job) they didn't seem to do the same sneaky thing (no dns foully)
I've also witnessed this on Verizon FIOS, I think they had an opt-out option as well, but I'm not sure if it works, (wasn't my connection)
Its good that they are doing an opt-out, but its sneaky and should be opt-in.
-Andrew
I've switched over to TekSavvy and am very happy. Paying less, too.
This is the best way:
on resolv.conf:
nameserver 4.2.2.1
nameserver 4.2.2.2
If you have a laptop or other device where you might use different connections, this is a good way to make sure your DNSs are not changed by different apps (I might connect using either wvdial or kppp, through EDGE/3G, or using KDE's wlan manager, simple DHCP on ethernet, etc)
Just set the immutable flag on your resolv.conf file:
chattr +i /etc/resolv.conf
If you want to make it writable again run:
chattr -i /etc/resolv.conf
WTF am I doing replying to an AC at 5 A.M on a Friday night?
What is the problem with redirecting wrongly typed Url? It's not like "Page not found" helps a lot. I like OpenDNS search engine, if I miss-type the url.
Love many, trust a few, do harm to none.
So who wants to whip up a greasemonkey script that redirects the Rogers hijack page to, say, a Google search?
Please?
Why do I need a sig? I never post.
Yes, it's obnoxious and offensive and worth pointing out that at the bottom of their 'helpful' page is a link marked LEARN MORE ABOUT THIS PAGE which gives the following explanation:
These search results were provided because the domain name you entered into the address bar is either improperly formatted, currently unavailable, nonexistent, or part of a key word search. Rogers Supported Search Results is a service designed to enhance your web surfing experience by eliminating many of the error pages you encounter as you surf.
No software was installed on your computer for this service to work.
Click here if you would no longer like to receive the Rogers Supported Search Results service.
Now for the best part. All that links does is display this custom error page (with the help of a delightful cookie, no less). Rogers has dug out a crawl space under their all time low. What a bunch of idiots.
How is this news? In the US at least ISPs have been sending people off to http://wwwwh.found-not-help.com/ type places with DNS spoofing magic for years.
Two of my imaginary friends reproduced once
Windstream started this kind of crap earlier this year. I instantly installed my own DNS server. Shortly after that, I learned that Windstream has alternate clean DNS servers.
166.102.165.32
207.91.5.32
From: http://www.dslreports.com/forum/r19794173-Windstream-DNS-Servers-With-and-Without-Ads
Orange did this in the UK at least 18 months ago, I think. Tech Support wouldn't tell me how to get round it (they didn't seem to understand that I didn't feel it was a "feature"), but I found other DNS servers on the Net.
AFAIK none of it is anywhere close to DPI, though. All the other services do is have a DNS server that goes "If I can't find a legit domain then return the IP of the ISP's web server" and the web server is set to listen for all requests, regardless of domain, and then does a search/advert page based on what domain you used.
Even ignoring the technical aspects it breaks, it's just wrong on so many levels.
I got tired of dealing with braindead or deliberately poisoned DNS servers at ISPs a long time ago. Run your own. It is trivial in linux (install caching-nameserver in EL/Fedora), and I assume OSX. I suspect even Windows has an open source named you could run.
+1 Insightful
[Rimshot]
09 F9 11 02 9D 74 E3 5B D8 41 56 C5 63 56 88 C0 is the magic number.
They clearly explain that they mangle your DNS requests, and this makes their service "smart". Unfortunately, they do not explain some of the negative ramifications of this. However, their service is targeted to "end-users". Presumably, an email provider would use their own DNS server on a real OS (I do).
Domain Name: ROGERSVIOLATINGNETNEUTRALITY.COM
Registrar: TUCOWS INC.
Whois Server: whois.tucows.com
Referral URL: http://domainhelp.opensrs.net/
Name Server: NS1.MEDIATEMPLE.NET
Name Server: NS2.MEDIATEMPLE.NET
Status: ok
Updated Date: 19-jul-2008
Creation Date: 19-jul-2008
Expiration Date: 19-jul-2009
This activity by Rogers is affecting the ability of corporate VPN connections to resolve internal addresses (those located behind their firewalls) leaving Rogers customers unable to access their company's systems.
Anyone who's been a Rogers customer should not be surprised in the least by this.
Attn Rogers Customers : Switch to Teksavvy, its so nice to actually be appreciated by an ISP.
This is not a first in Canada, MTS does this too (mts.net).
I once tried to figure out why my office outlook suddenly took like 3 minutes to start up. Eventually I found out it was trying to connect to "exchangeserver", which is on the lan and not at home. Really nice of the opendns people to forward all these request to their search pages I eventually found out. After I changed the dns servers back to my isp's it outlook fails to resolve and I get to work in offline mode after a few moments of loading.
I complained to my ISP years ago that they did this. But what recourse do I have? They are the only DSL provider in my area. My other option is Comcast.
This is the problem with the stupid telecom monopolies in the U.S. They are granted monopolies, but they don't have to behave fairly. argh!
Frontier (aka Citizens, frontiernet.net, citlink.net, newnorth.net, epix.net and gvni.com - global valley) does this too. The problem is, when you "opt out" it doesn't stop.
this development is not surprising. The biggest surprise for me was the amount of money that an ISP can make by doing this. Given this fact, this trend is a natural result.
Some ISPs even learned lessons from others who were doing so before. Nowadays such a measure is implemented in a transparent way and the resulting page even contains an "opt out" button. It gets pressed only by less than 1% of all users. Why? They don't try to ram down as much advertisement as possible down the customers throat but also give a "value add" (at least for the casual user) in return (e.g. pointing out, where the typed URL may be wrong). Coupled with some heuristics (redirecting wwwww.google.com but not mxx14.somwhere.net) several ISPs introduced this features without any or very little complaints.
Wether i like it or not is a moot point. ISPs make money this way, most customers can live with it, therfore it will happen. Stupid are those ISPs who try to "force" their users to accept it. As Newton stated, any force will produce a "counter force". These "counter forces" result in negative propaganda for those ISPs and get the attention of users who didn't really wonder why their "error page" has changed before.
Given the current security state of DNS in general, the added security risk by answering for NXDOMAINs does not even approach to be a secondary problem. Making DNS more secure in general would close this loophole as well: your browser could inform you about being redirected by your ISP due to a typo.
Sincerely yours, Martin
P.S. My statement is not "this is good" or "this is bad", it's more "this is inevitable".
Earlier I went to Pandora... It was redirected to Rogers search page. I know I typed the URL correctly. I realized that my Tor wasn't running (can't listen to Pandora outside the US), I started it, and everything worked well since.
Well this is fair, they make money off the advertising and we pay for the bandwidth that it uses(although its minimal) what makes that fair?
Rogers, you really better get your act straight, just cause im on contract with you guys for another 30 years and pay my full years salary doesn't mean i like you.
Just point your browser to OpenDNS at http://www.opendns.com/. Sign up with them and you'll use their DNS servers as opposed to your ISPs. When I mistype something in my browser, they provide assistance in the form of attempting to send you to the site with the correct spelling. It's free, so there's no barrier to using them. Woadan
You can't bend reality to meet your perceptions.
This is my first time posting on Slashdot but I feel compelled to expressed how incredibly upset and pissed off I am with Rogers. No longer can I type in "bmo" to get my bank magically :(
I'm waiting for people to start posting pictures of sad looking kittens with captions of "Rogers haz broken my internetz" and what not so that I can start plastering the local Roger's buildings and offices.
Anyhow, I need to go cry in a corner or something :(
I use rogers and this just started the other day and has been freaking me out. After I calmed down and actually looked at the page it says you can "opt out" so I did. BUT it doesn't really opt you out they made a fake 404 page that is still on the rogers domain and they send you there. I only caught it because they copied exactly the IE 404 page and I am using a MAC and Safari so when it says my browser is IE it looked kind of funny. This is the same roger that everyone hates so much that apple cut the number of iphones that they sent to canada, or so I heard. Way to go Rogers, winning fans right and left.
Well, seems it's not just the big ISP - my DSL provider (Cincinnati Bell) does the same. I tried the webmale.google.com FTA which sent me to the CB search page. Any suggestions on what tact to take in filing a complaint?
The patriot volunteer, fighting for country and his rights, makes the most reliable soldier on earth. (Stonewall Jackson
Assuming you are running a Linux or OpenBSD based router, would it be possible to modify the configuration of the router so any attempt to reach search.rogers.com results in a NXDOMAIN record being returned? This could be a nifty mod to DD-WRT and similar packages.
I know this isn't the "right" fix, but it might be very effective.
Do we know that the ISP is actually using "deep packet inspection" to "hijack" DNS error responses to serve a webpage instead?
Frankly, I doubt it. Chances are more likely that the ISPs DNS software has been customized to serve up a webpage instead of respond with a DNS error flag. I don't know what you think constitutes "deep packet inspection", but this certainly doesn't (nor, in my opinion, does it constitute worthiness of a Slashdot story).
Furthermore, nothing about this violates the principle of network neutrality. No packets have filtered, throttled or shaped in any way. I'm afraid that, unless we can prove they are actually checking packets from DNS requests going to other DNS servers, testing for a DNS error, and then serving up a webpage; "net neutrality", "DPI" and "hijacking" have become mere buzzwords to throw around aimlessly to shamelessly attract media attention.
Can someone on a Roger's connection change their TCP/IP or router settings to use OpenDNS and see what happens on a DNS error?
At the risk of replying to my own question, if you are running DNSMasq on your router, you can use the command:
To block any given IP address, and thus override Rogers override. This works to prevent Rogers from displaying its search page, no matter what URL you enter.
I called Rogers and complained about this. I was told that it is possible to opt out by clicking "learn more about this page". It sets a cookie, and that "disables" the ad-loaded search page. What you get instead is a fake error page which looks like the ones that IE makes, which is easy to notice when using !IE. The icons on that error page are broken too, which shows just how half-assed this so-called opting out really is.
Did anyone else read that as Deep Pocket Inspection?
Helpfully called Supported Search Results
Opting out is just done by using non Rogers DNS servers, although this apparently leaves you in an 'unsupported' state according to the text in the opt out instructions.
It's a sign of this DPI hysteria that this article blames DPI for redirection of domain name lookup failures. The fact is, DPI is not necessary to replace NXDOMAIN answers to DNS queries with pointers to a specific server. All one needs is to do some very simple hacking of the recursive resolver. Which is easy if you are the administrator who is running it.
This likely has nothing to do with DPI, it's just a DNS server (mis?)configured to return a result for all queries.
Frontiernet does this as well - I just put in an invalid domain name, and instead of the standard error page, I get there nice search engine instead... They've been doing this for at least a year.
At least you won't get the Microsoft search page. Weren't they the original employers of this tactic? And for as much as they've been sued, they were never sued for that one.
Expect more of this, although the apparently the buck stops at your ISP. For Network Solutions it was a bridge too far.
Those are my principles. If you don't like them I have others. -Groucho Marx
When you get the Rogers search results page, click on the "learn more" link in the bottom right. Then click the link for no longer getting directed to the Rogers search results page.
I'm on Rogers High-Speed, and they are certainly poisoning my requests. Lots of ads on their invalid URL pages. It has a link on the page, "Learn More About This Page", which brings you to another ad-ridden page with the following text:
"These search results were provided because the domain name you entered into the address bar is either improperly formatted, currently unavailable, nonexistent, or part of a key word search. Rogers Supported Search Results is a service designed to enhance your web surfing experience by eliminating many of the error pages you encounter as you surf.
No software was installed on your computer for this service to work.
Click here if you would no longer like to receive the Rogers Supported Search Results service."
Emphasis theirs, obviously. Clicking the link brings you to another page with the following:
"You have successfully changed the selected landing page returned from the Rogers Supported Search Results service. If you would like to revert back to the default results page, simply delete your "search.rogers.com" cookie or return to options.search.rogers.com
NOTE: If you delete your cookies, or use a program that deletes cookies, you have to repeat this process every time your cookies are deleted."
However, I was quick to note that invalid DNS requests still bring up a Rogers page. It's not the search page -- instead, it's a fake IE "The page cannot be displayed" error! The URL for this is listed as http://www20.search.rogers.com/not_found. AFAICT it even tries to refer to a DLL to load IE-style images.
Funny how I get this message in Firefox. It does the whole "Cannot find server or DNS Error; Internet Explorer" thing. Rogers makes no reference to Microsoft trademarks on this page, funny enough.
The only thing different about the page is a link at the bottom, "Change to Supported Search Results option".
Rogers, you fucking fail.
Kaminsky demonstrated the vulnerability by finding a way to insert a YouTube video from 80s pop star Rick Astley into Facebook and PayPal domains
Nick Negroponte is a stunning success. not.
Ted's many things, but stupid isn't one of them.
-Stu
Why does this require deep packet inspection? From the description, the ISP is just replacing failed DNS responses with their own IP address. While scummy, my local cable internet provider did it two years ago, and my local DSL provider did it a few months ago. High speed internet is not available where I live without this "feature." (You can work around it by not using their DNS servers. Which is annoying as hell; I shouldn't have to use a third party's DNS server, or run my own, just to get proper service. I should be able to use my upstream provider; it's better for everyone involved.)
Search 2010 Gen Con events
$ curl -I "psufsdfsdf.com" -A "Mozilla"
HTTP/1.1 302 Document has moved Location: http://www20.search.rogers.com/search?qo=psufsdfsdf.com&rn=U6do4kni7b5-cE2
running curl without modifying user agent will get proper results.
Modify Headers currently isn't working for me to modify the User-Agent http header. Try some other firefox addon, if anyone knows of one that works properly.
Canadian ISP MTS (Manitoba Telephone System?) is doing it too.
Telefonica ISP in Brazil (Speedy) is doing the same thing, redirecting unresolved domains to ajudanabusca.com.br which contains ads from Yahoo searchmarketing.
Fixed it for you: webmale.google.com.
--- I am known for the ones who want to find me on the net. Is that a privacy risk or a privilege? One might wonder..
I first noticed this morning that Rogers was re-directing my DNS errors. My first instinct was to switch to another ISP provider. Then, I had a better idea.
I've decided to stop paying my Rogers bill.
How do you like me now, Rogers?
Mike van Lammeren
It will challenge your head, your brain, and your mind.
I haven't seen any mention of something much worse that Earthlink is doing: even if you choose not to use their DNS servers (by configuring your clients to point to a known non-earthlink server), they hijack port 53 traffic and redirect it to their own servers. So not only do the default DNS servers they give you do this hijacking, they prevent you from using your own servers as well.
TDS does this as well and their tech support didn't know what I was talking about when I brought it up. Way to break the RFCs! This is one of the reasons I went back to another provider.