Slashdot Mirror


Misconfigured Open DNS Resolvers Key To Massive DDoS Attacks

msm1267 writes with an excerpt From Threat Post: "While the big traffic numbers and the spat between Spamhaus and illicit webhost Cyberbunker are grabbing big headlines, the underlying and percolating issue at play here has to do with the open DNS resolvers being used to DDoS the spam-fighters from Switzerland. Open resolvers do not authenticate a packet-sender's IP address before a DNS reply is sent back. Therefore, an attacker that is able to spoof a victim's IP address can have a DNS request bombard the victim with a 100-to-1 ratio of traffic coming back to them versus what was requested. DNS amplification attacks such as these have been used lately by hacktivists, extortionists and blacklisted webhosts to great success." Running an open DNS resolver isn't itself always a problem, but it looks like people are enabling neither source address verification nor rate limiting.

179 comments

  1. First post by Anonymous Coward · · Score: 5, Funny

    In before the fight between those two guys and their walls of text...

    1. Re:First post by noh8rz10 · · Score: 4, Funny

      maybe if the routers had been configured with HOSTS FILES then all of this could have been avoided...

    2. Re:First post by Tynin · · Score: 1, Offtopic

      In before the fight between those two guys and their walls of text...

      I've begun to think it is actually just one guy just trolling (poorly) for all they are worth. Either that or it has turned into a meme that encourages the the likes of 4chan /b/tards to, in their own way, declare I am Spartacus(APK), just for the lolz...

    3. Re:First post by gl4ss · · Score: 2

      it's a meme.
      the sign of a meme is that discussion about it fills first few posts even if the actual subject of the meme is nowhere to be seen.
      and spamhauscraft confirms: gnaa is dead.

      but why is such source address spoofing still such a problem? ironically this ties in to dozens of post-packages signed apk.

      and the hosts file approach isn't that bad way to filter bunch of ads. it works...

      --
      world was created 5 seconds before this post as it is.
    4. Re:First post by AdmiralXyz · · Score: 2

      You are IGNORANT and EVIL for ignore Earth 4 day simultaneous Time Cube rotation and preaching Academic Religious Singularity... wait.

      Bloody hell, I'm on the wrong thread.

      --
      Dislike the Electoral College? Lobby your state to join the National Popular Vote Interstate Compact.
    5. Re:First post by Githaron · · Score: 1

      ... Either that or it has turned into a meme that encourages the the likes of 4chan /b/tards to, in their own way, declare I am Spartacus(APK), just for the lolz...

      More like Spamtacus.

    6. Re:First post by Anonymous Coward · · Score: 0

      Just wanted to thank you for the reference in your sig, which prompted me to read about the NPVIC. It's fascinating, and I can't believe I've never heard of it before (particularly since I've been a practicing lawyer for 10 years).

    7. Re:First post by bsane · · Score: 1

      Likewise- I'm not in favor of it, but this is the first workable proposal I've ever seen.

  2. Accidentally, or not? by six025 · · Score: 3, Interesting

    Running an open DNS resolver isn't itself always a problem, but it looks like people are enabling neither source address verification nor rate limiting.

    One has to wonder if this is caused by negligence, or if it's more a case of "oopsie, we left this door open, oh well" - which would be a great way to set up nodes around the 'net specifically to allow these types of attacks to occur.

    Not saying that is right or wrong - asking a genuine question.

    Peace,
    Andy.

    1. Re:Accidentally, or not? by h4rr4r · · Score: 1

      It might also be an old DNS server no one is using or remembers they have up.

    2. Re:Accidentally, or not? by Anonymous Coward · · Score: 5, Insightful

      Isn't the real problem the originating ISPs for allowing spoofed packets to be sent in the first place? Is it really correct to be blaming the DNS resolver that it's responding to packets it has no way to authenticate? If the original ISP dropped a packet it shouldn't be routing, the whole problem would go awa.

    3. Re:Accidentally, or not? by Urd.Yggdrasil · · Score: 1

      That would seem to be a matter of what the default configuration is. Do these DNS servers have these protections enabled by default, and are then disabled? Is it that they left it off by default on older versions? Do they still leave it off by default?

    4. Re:Accidentally, or not? by Anonymous Coward · · Score: 5, Informative

      Yep. Had BCP38 (Best Current Practice No. 38) been in effect at those ISP's, this attack would not have occurred.

    5. Re:Accidentally, or not? by LordLimecat · · Score: 3, Informative

      A DNS server has no way of verifying whether the source address is valid. Only the ISP who provides access to the originator of the traffic can do that.

    6. Re:Accidentally, or not? by Yaa+101 · · Score: 1

      This has to do with not good thought out default settings of the various DNS servers out there, but also has to do with people running too old DNS servers.
      You can restrict recursing resolve based on source IP, groups of IP or subnets.
      First I do is define an internal mode and an external mode where external mode only sees an authoritive server and the internal mode can do recursed resolving.

    7. Re:Accidentally, or not? by Koutarou · · Score: 1

      As often as not it is a judgement call of cost to fix vs. risk.

      We have the situation where we have a pair of open resolvers whose addresses have been constant for the past 17 years. We have about a quarter million customers, some who have those addresses embedded into devices whose passwords have been long since forgotten.

      The amount of support time needed to deal with these customers from putting in ACLs to the resolvers would run into the many many thousands of staff-hours.

      As we were affected by a somewhat similar attack (a DNS amplification DDoS but with different mechanics, bouncing queries off of CPE with open forwarding resolvers) last year we drop TYPE=ANY queries (I've yet to see a legitimate production query of that type ever) and rate-limit queries but access lists on the servers would require such a huge expense that its not likely to happen any time soon.

    8. Re:Accidentally, or not? by Anonymous Coward · · Score: 0

      ...except that DNS typically runs over UDP, and thus there's little you can do to filter out spoofed packets...

    9. Re:Accidentally, or not? by Anonymous Coward · · Score: 0

      1) Doon't you trust the people you work with?
      2) We believe in openness!
      3) Security just makes people angry and more likely to attack us.
      4) The service interruption from security far outweigh those of just remaining open.

      I heard every single one of those stupid excuses for a university environment that insisted on running public NFS servers of all their material, including the Subversion passwords saved in $HOME/.svn/. and which they'd recently cross-conneted to their university login system for easy web acc9ount management.

      Given that one of the professors used to write worms, you'd think they'd know better.

    10. Re:Accidentally, or not? by sjames · · Score: 1

      Many deliberately don't restrict recursive lookup as a service to anyone who needs it. The fault lies with ISPs that allow their customers to source packets with addresses they haven't been assigned.

    11. Re:Accidentally, or not? by Anonymous Coward · · Score: 0

      Yep. Had BCP38 (Best Current Practice No. 38) been in effect at those ISP's, this attack would not have occurred.

      Unfortunately some ISPs are spammer-friendly. As long as the spammers pay them, BCP38 won't be implemented and the spammers can continue to send spoofed packets.
      I wouldn't be surprised, if some of the spammers got their own AS-numbers and act as "ISPs".

      Hopefully their upstream providers gets a clue.

    12. Re:Accidentally, or not? by Lennie · · Score: 1

      Suggestion: collect a list of all the IP-addresses that send queries for a few months and then enable the ACL.

      When the next DNS amplification DDoS attack comes in a few months you won't be part of it and you don't need to handle that traffic.

      --
      New things are always on the horizon
    13. Re:Accidentally, or not? by jon3k · · Score: 1

      It's the default BIND configuration, unless they've changed it recently. If you take a (at least CentOS/RHEL) linux machine, install BIND and turn it on, you're now an open recursive resolver. I don't know if it's the distro's default bind configuration or if it's the one that ships from ISC when the package maintainers built the RPM, or what. It's your responsibility to write a bind ACL to restrict recursive resolution to particular subnets or secure it in some other way (rate limiting, etc).

    14. Re:Accidentally, or not? by jon3k · · Score: 1

      That's the stupidest thing I've read in a while. We're filtering IP traffic, the layer 4 protocol is completely fucking irrelevant. The tier2/tier3 carriers should be filtering egress traffic based on the network address space they announce to their upstream peers.

      Let's say I'm an ISP, Acme Internet. I purchase bandwidth from AT&T and Cogent and SWIP some address space from ARIN and get myself a portable AS. Now I peer via BGP with AT&T and Cogent and announce my new address space and AS. Now I go to the interfaces where that BGP peering takes place and I write an ACL that looks like this:

      permit ip [my network address range] [my network mask] any
      deny any

      Then I apply it to the interfaces on the router where I'm peering in the "out" direction (read: leaving my network). Now explain to me how the fucking transport protocol has anything to do with blocking that traffic based on source address? None what-so-fucking-ever.

      Now let's say Customer Y comes along and says: Hey, I'd like to buy internet service from you. I've got my own portable address space and here's an LOA and I want you to announce it for me. You say, no problem! You connect their equipment, peer with them via BGP using their private/public AS. Then, you go back to your ACL on your routers and you add this line:

      permit ip [my network address range] [my network mask] any
      permit ip [my customers network range] [my customers network range mask] any
      deny any any

    15. Re:Accidentally, or not? by RockDoctor · · Score: 1

      It might also be an old DNS server no one is using or remembers they have up.

      Which is just a different form of administrative incompetence.

      Proposals have been forwarded to use open DNS resolvers to DDoS open DNS resolvers to force their admins to fix their problems. Which is probably not going to help much where the actual problem is simple ignorance. If the person doing the "administration" of a system doesn't even know what DNS resolution is, then blowing them away for running an open resolver isn't actually going to do anything much more than annoy them.

      --
      Birds are not dinosaur descendants;birds are dinosaurs, for all useful meanings of "birds", "are" and "dinosaurs"
  3. Why are people not being alerted? by h4rr4r · · Score: 2

    Why are they not sending out emails to the people running these things.

    Check which domains these servers are authoritative for and send them a damn email.

    1. Re:Why are people not being alerted? by electron+sponge · · Score: 1

      Why are they not sending out emails to the people running these things.

      Check which domains these servers are authoritative for and send them a damn email.

      I agree, something proactive needs to be done. The question I have is: whose job is it to do something proactive in these instances? Does anyone do these sorts of things?

      According to the article, there are ~27 million open DNS resolvers. That might take some time. I suppose it could be automated, though, with a "Dear [admin and/or technical contact], your DNS located at [ip address] is breaking the internet. Love, Some people you have never heard of. Click here for more information." I wonder how many of the emails would get chucked as spam?

    2. Re:Why are people not being alerted? by pavon · · Score: 1

      There are over 25 million known open DNS resolvers that can be used in DNS amplification attacks. Directly contacting the administrators of all the servers used in the attack is not a tractable problem. The same is true of pretty much any DDOS attach vector; there are too many broken machines to deal with them directly.

    3. Re:Why are people not being alerted? by six025 · · Score: 5, Funny

      There are over 25 million known open DNS resolvers that can be used in DNS amplification attacks. Directly contacting the administrators of all the servers used in the attack is not a tractable problem

      It sounds like the solution is to send out a huge amount of unsolicited email.

      Oh, wait ...

    4. Re:Why are people not being alerted? by Anonymous Coward · · Score: 0

      I suppose it could be automated, though, with a "Dear [admin and/or technical contact], your DNS located at [ip address] is breaking the internet. Love, Some people you have never heard of. Click here for more information." I wonder how many of the emails would get chucked as spam?

      I get those e-mails from higher up at my work. My department's DNS isn't open, but it look open to the automated scanning software that looks for them. I'm glad they do that scanning. They do catch real problems most of the time.

    5. Re:Why are people not being alerted? by LordLimecat · · Score: 3, Informative

      Because the DNS servers are doing nothing wrong.

      The problem is that people can spoof source addresses (because ISPs arent stopping it). Fix this issue, and youll still have to worry about any of a million other scenarios where a small request gets a lot of data back.

      All you have to do is make sure source addresses are filtered when they hit the ISP, and the huge majority of these issues (as well as being able to cloak where an attack came from) go away.

    6. Re:Why are people not being alerted? by bobstreo · · Score: 4, Funny

      There are over 25 million known open DNS resolvers that can be used in DNS amplification attacks. Directly contacting the administrators of all the servers used in the attack is not a tractable problem

      It sounds like the solution is to send out a huge amount of unsolicited email.

      Oh, wait ...

      Well we could do a kickstarter, and hire our friends at Cyberbunker to host the email sending...

    7. Re:Why are people not being alerted? by Shoten · · Score: 1

      Trust me...it's not that simple. For one, there usually isn't an email to send to...there may be one listed somewhere, but it may not be real or nobody may read it. But on top of that, who is this "they" you are referring to...Spamhaus? So, Spamhaus should do a lookup on every single DNS server that is hammering them during the largest DDoS in history, find the abuse email address for each of them, and send them an email? All while getting hit with the biggest DDoS ever?

      To get a sense of why abuse email accounts get ignored in a lot of organizations, Google 'site:sans.edu abuse' and read the first 5 or six articles.

      --

      For your security, this post has been encrypted with ROT-13, twice.
    8. Re:Why are people not being alerted? by Shoten · · Score: 3, Informative

      Because the DNS servers are doing nothing wrong.

      The problem is that people can spoof source addresses (because ISPs arent stopping it). Fix this issue, and youll still have to worry about any of a million other scenarios where a small request gets a lot of data back.

      All you have to do is make sure source addresses are filtered when they hit the ISP, and the huge majority of these issues (as well as being able to cloak where an attack came from) go away.

      Actually, they are. The feature being leveraged here is that the servers are performing recursive lookups for domains that they do not control for the open Internet; BIND turns this off, by default, starting with version 9.4. The problem is that a lot of 9.3.X and older DNS servers are still out there, as well as a lot of bad network architecture jobs. The servers should only handle recursion for IP addresses that are on the inside. And as for the spoofing? Well, ingress filtering is trivial to do at the border. And these two things in concert shut this problem down entirely.

      --

      For your security, this post has been encrypted with ROT-13, twice.
    9. Re:Why are people not being alerted? by Em+Adespoton · · Score: 1

      ingress filtering at the border also has the benefit (for the providers) that customer-hosted open relays will also be blocked. Things like Tor will still work, but no more auto-forwarding/reflecting of packets. This could REALLY clean up the bandwidth the current infrastructure has to deal with, while minimally impacting legitimate traffic.

    10. Re:Why are people not being alerted? by Koutarou · · Score: 1

      During an earlier DNS amplification attack we actually identified over 1000 of our customers that had their CPE devices misconfigured to expose the onboard resolver to the internet at large.

      After contacting them we had a less than 1% rectification rate.

    11. Re:Why are people not being alerted? by sjames · · Score: 1

      Actually, they are not, or this wouldn't be happening. The attack involves sending DNS requests to an open resolver with your target's source address. If your ISP was doing the right thing, those packets would never get to the open net at all.

      I know that any time I've set up a dual homed network, the upstream providers have wanted evidence that I had a right to use the addresses I told them I would be originating. Until I provided that and a complete list of those addresses, the packets would not go out. That is as it should be.

    12. Re:Why are people not being alerted? by DrProton · · Score: 1

      That might take some time. I suppose it could be automated, though, with a "Dear [admin and/or technical contact],

      Are you joking? What if they don't read English? The most open-server dense netblock is .tw. Pakistan is also high on the list of offender IPs.

      --
      "Mit der Dummheit kaempfen Goetter selbst vergebens." - Schiller
    13. Re:Why are people not being alerted? by WaffleMonster · · Score: 1

      Why are they not sending out emails to the people running these things.

      Check which domains these servers are authoritative for and send them a damn email.

      Cause "fixing" them solves nothing?

    14. Re:Why are people not being alerted? by Maow · · Score: 1

      Because the DNS servers are doing nothing wrong.

      The problem is that people can spoof source addresses (because ISPs arent stopping it). Fix this issue, and youll still have to worry about any of a million other scenarios where a small request gets a lot of data back.

      All you have to do is make sure source addresses are filtered when they hit the ISP, and the huge majority of these issues (as well as being able to cloak where an attack came from) go away.

      Actually, they are. The feature being leveraged here is that the servers are performing recursive lookups for domains that they do not control for the open Internet; BIND turns this off, by default, starting with version 9.4. The problem is that a lot of 9.3.X and older DNS servers are still out there, as well as a lot of bad network architecture jobs. The servers should only handle recursion for IP addresses that are on the inside. And as for the spoofing? Well, ingress filtering is trivial to do at the border. And these two things in concert shut this problem down entirely.

      If my DNS is doing recursive lookups on spoofed packets, and I turned off recursion, wouldn't the attackers then send spoofed packets to, say, Google's DNS, causing the same havok?

      Sure it would be easier for Google to implement rate limiting through IP tables or whatever, but they wouldn't be able to recognise spoofed packets either.

      So I don't see how recursion is the issue versus ISPs blocking spoofed packets leaving their own networks.

      Am I wrong here, and if so, how?

    15. Re:Why are people not being alerted? by Tom · · Score: 1

      The problem is that people can spoof source addresses (because ISPs arent stopping it).

      Bingo.

      I wrote a paper about a similar attack (called a reflection DDoS attack back in the days) in 2002. Mine didn't use DNS, but a different service, but same principle - massive amplification.

      I'm honestly surprised that IP spoofing is still possible today. Have ISPs been asleep for the past decade? The number of legitimate use cases for source spoofing across a WAN (there are a number in LAN) can probably be enumerated in a very short list. I personally can think of... one: Testing if your ISP is stupid.

      --
      Assorted stuff I do sometimes: Lemuria.org
    16. Re:Why are people not being alerted? by Eunuchswear · · Score: 1

      Why are they not sending out emails to the people running these things.

      Check which domains these servers are authoritative for and send them a damn email.

      Wait. If a DNS server is authoritative it must be open. (It should also be rate-limited).

      The problem is non-authoritative servers. They should only be serving some defined set of clients.

      And ISPs should implement BCP38. (Best "current" practice. Hah.)

      --
      Watch this Heartland Institute video
    17. Re:Why are people not being alerted? by jon3k · · Score: 1

      Well, there's a couple million of them. It's really an uphill battle. For every one you shut down today another will popup tomorrow. Plus this is just one attack vector. What we need to do is get ISPs to start filtering egress traffic and we can solve an entire range of these attacks by being able to track down the source.

  4. I had a server doing this for years. by Anonymous Coward · · Score: 0

    Never even noticed until I ran Ethereal for an unrelated problem, and was like, "What is all this shit?"

    Sorry about that.

    The rate was slow enough that it never made a dent in the bandwidth usage. They must keep it throttled down but have a massive number of servers in parallel.

    1. Re:I had a server doing this for years. by Anonymous Coward · · Score: 0

      *sigh* add me to the list. It was open for years and years, and closing it was a careful process because I had to make sure it wasn't going to break anything.

    2. Re:I had a server doing this for years. by Ja'Achan · · Score: 1

      Same here, we got a call from the hosting company just last week about a huge bandwidth use. Luckily I heard about these style attacks before, so once I noticed them I knew how to stop them. Somewhere out there is a DDoS now with 20 MB/s less. Just our $0.02 I guess.

  5. Article is garbage by Anonymous Coward · · Score: 5, Insightful

    It claims that the problem is DNS resolvers that don't authenticate the sender's IP address using BCP38. It is comparing chalk and cheese. Filtering out spoofed IP addresses is something that needs to happen at the edge of the network. It's not something that a single server on the network can do.

    1. Re:Article is garbage by asc4 · · Score: 2

      This. Rate-limiting can help...I'm quite sure Google has rate-limiting in place on 8.8.8.8 for instance. But for those who don't have Google's budget, it's a challenge. There are not currently any sufficiently tested and stable DNS rate-limiting features in any of the top 3 resolvers out there. The problem here is networks letting spoofed packets out of their nets, not DNS servers performing correctly.

    2. Re:Article is garbage by Synerg1y · · Score: 0, Flamebait

      Rofl, why is this discussion at the bottom, and a bunch of newbs asking why a bunch of open DNS admins haven't doing anything about it up top. I don't get slashdot techies anymore, except the consensus they're all stupid.

      There's no point to spoofing out IP addresses at the edge of the network when the throughput is choked, it won't do anything, you can keep dropping them and turn off SYN to keep internal communication up with the edge, but the way out is clogged.

      In regards to Open DNS servers and not doing IP verification, I'd imagine that has to do with the amount of resources available to them.

      Rate limiting would help, but one day may block legitimate users as internet use expands.

      Out of all those though, rate limiting seems to make the most sense and is the lesser of the evils.

    3. Re:Article is garbage by Anonymous Coward · · Score: 0

      The point is that there's no reason for this trafic to hit DNS servers in the first place. They're spoofed addresses that should be dropped by the ISP. Sure they might still choke due to the sheer amount of trafic, but they shouldn't route it to the entire world.

    4. Re:Article is garbage by t4ng* · · Score: 1

      ISPs could very easily drop packets with fake source IPs at their borders. They know what IP addresses they own, and it's not resource intensive to check it. It would stop a whole host of problems if all ISPs did this.

      Then again... are smartphones and tablets using a mobile-ip protocol that would get screwed up by this? If so, good! Maybe those damn kids will stop staring at their phones to two seconds and get the hell off my lawn!

    5. Re:Article is garbage by Stan92057 · · Score: 1

      Well, We can say it this persons job or that persons job or it should be done this way but then that way wont work according to some people and they write to say so. The Problem is no one wants to do anything or take responsibility. This is going to cost money and its going to suck for some people. But We Have let the bad guys take over the internet, so now its going to be a costly thing to fix. Christ, we would have never made it to the moon with all the negative thinkers we have now its a crying shame.

      --
      Jack of all trades,master of none
    6. Re:Article is garbage by sl3xd · · Score: 2

      If so, good! Maybe those damn kids will stop staring at their phones to two seconds and get the hell off my lawn!

      Now will you believe that there are good reasons to not open your WiFi?

      !!! You've got kids from the whole neighborhood just hanging out on your lawn, leeching your WiFi. Think of all the pheromones coming from all those kids wishing that cute thing a few steps over would look up from the phone and talk to them. All of those awkward glances and giggles.

      At this point, the last thing you need is one of them downloading a nude picture of one of their classmates (which will happen several times a week...). Can you imagine the fallout if you not only have "kiddie porn" being downloaded on your network -- but said "kiddie" was regularly seen on your yard

      Keep your WiFi closed. Turn on your sprinklers, loose the hounds! You'll get those damn kids off your lawn, clean up your air, and stay out of jail!

      --
      -- Sometimes you have to turn the lights off in order to see.
    7. Re:Article is garbage by LordLimecat · · Score: 1

      Youre not understanding how the spoofing works, and "the way out being clogged" is irrelevant when youre getting 100-1 amplification off of large numbers of bots.

      The attacking computers are claiming that their source address is that of the person they want to attack; they request a large DNS file; the DNS server sends its gigantic response to the victim (who has been impersonated).

      The DNS server CANNOT realize that the source IP was forged without sending additional traffic. The ISP however CAN, since they know what IPs should reside at each edge of their network, and all they have to do is block those forged addresses, and every single amplification-based DDoS goes away.

    8. Re:Article is garbage by Synerg1y · · Score: 1

      Right, the post I was talking about was saying that the traffic should be filtered at the edge of the network, my point is that wouldn't do anything.

      I meant...

      There's no point to filtering out spoofed IP addresses

      w proper sentence structure lol.

      AC didn't specific which network the ISP's or spamhaus. I agree the ISP can fix it though, getting them to do so carries its own set of challenges.

      Here's a good read for anybody still confused: http://arstechnica.com/security/2013/03/spamhaus-ddos-grows-to-internet-threatening-size/

      Basically restates the above post + politics.

    9. Re:Article is garbage by Em+Adespoton · · Score: 1

      Right, the post I was talking about was saying that the traffic should be filtered at the edge of the network, my point is that wouldn't do anything.

      I meant...

      There's no point to filtering out spoofed IP addresses

      w proper sentence structure lol.

      AC didn't specific which network the ISP's or spamhaus. I agree the ISP can fix it though, getting them to do so carries its own set of challenges.

      Here's a good read for anybody still confused: http://arstechnica.com/security/2013/03/spamhaus-ddos-grows-to-internet-threatening-size/

      Basically restates the above post + politics.

      Actually, all that needs to happen is for the ISPs to correctly set their drop tables on their BGP policies. These tables should be set up by default when the ISP acquires a netblock, and updated each time a netblock is added/dropped. It's SOP, and not difficult.

      For consumer-facing ISPs who don't have BGP to peer with other networks (but are just a subscriber themselves), they can just configure the drop tables on their border switches so that only source IPs within their netblock can be sent outbound. This provides them with MANY advantages (as it lowers potential bandwidth usage and lessens service abuse and resulting support tickets) and for most providers (except those who dynamically lease from multiple netblocks for the same pool -- something you shouldn't be doing without BGP) carries no risk. It's 2 hours during the maintenance window (to allow for testing before deploying) that will likely pay for itself within a day.

      In short, the only reasons I can see not to do this are complicity, laziness and ignorance.

    10. Re:Article is garbage by MaraDNS · · Score: 1
      Out of all those though, rate limiting seems to make the most sense and is the lesser of the evils.

      Except for the fact that some DNS servers do not have rate limiting nor the funds to implement rate limiting (it's non-trivial to implement), you're right.

      In my case, without EDNS support, the highest amplification factor my DNS server has is 23x (as opposed to the 100x+ EDNS servers have). Also: My server doesn't have open recursion enabled by default.

      --
      MaraDNS is an open-source DNS server.
    11. Re:Article is garbage by mukund · · Score: 1

      There is a rate limiting patch for BIND. The BIND package in RHEL/CentOS has it now:
      https://bugzilla.redhat.com/show_bug.cgi?id=873624

      A person has also attached a graph showing its effect on that bug page. I know of some other places which are using this patch.

      (Disclaimer: I work for the organization that produces BIND.)

      --
      Banu
    12. Re:Article is garbage by WaffleMonster · · Score: 1

      There is a rate limiting patch for BIND. The BIND package in RHEL/CentOS has it now:

      If you really want to solve the problem then implement DNS cookies.

      Please think about what your doing. Rate limiting solves nothing. Once this is deployed the attacker will simply alter the contents of their queries rather than resending the same tired request such that it now becomes indistinguishable from background with much the same results. At that point any additional rate limiting hurts legitimate users just as much as attackers.

      This is your typical spam fighting downward spiral. You see a problem and you fix it. The fix solves nothing because your advasaries have brains but you sure as hell break shit and waste everyones time in the process.

  6. Determining vulnerability? by ShaunC · · Score: 1

    I see that the Open Resolver Project has a tool to scan for offending servers in your IP space, but it doesn't explain what the results indicate. I'm guessing that an RCODE value of 0 means you're not part of the problem?

    --
    Thanks to the War on Drugs, it's easier to buy meth than it is to buy cold medicine!
    1. Re:Determining vulnerability? by h4rr4r · · Score: 1

      I believe any server it lists is part of the problem.
      Servers that are not part of the problem should not be listed at all.

    2. Re:Determining vulnerability? by ShaunC · · Score: 1

      I found 8.8.8.8, 4.2.2.4 etc. on there, which I'm hoping are set up responsibly. But I don't know of a "known bad" resolver to scan and see if the results come out differently.

      --
      Thanks to the War on Drugs, it's easier to buy meth than it is to buy cold medicine!
    3. Re:Determining vulnerability? by heypete · · Score: 1

      Well, that makes sense: the Google Public DNS servers are indeed open resolvers but they have all sorts of mechanisms in place to prevent their being abused.

  7. Misconfigured slashdot editors by Anonymous Coward · · Score: 0

    Repeatedly post the same story.

  8. Hoax? by Ubi_NL · · Score: 4, Interesting

    I know Its not the primary topic here,, but gizmodo has some evidence that the whole cyberbunker thing is a fake

    http://gizmodo.com/5992652/that-internet-war-apocalypse-is-a-lie

    --

    If an experiment works, something has gone wrong.
    1. Re:Hoax? by Anonymous Coward · · Score: 2

      I know Its not the primary topic here,, but gizmodo has some evidence that the whole cyberbunker thing is a fake

      http://gizmodo.com/5992652/that-internet-war-apocalypse-is-a-lie

      WHOA WHOA WHOA. No.

      This 'thing' is definitely real. It's happening. That's not in question. What ISN'T real, however, is CloudFlare's assertion that it's "jamming crucial infrastructure around the world".

    2. Re:Hoax? by gl4ss · · Score: 1

      dunno, it is real if you define spamhaus as crucial infrastructure.

      it isn't though..

      --
      world was created 5 seconds before this post as it is.
    3. Re:Hoax? by Anonymous Coward · · Score: 0

      gizmodo and "evidence" are an oxymoron aren't they? Anything under Gawker is suspect, and giz has always been gutter level.

    4. Re:Hoax? by liamevo · · Score: 1

      The article itself state this exactly.

    5. Re:Hoax? by Shoten · · Score: 1

      gizmodo and "evidence" are an oxymoron aren't they? Anything under Gawker is suspect, and giz has always been gutter level.

      If I hadn't just posted twice, I would mod this up in agreement. Gizmodo is a blog that posts gadget-related rumors and the like...and even then they suck up the snake oil like Robert Evans snorts cocaine.

      --

      For your security, this post has been encrypted with ROT-13, twice.
    6. Re:Hoax? by Anonymous Coward · · Score: 0

      Definitely not fake. I can verify that both Spamhaus and Project Honey Pot (which was also attacked but not mentioned anywhere) were down. Also in dispute from Giz is not that it happened, but rather if the DDoS was 300Gbs and if that was enough to interfere with tier 1 traffic to "break the Internet". All I can say is that you RTFA from Giz before saying it's a hoax.

    7. Re:Hoax? by Em+Adespoton · · Score: 1

      Added to that, if it was a hoax, it piggybacked the IXes mentioned having significant routing issues, all at the same time, around the time CloudFlare, a respected hosting service who claimed to be affected, started blogging about it. You might not have noticed, but anyone with a network presence in the UK, Netherlands or HK definitely did; traceroutes were all you needed to see the disruption for yourself.

      So... documented reports from those who actually route the Internet plus much anecdotal evidence vs comments on Gizmodo from anonymous sources -- I think I know what I'll prefer to believe.

      The cyberbunker part might be pure conjecture, but the DDoS was pretty obvious.

    8. Re:Hoax? by MaxDollarCash · · Score: 1

      I know Its not the primary topic here,, but gizmodo has some evidence that the whole cyberbunker thing is a fake

      http://gizmodo.com/5992652/that-internet-war-apocalypse-is-a-lie

      Well reading your quoted article is worrisome as it goes as far as describing a Ddos attack as a nuke. Do I feel another law, restriction coming up?

  9. 46.244.10.0 - 46.244.10.31 by Anonymous Coward · · Score: 0

    Are there any routers that will ever talk to that range of IP addresses ever again, other than the ones run by a2b-internet.com?

  10. Arrest them! by Billly+Gates · · Score: 1

    Have the SWAT team bust down their door and hall their asses to jail. Seriously, this is rediculous. Hacking into someone elses servers is a sevre crime the last time I looked and there is ample evidence from OpenDNS who does not even have to file charges.

    Otherwise you are showing the Russian Mobfia and others they are not accountable to their actions and can do whatever the hell they want. I wish more arrests would be made. Shutting down and arresting cyberpunk officers would be a great start. After all they got KimDotCom and he didn't do damage. I have noticed youtube is barely working with syncing issues and I am on fios which is no doubt related as Google admits they trying to absorb the punch so the internet doesn't get knocked out

    1. Re:Arrest them! by Anonymous Coward · · Score: 0

      And you know 100% for sure that these bunker spammer folk are the ones that actually carried out the attack, and not some random stranger on the internet that just felt like showing off his skillz by taking two people arguing with each other and making the whole planet think that one attacked the other for "the lulz"?

      SWAT/police need a little more proof than "I think they did it" before they kick in a door (or a bunker...) with guns.

    2. Re:Arrest them! by burne · · Score: 1

      Have the SWAT team bust down their door and hall their asses to jail.

      Smart! Leave nobody to switch off the botnet!

    3. Re:Arrest them! by Anonymous Coward · · Score: 0

      Have the SWAT team bust down their door and hall their asses to jail. Seriously, this is rediculous. Hacking into someone elses servers is a sevre crime the last time I looked and there is ample evidence from OpenDNS who does not even have to file charges.

      "What? You're saying the kids are just copying a bunch of bits for free? Come come, how can the movie studios be mad about THAT? Those little scamps get into all sorts of mischief these days, and the studios should know that!"

      "Oopsie-doodle! Someone installed a <voice mode='mocking'>big mean scary hacking backdoor at his job</voice> because his own self-absorbed paranoia led him to believe nobody could ever do his job at all, so he needed to hold an entire city's tech infrastructure hostage? Oh, please! Now you're just being silly! We've all had days just like that! He's just a silly-willy innocent sysadmin who everyone can relate to! Obviously, the city should've trusted him more, else he wouldn't have had to put everyone at risk like that! If only you worrywarts would look at the big picture, you'd see it was perfectly fine to have a single emotionally unstable psychopath with a god complex in control of the communication network of one of the largest metropolitan areas in the world!"

      "Guffaw! Well, wouldya look at that? The tykes arranged a DDoS of some government entity I don't like! Well, ain't that just the cutest darned thing? And look! Now they're releasing the personal information of innocent government workers who're just trying to do their jobs! Aww, that's just adorable! Better luck next time, people who expect to be able to do their jobs or have an expectation of privacy working for a larger group we don't like right now! Maybe if your entire function wasn't marginalized by the comic books we immerse ourselves in regularly, we might be able to see deeper and find some pity for you as human beings, rather than dismiss you all as comical exaggerations of a binary good vs evil battle!"

      "Hey, isn't that someone doing a DDoS on some server I don't find offensive? MURDER. EVERYBODY. NOW. This is an abomination not only against GOD HIMSELF, but against ALL POSSIBLE DEITIES EVER CONCEIVED BY MAN, BEAST, OR ALIEN. No punishment is too severe. We must wipe the attacker's current country of residence from existence until we find him and know he is dead. Then his birth country must be cleansed to ensure nothing like him can ever be born again. THIS WAS A DDoS, PEOPLE. YOU NOW ALL HAVE LICENSES TO MURDER. FAILURE TO DO SO IS A FURTHER CRIME AGAINST EXISTENCE."

    4. Re:Arrest them! by PlusFiveTroll · · Score: 1

      >Have the SWAT team bust down their door and hall their asses to jail.

      Cannot tell if serious...

      If you read the cyberbunkers website, that happened once. Dutch swat showed up.. Looked at gigantic steel doors for a nuclear bunker... Left.

    5. Re:Arrest them! by Anonymous Coward · · Score: 0

      Agree to reduce the sentencing if one of them pleads guilty and gives instructions on how to shut it off? Make it known if they do no cooperate a coworker gets to walk if he or she agrees or gets a reduced sentence.

      Boy, will that get an answer fast as hacking is a crime where you can get up to a decade or more in prison. This is what cops and the FBI do all the time.

    6. Re:Arrest them! by mjwalshe · · Score: 1

      OK just cut of the power and wait for them to come out :-) or come back with a thermic lance or as its the police just lob teargas into the vents (the cops being allowed to use gas where military forces are not) .

      of course the classic way of solving the this sort of problem was done at Eben-Emael forts in WW2 was to use shaped charges to blow a hole.

    7. Re:Arrest them! by Em+Adespoton · · Score: 1

      OK just cut of the power and wait for them to come out :-) or come back with a thermic lance or as its the police just lob teargas into the vents (the cops being allowed to use gas where military forces are not) .

        of course the classic way of solving the this sort of problem was done at Eben-Emael forts in WW2 was to use shaped charges to blow a hole.

      Or, just go to their physical upstream provider (the one who feeds them the cable) and tell them to cut the connection. Then wait for someone to show up to complain.

    8. Re:Arrest them! by Anonymous Coward · · Score: 0

      If you read the cyberbunkers website, that happened once. Dutch swat showed up.. Looked at gigantic steel doors for a nuclear bunker... Left.

      And maybe if you repeat it often enough you will even start to believe it yourself. Do you always get your crime news from the criminal's site?

      This is The Netherlands people, not the USA, there isn't a granny with an elephant rifle behind every door, and people have no arsenals of military weapons unless they want to get into a lot more trouble than by playing hide and seek on the internets. If there was a court order (https://en.wikipedia.org/wiki/Court_order for the americans who never heard of this) to knock their door down, it would be down. Luckily our courts still require solid proof of wrongdoing that warrants such an action before they give permission to do so. We don't generally consider "collateral damage" acceptable in white collar crimes.

  11. I'm not quite sure how you're supposed to do it? by green1 · · Score: 1

    Maybe this is over my head. But how would one rung a "safe" DNS server then? My interpretation of the article basically says to let only specific people use your DNS server, but then how would a company run a public resolver?

    For example, Google runs open public name servers on 8.8.8.8 and 8.8.4.4, same with OpenDNS, and many, many more. What is to stop those servers from being used in this sort of attack? Is this article really advocating a situation where you MUST use only your own ISP's resolver and trust them not to do what so many of them consistently do and mess with the results?

    Or am I completely missing the point to this article?

  12. these people are worse by v1 · · Score: 1

    than the users that get their computers infected with botnets and spew spam. These people are supposed to know what they're doing.

    Take away their Geek Card, and then suspend their internet license ;)

    --
    I work for the Department of Redundancy Department.
    1. Re:these people are worse by Anonymous Coward · · Score: 0

      Ah do you know which version of bind it is auto off in? Do you know the settings to turn it off? Or did you get a copy that was installed with you oldish copy of ubuntu and you did not even know it was there?

      By your logic everyone should know every setting of every server program out there if you just want to run something. You should have a masters degree before tuning some software on.

      More than likely these are older copies of bind (on by default bellow 9.3ish). Bind is the sort of software you stand up and forget about it because it 'just works'.

      The real issue is these packets are even leaving the L1/L2/L3 networks with 0 checking of source address. Address spoofing is interesting in an academic world. However it should be a rare thing on the live internet... But it is amazingly common...

    2. Re:these people are worse by v1 · · Score: 1

      By your logic everyone should know every setting of every server program out there if you just want to run something.

      If you've got a fat enough pipe to do damage from someone abusing your system, and are running an externally-facing service like DNS, that is KNOWN to be an attack vector, then YES, I can, and WILL expect you to know what you're doing, so you're not a danger to others, or ME. You've gone to the trouble of taking off the training wheels, and with power comes responsibility.

      As it is now, the internet is like the interstate with their 80 yr olds flinging giant Winnebagos down the road without requiring them to hold a CDL, and they're just as much of a problem. People wielding dangerous tools need to be knowledgeable and responsible with them, and held accountable and partially liable when they aren't. Ignorance is not a defense.

      --
      I work for the Department of Redundancy Department.
  13. Alternate article by SternisheFan · · Score: 1
  14. Re:I'm not quite sure how you're supposed to do it by nairnr · · Score: 2

    Maybe this is over my head. But how would one rung a "safe" DNS server then? My interpretation of the article basically says to let only specific people use your DNS server, but then how would a company run a public resolver?

    For example, Google runs open public name servers on 8.8.8.8 and 8.8.4.4, same with OpenDNS, and many, many more. What is to stop those servers from being used in this sort of attack? Is this article really advocating a situation where you MUST use only your own ISP's resolver and trust them not to do what so many of them consistently do and mess with the results?

    Or am I completely missing the point to this article?

    Two different things. If you are running a DNS server yourself, for your own domain then you should only respond to requests for your domain from the outside. IE - Non-recursive. The only answers you serve are for those queries you are authoritative for. You only accept recursive queries from inside your own network. Those are the recursive ones.

    Public servers would use rate-limiting to to protect against being effective in spoofed attacks.

  15. By Design by Anonymous Coward · · Score: 1, Interesting

    DNS resolvers were originally intended to be open. There was no reason for them not to be. But furthermore, the recursive functionality of DNS made open resolvers a near requirement. This has changed a little and slowly over the years, but it's still largely the case.

    Now compound the above with the fact that neither of the two most widely used DNS servers on the planet, BIND and MicrosoftDNS(That's right Bernstein fans so STFU.), check requesting source address validity. It's not in the spec, so why should they?

    This attack suggests that the spec needs refinement, but don;t go blaming people for doing what has been accepted best practice for the past 20 years or more.

    1. Re:By Design by quintus_horatius · · Score: 1

      It's not the job of the DNS server or protocol to check the source ip; that job belongs to the firewall.

    2. Re:By Design by LordLimecat · · Score: 2, Insightful

      Can someone explain how a DNS server can check source address validity? Is it going to fire off more packets to that source address (worsening the DDoS) or what?

    3. Re:By Design by Anonymous Coward · · Score: 2, Informative

      There is no way that DNS over UDP can verify a source address. The solution is that all ISPs drop traffic with invalid source addresses before it leaves their network.

    4. Re:By Design by Alex+Pennace · · Score: 3, Interesting

      DNS resolvers were originally intended to be open. There was no reason for them not to be. But furthermore, the recursive functionality of DNS made open resolvers a near requirement. This has changed a little and slowly over the years, but it's still largely the case.

      [...] It's not in the spec, so why should they?

      The changing environment now calls for doing things that weren't done years ago. We have already crossed this bridge with open email relays; this isn't necessarily the case here (the real problem is the lack of IP spoofing protection), but it would be nice for administrators to realize that they may have an open resolver. Many of them will decide that there is no point in offering free DNS resolution services to the whole world and take steps to restrict access. Some will decide that they want to continue offering it; more power to them.

      Far from being a requirement, a DNS resolver works just fine if it isn't wide open.

      This attack suggests that the spec needs refinement, but don;t go blaming people for doing what has been accepted best practice for the past 20 years or more.

      I wouldn't go as far as to accuse them of malfeasance or negligence, particularly since the real problem is lack of BCP38 compliance. So lets not do that. Instead lets educate administrators and permit them to make their own decisions; in this case the decision will likely be to restrict.

    5. Re:By Design by mysidia · · Score: 2

      Far from being a requirement, a DNS resolver works just fine if it isn't wide open.

      Yes, but an authoritative DNS server does not, and authoritative DNS servers can still be used in reflection attacks.

      Zone files that contain a large response for an easily found query are especially popular.

      The problem to be solved is not a DNS problem, but a failure to implement BCP38 / Ingress filtering implementation problem.

      Failure to implement ingress filtering is worse than open mail relay, because it allows bad actors to hide their identity.

    6. Re:By Design by mpe · · Score: 1

      Now compound the above with the fact that neither of the two most widely used DNS servers on the planet, BIND and MicrosoftDNS(That's right Bernstein fans so STFU.), check requesting source address validity.

      IIRC MicrosoftDNS is slightly modified version of bind 4.

    7. Re:By Design by Eunuchswear · · Score: 2

      Since an authoritative DNS server only handles requests from recursive caching servers it can implement rate limiting, thus making reflection attacks useless.

      But you're right - the failure to implement BCP38 is a bloody scandal.

      --
      Watch this Heartland Institute video
    8. Re:By Design by kasperd · · Score: 2

      Can someone explain how a DNS server can check source address validity?

      That's the question I wanted to ask. I can give a partial answer to the question, but no the complete solution implied to exist by the summary.

      When the server sends a DNS reply back to a legitimate client, it is not supposed to receive any more packets related to that query. However, if the source address was spoofed, the receiver of the packet will send an ICMP error back indicating the port is closed, or an ICMP error indicating the port is blocked by the firewall, or an ICMP error indicating that the address is unreachable.

      You can look for those ICMP errors to find out if your own DNS server is part of the attack with a tcpdump command looking for example like this:

      tcpdump -pni eth0 -s0 'icmp[8] == 0x45 && icmp[17] == 0x11 && icmp[28] == 0 && icmp[29] == 53'

      One caveat to remember is, that the ICMP error itself could be spoofed, so some verification would be needed to validate the ICMP error. Also requests spoofing the IP address of a legitimate client of the DNS server means there could be spoofed and legitimate queries arriving from the same source IP address, and just blocking all of those, would introduce a different kind of DoS vulnerability.

      So detecting the attack on the DNS server after the fact is easy in principle. But responding to it in a way that doesn't DoS the DNS server itself is tricky. The best I can come up with is force clients to switch to TCP by sending an empty reply with the truncated flag set. That would reduce the amplification factor to one or less, effectively making this DNS server of no use for the attacker. But it would severely reduce the efficiency of DNS lookups on that server, and completely break it for setups, that assumed DNS lookups were always done over UDP.

      If there exists a better solution, I'd like to hear about it. Moreover the best solution I can imagine doesn't seem to be implemented by bind. The best I could come up with for bind is:

      max-udp-size 512;

      Is it going to fire off more packets to that source address (worsening the DDoS) or what?

      If you are sending just a single packet to the victim, and that packet is smaller than the DNS request, then the amplification factor is less than one, and the attacker would be better off attacking the target directly. But such a packet needs to be designed to trigger an appropriate response from the DNS client.

      One thing you could do when receiving a DNS request from a previously unknown IP address is to always respond with a truncated reply.

      • If it triggers an ICMP error the request is not legitimate.
      • If it triggers a request over TCP the request is legitimate, and you can safely send large replies over UDP to that particular IP address until one of them triggers an ICMP error.
      • If it triggers no response at all, the address you send the reply to is misconfigured in some way. Or the network is congested, which could indicate the address is under attack. In that case you just keep sending truncated replies to that IP address until you know better.

      All in all that results in the following simple algorithm.

      • If you receive a request over UDP and the address is in the cache of known clients send a full reply.
      • If you receive a request over UDP and the address is not in the cache of known clients send a truncated reply.
      • If you receive a request over TCP add the address to the cache of known clients.
      • If you receive an ICMP error (matching a reply you recently send), remove the IP from the cache of known clients. (Optionally implement a counter such that it takes e.g. 10 ICMP errors to remove an entry from the cache.)

      As for rate limiting, I looked in the bind manual and found no mention of any way to configure rate limiting. Maybe they used another name for it.

      --

      Do you care about the security of your wireless mouse?
    9. Re:By Design by kasperd · · Score: 1

      There is no way that DNS over UDP can verify a source address.

      You can validate it after the fact. If you receive an ICMP error it was not legitimate. If you can get it to connect over TCP by sending a truncated reply, it was legitimate.

      The solution is that all ISPs drop traffic with invalid source addresses before it leaves their network.

      This is unrealistic. If you want to design a secure system, you are better off designing it under the assumption, that anybody can spoof source IP addresses. Filtering packets based on source address can be useful in some cases, but it shouldn't bee seen as the solution to DDoS attacks.

      --

      Do you care about the security of your wireless mouse?
    10. Re:By Design by Anonymous Coward · · Score: 0

      There is no way that DNS over UDP can verify a source address.

      You can validate it after the fact. If you receive an ICMP error it was not legitimate.

      A couple of problems with that approach:

      • a) first and foremost, most hosts do not respond anything to illegitimate UDP packets
      • b) even if they did, by the time the DNS server would receive the ICMP error message, it would have already sent out the big response packet, which is causing the DDoS
      • c) DNS is stateless. So even if the previous request was illegitimate, will the next request also be?
        • Assume yes: now you can DoS any server off the Internet by flooding their primary DNS server with illegitimate requests, causing their primary DNS server to assume that also every valid request is illegitimate.
        • Assume no: nothing is solved. DNS server may now log that there was an invalid request, but it will still keep sending them out.

      If the problem is to be solved by updating the DNS servers, there would have to be some sensible rate limiting default for UDP requests. But this could take years to deploy fully.

      The solution is that all ISPs drop traffic with invalid source addresses before it leaves their network.

      This is unrealistic. If you want to design a secure system, you are better off designing it under the assumption, that anybody can spoof source IP addresses.

      You're right, it's very bad to assume any packet has a valid source IP. But my point was that in order for the attackers to use this attack vector, they must find an ISP that lets them send out packets with spoofed source IPs. These ISP do not do their egress filtering right, and as Internet is based on protocols and good practices, it's fair to say that these ISPs have their networks misconfigured.

      Given how many more vulnerable open DNS servers are out there (millions, run by a plethora of different individuals and organizations), compared to those few ISPs that let out spoofed IP packets, it's much more efficient to tackle this problem by persuading those ISPs to start doing their egress filtering right.

      It definitely does not mean that application programmers can start assuming all source IPs are valid (it still might originate in the local network, where no egress filtering can be done). But it sure would make it much harder for the attackers to find an ISP that would allow them to abuse their networks for sending spoofed IP packets to the wild, which is an absolute requirement for this type of an attack.

    11. Re:By Design by LordLimecat · · Score: 2

      that anybody can spoof source IP addresses

      Its absolutely realistic, and that statement is only true because ISPs are lazy.

      Look, Im verizon. I know that my DHCP servers in a neighborhood are providing 98.142.30.0/24 to those folks. Hey look, a packet claiming to be sourced from 132.29.42.27, I wonder if thats legitimate or if my border routers should just drop it?

      There is NO scenario where a wired internet connection should be spoofing IP addresses, because the ISP will NEVER be able to deliver return traffic to that person. I have heard that there are possible justifications for spoofing in the mobile space, but lets be realistic; 99% of bots are not mobile, they are on static lines where ingress filtering would put an immediate stop to amplification attacks.

      Your idea that DNS servers now need to fire off ICMP traffic to verify source address- what happens when the IP is legitimate, its just someone else? Now on top of your large zone file that youre going to hit them with, youre dumping ICMP traffic too-- you just made the amplification attack stronger.

      TCP/IP (and ethernet) operate on the assumption that nodes are not lying when they write their source MAC and IP addresses. It is technically possible for a node to do so, but guess what-- it is trivial to implement layer 2 and layer 3 ACLs to stop that crap at the first hop.

    12. Re:By Design by LordLimecat · · Score: 1

      If there exists a better solution, I'd like to hear about it.

      BCP 38, which does the source address checking where it can be done-- at the first hop controlled by the provider and router of the IP address, the ISP. They know what IPs should be coming in from which ports, since they provide the ports and IP addresses (port in this case meaning PoP / physical connection).

    13. Re:By Design by kasperd · · Score: 1

      most hosts do not respond anything to illegitimate UDP packets

      I know lots of people block ICMP packets to "protect" their network. Maybe these misguided attempts at protecting networks will stop, if sending those ICMP errors would actually reduce the incoming flow of attack traffic. If it was common practice among DNS servers to take countermeasures, once they receive ICMP errors, then this thread would have looked differently. In that case, it would have started out with explanations about how incompetent the administrators were to put their own network at risk, by blocking legitimate ICMP packets.

      even if they did, by the time the DNS server would receive the ICMP error message, it would have already sent out the big response packet, which is causing the DDoS

      One packet does not constitute a DDoS attack. And one packet from every single DNS server on the net, would still be a tiny attack.

      I already pointed out just looking for ICMP errors is only detecting the illegitimate packet after the fact. The tricky part is what countermeasures to take. And in case we can come up with countermeasures with minimal impact, we could apply those even before knowing if there is an attack. I described one method, which involves sending a truncated reply and using queries received over TCP to signal legitimate clients of the DNS server.

      If such countermeasures were used, an attack could not use every DNS server on the net for amplification, but only those, which the victim is already using. That would significantly reduce the effectiveness of the attack.

      DNS is stateless.

      Not completely. Recursive resolvers need to remember state about all requests in progress. And DNS servers need to be able to receive requests over TCP as well, which is rarely done stateless.

      So even if the previous request was illegitimate, will the next request also be?

      No, you cannot be sure about that. So you need some reasonable heuristics and a method to ensure that even if you think a query was forged, it can still succeed by switching to TCP.

      Assume yes: now you can DoS any server off the Internet by flooding their primary DNS server with illegitimate requests, causing their primary DNS server to assume that also every valid request is illegitimate.

      That is obvious. You need to allow for fallback to TCP. This means sending a truncated reply. The truncated reply could be of the same size as the query or smaller, which is sufficient to eliminate the amplification.

      : nothing is solved. DNS server may now log that there was an invalid request, but it will still keep sending them out.

      Still detecting the problem may be a reasonable first approach. But you still need to apply some countermeasures.

      If the problem is to be solved by updating the DNS servers, there would have to be some sensible rate limiting default for UDP requests.

      Rate limiting is going to make your DNS server an easier target for DoS attacks. If the rate limiting only applied to blocks detected to be under attack, your DNS server would no longer be such an easy target for a DoS attack.

      A new protocol (possibly an extension to DNS as we know it), could provide an even better solution: When the server receives a request, it computes a cookie based on the client IP address. If the request already carried a valid cookie, it can be assumed to not have been forged, and a full reply can be send. If the request did not carry a valid cookie, a short reply is sent with just the cookie. The cookie can be valid for say an hour, and there can be an overlap between successive cookies, such that there is always two valid cookies. This approach would be stateless for the ser

      --

      Do you care about the security of your wireless mouse?
    14. Re:By Design by kasperd · · Score: 1

      BCP 38, which does the source address checking where it can be done-- at the first hop controlled by the provider and router of the IP address, the ISP.

      Great. I am going to configure that on my bind based DNS server right away.

      --

      Do you care about the security of your wireless mouse?
    15. Re:By Design by Anonymous Coward · · Score: 0

      A new protocol (possibly an extension to DNS as we know it), could provide an even better solution

      Yes, invent a new protocol. What a genius! Why did no one come up with this before?

      True, but doesn't that contradict what you said earlier about it being a few ISPs permitting this sort of spoofing?

      Obviously not. There are tens of millions of open DNS servers and there are far, far less ISPs and only a fraction of those allow spoofed IPs.

      If a customer has two redundant internet connections with IP addresses handed out from two different Internet providers, they would have a legitimate use-case for being able to send packets, which looks as if the source IP was spoofed.

      Obviously there are always trade-offs, but this sounds like a pretty rare corner case. I am sure most ISPs that currently allow spoofed source IPs could drop that "feature" without any disturbance to end-customers. If spoofed source IPs need to be allowed, they should only be allowed for customers with a legitimate reason to do so, and at the ISP's peril should the customer abuse such privilege.

    16. Re:By Design by kasperd · · Score: 1

      There is NO scenario where a wired internet connection should be spoofing IP addresses, because the ISP will NEVER be able to deliver return traffic to that person.

      It could be delivered through a different path. For example you might have redundant internet connections through different providers. It could also be that one of the two paths is using VPN and the other is not.

      There are also special addresses, which are valid as source address, even if they are not assigned to you specifically. For example, I could send packets through my ISP with source address 192.88.99.1, which would be perfectly legitimate and not perform any IP spoofing at all. But even though the packet is perfectly legitimate, and the reply would indeed be routed back to me, that probably won't work, because my provider is filtering and didn't know about 192.88.99.1, when configuring the filters.

      If we look at hosting companies, there is another reason why a customer may need to send packets with apparently spoofed source addresses. It may be that the customer is simply doing load balancing across multiple data centers, and are using a DSR setup.

      At some point I watched a talk mentioning another legitimate use case for apparently spoofed source address. It was for investigating what sort of prioritization of traffic an ISP may be doing without telling you about it. It involved doing a legitimate connection between your own computer and a website and then from a third point on the net inject spoofed packets into your own TCP connection.

      Your idea that DNS servers now need to fire off ICMP traffic

      I never said that. I said if spoofing is taking place, then the DNS server will receive an ICMP packet. Those ICMP packets are being sent right now, tons of DNS servers across the internet are receiving such ICMP packets right now. I am just suggesting they react to those ICMP packets.

      TCP/IP (and ethernet) operate on the assumption that nodes are not lying when they write their source MAC and IP addresses. It is technically possible for a node to do so, but guess what-- it is trivial to implement layer 2 and layer 3 ACLs to stop that crap at the first hop.

      There is a major difference. TCP is designed to actually work, even if nodes are spoofing source IP. Ethernet is designed for a LAN where people trust each other. On a LAN it only takes a few packets with spoofed source address to break connectivity, with TCP it takes a significantly larger number of spoofed packets to break connectivity.

      Both have been improved since earlier versions, such that they are now better at dealing with spoofing. On Ethernet it requires high-end switches and managing ACLs to prevent problems. With TCP it just required a minor tweak in connection setup to make it even more resilient to spoofed source addresses. And that tweak didn't require any configuration other than an on/off switch to choose if you want the protection or not.

      TCP is much better at dealing with spoofed source addresses than raw Ethernet is. I think a few years down the line we'll see a situation where those managed switches are all replaced with routers and a separate /64 network is assigned to each port. At that point MAC spoofing will simply not be an issue anymore.

      --

      Do you care about the security of your wireless mouse?
    17. Re:By Design by kasperd · · Score: 1

      Yes, invent a new protocol. What a genius! Why did no one come up with this before?

      Somebody did already, they just didn't do a very good job at it. EDNS made this sort of attack 8 times more effective than it was before EDNS was introduced.

      If spoofed source IPs need to be allowed, they should only be allowed for customers with a legitimate reason to do so, and at the ISP's peril should the customer abuse such privilege.

      That is a very sensible approach. It does however require a little bit more management for the ISP to do this, and they will likely charge extra for that. Customers who have a choice may decide to go with an ISP that permit it by default, because it is simpler than figuring out how to get it turned on, and probably cheaper too.

      If that ISP decides to turn it off, and they actually have customers relying on it, they'll suddenly have to deal with support calls.

      If it actually had a cost to the ISP, who was permitting spoofed source addresses, the situation might look different. But as it is, tracking down the source of packets with spoofed source is a bit tricky.

      --

      Do you care about the security of your wireless mouse?
    18. Re:By Design by LordLimecat · · Score: 1

      It could be delivered through a different path.

      Then it should use the proper IP address on the interface that it is using. You cannot do what you're suggesting, because if your main line goes down and you continue to use that IP on the redundant connection, your return traffic will still be routed to the downed line.

      Alternatively, if you try to send a packet sourced on one NIC IP out through a different NIC, your computer will discard the response as it is coming into the wrong interface.

      There is NO circumstance where your ISP can properly route a packet back to you and yet not know that they are doing so. Every ISP knows the valid range of IP addresses that they can route; they must, in order to route them-- they have to announce them via BGP, they have to route them internally. And unless an ISP has a single massive layer-2 broadcast domain, they also know with great specificity which routers are serving which customers, and which IPs those routers are routing.

      There is a major difference. TCP is designed to actually work, even if nodes are spoofing source IP

      TCP will not work when the source ip is spoofed; the 3-way handshake will fail, and every stateful firewall on the market will block the traffic as bogus ACK or SYN-ACK traffic. For the TCP handshake to complete there must be 3 packets sent back and forth, and only two endpoint IPs involved (excepting NAT or other packet re-writing techniques).

      Ethernet is designed for a LAN where people trust each other. On a LAN it only takes a few packets with spoofed source address to break connectivity,

      Thats only true with commodity hardware. It is trivial with enterprise hardware to do the exact same sort of filtering; switches can be configured to watch what MACs come across a port and then accept ONLY those MACs in the future.

      Switches will probably not be replaced by routers; they serve different purposes, and in fact you see the reverse trend-- layer 3 switches which are able to perform rudimentary routing. The problem with routers is that they are much much slower, and they perform a fundamentally different task. All routers I have ever worked on explicitly forbid having more than one physical interface with the same subnet (home wifi routers are combo router / switches). And you absolutely do not want your router being hammered with every bit of traffic on your network-- mid-range switches can easily handle 96gbps of traffic, while a router than can handle that would be substantially more expensive.

      MAC spoofing is not an issue in any environment with the budget for a $500 switch, and the serious desire to defeat MAC spoofing.

    19. Re:By Design by LordLimecat · · Score: 1

      You're welcome to also attempt to stop spam by reconfiguring your BIND server. Just dont be too disappointed when the spam doesnt stop.

    20. Re:By Design by kasperd · · Score: 1

      if your main line goes down and you continue to use that IP on the redundant connection, your return traffic will still be routed to the downed line.

      Of course it won't work if the line is completely down, or if it for some other reason is unable to deliver traffic to you. But if the line can deliver packets to you, and only the outgoing path is having a problem, then it can indeed help. He cannot give you any percentage of what kind of reliability improvement it could give, since I haven't had the opportunity to measure such a setup.

      TCP will not work when the source ip is spoofed; the 3-way handshake will fail

      I was not trying to imply you could do a TCP session working with a spoofed IP, quite the contrary. My point was the packets with spoofed IP address does not immediately break legitimate traffic on that IP. In fact it is quite difficult to break established TCP connections, if you are not on the path it flows through, even if you have access to spoof an IP address. That a server receiving incoming TCP connections can be fairly confident the client IP is authentic, is an added bonus.

      On a switched network with non-managed switches, spoofing the MAC address of another computer may be enough to kick that other computer off the network. You need to use managed switches and configure ACLs on those to stop that sort of attack.

      Switches will probably not be replaced by routers; they serve different purposes, and in fact you see the reverse trend-- layer 3 switches which are able to perform rudimentary routing.

      If it performs routing, then it is a router. Hence if that's the way we are heading, I was right saying the switches will be replaced by routers.

      All routers I have ever worked on explicitly forbid having more than one physical interface with the same subnet (home wifi routers are combo router / switches).

      And I expect that to be taken one step further. There already exist chips, which can be either a switch or a router depending on how you configure them. And if you just configure such a chip to act as a router with every port being on a different segment, then you don't need to worry about MAC spoofing.

      --

      Do you care about the security of your wireless mouse?
    21. Re:By Design by LordLimecat · · Score: 1

      Every port being on a different segment is utterly unnecessary, and would introduce unneeded latency, break discoverability (broadcasts no longer work), waste huge numbers of IPs (for every IP you get, youre wasting one on the network number, one on the broadcast, and one on the gateway), and all for no benefit.

      As I said, you cal ALREADY turn on port-security with dynamically learned MAC addresses on a mid-range Cisco Switch, which immediately thwarts MAC spoofing / ARP poisoning. The thing is, these attacks are pretty rare (since you have to be on the LAN in order to perform them, and theyre incredibly easy to detect and incredibly disruptive), so theres generally no need. The solution you are proposing-- segmenting everything onto a separate subnet-- adds a HUGE amount of complexity to address management and huge expenses in the hardware side. Routers perform a vastly different job than switches, and do so orders of magnitude slower. switching is performed essentially "wire-speed", with fractions of a millisecond incurred by switching delay, while routers can add multiple milliseconds to that. And when you're dealing with latency sensitive applications-- for instance, SAN access or remote computng-- and you add up the milliseconds from EACH router along the way, that becomes substantial.

      And Im at an utter loss as to why using routers would even SOLVE this problem; you STILL would have to do filtering, just at layer 3 instead of layer 2.

      If it performs routing, then it is a router.

      And if it performs switching, it is a switch. Layer 3 switches perform switching, fast as you would normally expect, but have the rudimentary ability to route between VLANs on the same switch. It is still technically within the "switching" realm (as you are doing a lookup of physical port to IP address-- something that routers simply do not do), but also touches the routing realm (as you are crossing subnet boundaries). To call it "a router" is to misunderstand what it does.

      Im beginning to wonder if Im on candid camera here; you appear to be advocating with a "straight face" the replacement of OSI layer 2 with OSI layer 3, with no conception of why that is an awful idea.

    22. Re:By Design by Anonymous Coward · · Score: 0

      It could be delivered through a different path. For example you might have redundant internet connections through different providers. It could also be that one of the two paths is using VPN and the other is not.

      If you had such a configuration, the routing table on your private router / computer should be set up to send packets with the correct external address out via each interface. Each connection you have would have a valid network address with which to send traffic. If you fail to send traffic over an interface without using the correct interface address, the ISP should rightfully drop that packet. If you are using a VPN over one of the interfaces, it needs to be properly encapsulated, or again, the ISP should rightfully drop the packet.

      There are also special addresses, which are valid as source address, even if they are not assigned to you specifically. For example, I could send packets through my ISP with source address 192.88.99.1, which would be perfectly legitimate and not perform any IP spoofing at all. But even though the packet is perfectly legitimate, and the reply would indeed be routed back to me, that probably won't work, because my provider is filtering and didn't know about 192.88.99.1, when configuring the filters.

      And those packets are only allowed to be sent directly to an IPv4/IPv6 relay router. Meaning that if your ISP does not implement such a relay, they are still right to disallow such packets from exiting their network, as there would be no way to route return traffic. Basically if they don't know about it, they are right to filter it.

      If we look at hosting companies, there is another reason why a customer may need to send packets with apparently spoofed source addresses. It may be that the customer is simply doing load balancing across multiple data centers, and are using a DSR setup.

      I'm not sure why one would use DSR for such a set up, but in that case, the ISP should still block these packets unless they have a specific arrangement with that customer to do otherwise, in which case they would adjust their filtering and routing tables to compensate. A responsible ISP would also require that you provide written proof for each range that you wish to transmit on behalf of. Hosting providers need someone to blame for all traffic, if they allow your traffic without a written arrangement, their ass is on the line should it be traced back to them.

      At some point I watched a talk mentioning another legitimate use case for apparently spoofed source address. It was for investigating what sort of prioritization of traffic an ISP may be doing without telling you about it. It involved doing a legitimate connection between your own computer and a website and then from a third point on the net inject spoofed packets into your own TCP connection.

      There are other methods of determining this as well, however, if you are dealing with an ISP, complain, test via VPN, and if they don't remove the limit, drop them. If you have a contract with a hosting provider, you are often given a hard limit; if you can't reach that limit, either their network sucks and they have committed fraud by selling you a product which they could not deliver, or they are rate limiting you in which case they have sold you a product in which they intended not to deliver. In both cases, you can sue those rat bastards.

      You're presenting a lot of edge cases, all of which the ISP is still either:
      a) Better off protecting their asses by filtering your traffic.
      b) Rightfully filtering your traffic due to configuration errors on your end.

    23. Re:By Design by kasperd · · Score: 1

      Every port being on a different segment is utterly unnecessary

      Completely eliminating problems with MAC spoofing is worth something. It would mean even if a vendor by mistake assigned same MAC to two devices, you could plug them both into the same router, and it would just work.

      and would introduce unneeded latency

      My calculations says the opposite. But it is really a minor difference, because it is only for the initial neighbor discovery, there will be a difference. Once receiving MAC addresses are known, the actual payload traffic takes the exact same physical path, hence no change in latency. For the neighbor discovery it is more likely for each node having an entry for the router in cache already and the router having entries for the devices, than it is for the devices having entries for each other. So the probability that you need to wait for a neighbor discovery is smaller. Moreover the latency of that discovery will be smaller, as it will need to go over only a single Ethernet link, rather than the two links needed in case of doing it between two devices each connected to a switch.

      break discoverability (broadcasts no longer work)

      This is already being considered by the IETF.

      waste huge numbers of IPs

      Which is a problem only if you are doing this using public IPv4 addresses. But the networks we are talking about here aren't using public IPv4 addresses in the first place.

      and all for no benefit.

      Unless you want the introduced security it offers to your LAN. Some attacks works only within the same segment. Putting every port on a separate segment means you only need to protect the router against such attacks and not every single device.

      As I said, you cal ALREADY turn on port-security with dynamically learned MAC addresses on a mid-range Cisco Switch, which immediately thwarts MAC spoofing / ARP poisoning.

      Those are not the only sorts of attacks that you can perform within a segment. And learning MAC addresses doesn't make sure your devices will actually be able to communicate in case the vendor screwed up and manufactured two with identical MAC addresses. Putting each port on a separate segment would solve that problem.

      Routers perform a vastly different job than switches, and do so orders of magnitude slower. switching is performed essentially "wire-speed", with fractions of a millisecond incurred by switching delay

      With the proper chips, routing can be done at wire-speed as well. It is not even much more complicated to do so. Of course what I mentioned won't happen until the devices are being manufactured with chips capable of doing it.

      you STILL would have to do filtering, just at layer 3 instead of layer 2.

      • It is not something you absolutely have to do. IP is not that vulnerable to source address spoofing. Higher level protocols deals mostly fine with it.
      • The MAC filtering you proposed wasn't validating the source IP anyway. Even if you don't spoof the source MAC address on a packet, you can still spoof the source IP address and send it through a switch.
      • Filtering invalid source IPs would be easier in the setup I expect to see, because the router actually knows which source IPs are valid on which ports. In contrast the switch doesn't know which MACs are valid on which ports, and it doesn't even know what an IP address is.

      It is still technically within the "switching" realm (as you are doing a lookup of physical port to IP address-- something that routers simply do not do)

      Finding out which port a packet must leave on based on the destination IP address is the defining feature of a

      --

      Do you care about the security of your wireless mouse?
    24. Re:By Design by kasperd · · Score: 1

      If you had such a configuration, the routing table on your private router / computer should be set up to send packets with the correct external address out via each interface.

      You can't change your IP in the middle of a TCP connection (though that would be a really nice feature). And some websites will break if you switch IP address in the middle of a session. YouTube streaming has been seen doing that.

      If you fail to send traffic over an interface without using the correct interface address, the ISP should rightfully drop that packet.

      If they don't, they will be doing a service to those customers, who do have redundant links. There is nothing in IP mandating packets take the same path in both directions.

      And those packets are only allowed to be sent directly to an IPv4/IPv6 relay router. Meaning that if your ISP does not implement such a relay, they are still right to disallow such packets from exiting their network, as there would be no way to route return traffic.

      I can see you don't know as much about that protocol as I do. But I have written an implementation of the protocol, so I should know how it works.

      First of all, the packets I mentioned are not being sent to the relay, they are being sent from the relay. And anybody is allowed to setup such a relay. On a simple home network, you cannot advertise your relay over BGP (and you probably wouldn't want to), but it can service your own LAN without being advertised. So you can have a legitimate relay on your home network. The packets it sends must of course be sent to 6to4 border router, but that can be many hops away, it certainly doesn't have to be within your ISP's network. And the destination could be on any globally routeable IPv4 address (except from 192.88.99.0/24).

      I'm not sure why one would use DSR for such a set up

      DSR will give you much better performance than an equivalent setup without DSR.

      A responsible ISP would also require that you provide written proof for each range that you wish to transmit on behalf of.

      It is reasonable to only enable it if customers ask for it. But they can't make the process more complicated than signing up in the first place without pushing some of those customers to other providers.

      Hosting providers need someone to blame for all traffic, if they allow your traffic without a written arrangement, their ass is on the line should it be traced back to them.

      Doesn't look like it.

      There are other methods of determining this as well, however, if you are dealing with an ISP, complain, test via VPN, and if they don't remove the limit, drop them.

      Traffic would take a totally different path across the network. A difference in responsiveness across the two paths would be expected, and it does not prove that the ISP is treating traffic differently.

      You're presenting a lot of edge cases

      The point isn't whether those are corner cases, the point is how many legitimate use cases I could present right off the top of my head. I think there are plenty more use cases, which I haven't thought about. And maybe some of those use cases will never be fully thought out, simply due to the person who would have come up with a clever idea dropping it because of being restricted by his ISP. Of course the cases I described are not typical, they couldn't be due to many ISPs dropping that sort of traffic. If that traffic hadn't been dropped, such use cases might have been typical.

      This is not to say ISPs are doing something wrong by dropping packets they think have a spoofed source address. But neither should we say ISPs are doing something wrong by allowing it. For me it takes only one legitimate use case to defend those ISPs who do permit it. The root of the problem is not spoofing, but amplification. (I have experienced a case that would make a factor 100 amplification look harmless, unfortunately I am not allowed to go into details about that episode.)

      --

      Do you care about the security of your wireless mouse?
    25. Re:By Design by mysidia · · Score: 1

      Since an authoritative DNS server only handles requests from recursive caching servers it can implement rate limiting, thus making reflection attacks useless.

      Rate limiting on the authoritative doesn't make reflection attacks useless.

      It just means that a larger number of authoritative nameserver targets are required for the attack to be effective. The spoofed query rate against any one authoritative nameserver doesn't have to be excessive.

      There happens to be no shortage of authoritative nameservers.

    26. Re:By Design by LordLimecat · · Score: 1

      You dont understand what port-security does. Please research port-security and sticky mac. Duplicate MACs have no bearing on port-security (the switch honestly doesnt care, as long as your MAC doesnt mysteriously change).

      Before proposing new solutions to problems that have already been solved, I recommend you do more research.

    27. Re:By Design by kasperd · · Score: 1

      Duplicate MACs have no bearing on port-security (the switch honestly doesnt care, as long as your MAC doesnt mysteriously change).

      The documentation from Juniper disagrees with you (first hit when searching for sticky MAC). I do consider documentation from a major vendor of switching hardware to be more trustworthy than comments on slashdot from people I know nothing about.

      --

      Do you care about the security of your wireless mouse?
    28. Re:By Design by Eunuchswear · · Score: 1

      You're right. I'm wrong. Without BCP38 we're fucked.

      Since there seems to be no momentum behind BCP38 that means we're fucked.

      (I say this as the operator of a small PI space - i.e. one of the people who's most likely to be affected by errors in BCP38 implementation).

      --
      Watch this Heartland Institute video
  16. Re:I'm not quite sure how you're supposed to do it by radiumsoup · · Score: 1

    Or am I completely missing the point to this article?

    Yes.

    It's talking about spoofed requests - much like if someone sent a request for more information to a Scientology center, and they put your return address on the form. Suddenly you're getting very creepy mail from the Scientologists and you have no idea where it came from. If they do it enough times to enough organizations, and your mailbox is full, and your Netflix Blu-ray of Tootsie is deferred until you can clean out your mailbox.

  17. Re:I'm not quite sure how you're supposed to do it by gparent · · Score: 1

    The problem is that almost no one actually needs to run a public resolver.

    Your ISP provides a DNS server to you that is recursive (usually), so they can use ACLs to make sure only their clients are using them.

    Domain owners provide DNS servers that are authoritative, but only for their own domain, so it limits the scope of the problem as well.

    The problem is when domain owners provide DNS servers authoritative for their domain, but -also- allowing other people to use them as public recursive servers. There's usually no reason for this other than the server administrator's competence.

    There are legit uses for open recursors, you mention Google DNS and OpenDNS as an example. These guys have to use rate limiting and defeat the attacks themselves, there's no easy solution.

  18. Mitigation while it still happens? by gmuslera · · Score: 1

    The kind of traffic it generated could practically disconnect entire countries from internet, and is still open to whatever with the right resources to use it, What kind of measures can be taken to prevent it? To have as DNS mirrors several with really big bandwidth?

  19. Re:I'm not quite sure how you're supposed to do it by Anonymous Coward · · Score: 0

    "If you are running a DNS server yourself, for your own domain then you should only respond to requests for your domain from the outside."

    This can be used for DDOS, right?

  20. Re:I'm not quite sure how you're supposed to do it by Anonymous Coward · · Score: 0

    To reply myself... no it can't, it's non..recursive..

  21. Re:I'm not quite sure how you're supposed to do it by t4ng* · · Score: 1

    Two other different things...

    1) ISPs could drop out-going tcp and udp packets on port 53 from all their IP address except their own DNS servers. That would stop their customers from using public DNS server outside their networks. But it would also stop this kind of attack.

    2) Drop all outgoing traffic that has a spoofed source IP address. This is a very simple bit mask operation. Yes, it requires more compute power than not doing it, but not very much. The ISPs know what IP addresses they own, they can very easily prevent spoofed traffic from leaving their networks, effectively stopping this kind of attack, as well as other types of hacking. At the same time, it would still allow legitimate use of public DNS servers.

  22. NOT "OPENDNS" but "open" "dns" servers. by Anonymous Coward · · Score: 1

    OpenDNS is a DNS service, whereas "open dns servers" were abused - but not at OpenDNS...

  23. Sad thing is... by Anonymous Coward · · Score: 0

    Nobody from Cyberbunker will go to jail for it most likely and they SHOULD go to jail....

  24. Re:I'm not quite sure how you're supposed to do it by PlusFiveTroll · · Score: 1

    To reply myself... no it can't, it's non..recursive..

    Um, not exactly... You an have an authoritative non-recursive DNS server that gives large responses to questions used in an amplification attack...

    'dig a www.authoritative.domain @authortative.domain.ip'

    RESPONSE = 1000+ bytes follows...

  25. Re:I'm not quite sure how you're supposed to do it by t4ng* · · Score: 1

    Sure it could. If it is (mis)configured to allow a zone transfer, you could have a bot net send it zone transfer requests for your own domain with the source ip address spoofed to be your target. A little more complex setup than a recursive request, but you still some get good amplification. Do that on thousands or millions of DNS servers that aren't recursive, but allow zone transfers, and you still get a DDOS attack with very little input traffic. You could also do it on root servers (or any recursive server) by asking for MX records on a domain that has a bunch of MX records, like big ISPs. Not as much amplification as a zone transfer, but still some.

    So really the only way to stop it is for ISPs to just stop traffic with spoofed source addresses from leaving their networks.

  26. Re:I'm not quite sure how you're supposed to do it by PlusFiveTroll · · Score: 2

    #2 is the right answer, be responsible for the traffic on your network.

    #1 is the wrong answer. Too many ISPs fuck with DNS by returning IP addresses to advertizing domains instead of NXDOMAIN.

  27. Re:I'm not quite sure how you're supposed to do it by green1 · · Score: 1

    Why not? sure, it would be more difficult as each request would have to be tailored to the DNS server it's using, but the same principle should apply, spoof the source address, request information (in this case something within the domain being hosted) and let the larger reply go to the spoofed (victim's) address.

    The only thing preventing this is that it's more work than the easier current method of being able to send the same request to every name server, but there's no reason it couldn't still be done.

  28. Re:I'm not quite sure how you're supposed to do it by green1 · · Score: 1

    1) would be REALLY bad, and I hate anyone who would even consider such a solution.

    2) I can't imagine why every ISP and transit provider doesn't already do this. This has been a known problem for over a decade, deal with it already!

  29. Re:I'm not quite sure how you're supposed to do it by green1 · · Score: 1

    You're confirming that I understood the article perfectly. The problem is in their choice of solution.

    It seems there are 2 possible solutions.

    1) get ISPs and transit providers to actually start blocking IP spoofing (something they all should have been doing years ago)

    2) break the internet by banning all public resolvers.

    Unfortunately the article seems to me to be advocating for number 2, which would harm many people, and just cause the attackers to continue to use IP spoofing on different services or protocols.
    Fix number 1 and you fix a lot. implement number 2, and you delay the issue by a few days while the attackers work around it.

  30. Re:I'm not quite sure how you're supposed to do it by Qzukk · · Score: 1

    It could, but only if they knew what domain your server was authoritative for when they picked your DNS server at random.

    Your server would also have to be able to cough up a pretty big response to make it worthwhile.

    --
    If I have been able to see further than others, it is because I bought a pair of binoculars.
  31. Open DNS? by Anonymous Coward · · Score: 0

    forgive my ignorance but the only Open DNS that I know of is http://www.opendns.com. I wonder if the article is talking about opendns.com. I didn't see any news releases on their website.

  32. Re:I'm not quite sure how you're supposed to do it by mcrbids · · Score: 1

    You simply configure your DNS server properly, including setting the networks it's allowed to resolve for. A nameserver can be both authoritative for certain domains globally, and also be recursive for specific hosts.

    Of course, there's also the problem of DNS amplification using source address spoofing by requesting authoritative DNS records, but simply doing the above greatly mitigates the effectiveness of the attack.

    --
    I have no problem with your religion until you decide it's reason to deprive others of the truth.
  33. Illicit webhost? by Anonymous Coward · · Score: 0

    Why is Cyberbunker judged to be an "illicit webhost" by Threat post? If corporations are people, isn't that defamation of character?

  34. So what are the defaults? by Ungrounded+Lightning · · Score: 1

    Running an open DNS resolver isn't itself always a problem, but it looks like people are enabling neither source address verification nor rate limiting.

    One has to wonder if this is caused by negligence, ...

    Also, one has to wonder if it's negligence by the person installing the resolver, or by the person distributing the resolver.

    What are the default values for source address verification and rate limiting? If having them both disabled is a problem, at least ONE of them should be on by default, requiring it to be explicitly DISabled by the user, and the config file should have a warning about WHY it's on/even there.

    If the default configuration is vulnerable you can't expect a whole user population to ALL figure out ALL the fine details and tweak the configuration into safety the FIRST TIME and EVERY TIME. It should be safe (if crippled) out of the box and a warning obvious during the process of changing it to be less safe.

    --
    Bantam Dominique roosters crow a four-note song. Once you've heard it as "Happy BIRTHday" you can't NOT hear it that way
  35. Re:It really isn't me... apk by Anonymous Coward · · Score: 0

    And how many of these 200 + comments were appropriate to a story unrelated to hostfiles?

  36. Re:It really isn't me... apk by Anonymous Coward · · Score: 1

    That was an internal dispute between the Allied Southern APK Schism and the Second Western APK Heresy. It was a private matter but unfortunately tempers reached a boiling point and things spilled over into public view. The New Central APK Orthodoxy stepped in a few days later & now everybody's back on civil terms. Don't post shit when you don't know a damn thing about APK culture and governmental structure.

  37. Re:It really isn't me... apk by Anonymous Coward · · Score: 0

    I've been monitoring these threads so much that I've started recognizing repeat visitors. I dub you "LHC Guy".

  38. Thoughts from MaraDNSâ(TM) implementer by MaraDNS · · Score: 0
    As the implementer of MaraDNS, here are my thoughts:
    • 1) MaraDNS 1 and Deadwood do not support a technology called "EDNS" that allows for large DNS packets. By only supporting 512-byte packets, both DNS servers do not allow for the 100x amplification used in this DDOS that other DNS servers have.
    • 2) My DNS software does not come with unrestricted recursive access enabled by default, and the documentation strongly discourages open recursion.
    • 3) I will have to double check, but, as I recall, the documentation and example configuration files do not include an example with unrestricted recursive access.

    One feature that would be nice would be to be able to restrict how much data my DNS server sends to a given IP (again, as noted above, MaraDNS/Deadwood already has a form of this because they do not support EDNS). Unfortunately, since I am not developing new features for MaraDNS like this without being compensated for my time, I would need a corporate or government grant to implement this. TANSTAAFL

    --
    MaraDNS is an open-source DNS server.
    1. Re:Thoughts from MaraDNSâ(TM) implementer by Koutarou · · Score: 1

      And of course with this "feature" it will never support DNSSEC ever.

    2. Re:Thoughts from MaraDNSâ(TM) implementer by MaraDNS · · Score: 1

      I would love to implement DNSSEC for MaraDNS, but, again, it's a case of TANSTAAFL: http://maradns.org/products.html

      --
      MaraDNS is an open-source DNS server.
    3. Re:Thoughts from MaraDNSâ(TM) implementer by mysidia · · Score: 1

      MaraDNS 1 and Deadwood do not support a technology called "EDNS" that allows for large DNS packets

      Sounds like a side effect of a deficiency (read: less than complete DNS protocol support); lack of EDNS support is a potential problem, as it impacts IPv6+DNSSEC, where large legitimate responses may be more frequent. DNSSEC support is critical, as is the ability to resolve such zones without falling back to TCP.

      BIND has max-udp-size and edns-udp-size parameters. As do other DNS resolvers.

      One feature that would be nice would be to be able to restrict how much data my DNS server sends to a given IP

      On authoritative DNS server implementations, perhaps. DNS resolvers should not be usable by the world.

      Any DNS server that provides recursive DNS ought to not simultaneously provide authoritative DNS from the same service, or from the same IP.

      Unfortunately, since I am not developing new features for MaraDNS like this without being compensated for my time, I would need a corporate or government grant to implement this.

      So you would put forward a DNS server that doesn't actually provide complete DNS functionality, and is no longer being developed?

      I fully expect any government or corporate grants will go towards DNS server implementations that are more widely used, already under development, and fully featured, towards research and development of new advanced experimental options or capabilities, that require substantially large development efforts.

      Because spending grant dollars to help a competing implementation get up to speed with the slew of other competing implementations, sounds like a potential waste, when, instead research dollars could be more efficiently spent on upgrading BIND or PowerDNS, or whatever. :)

      (Because corporations are more likely to be already using, and want additional functionality on existing DNS server implementations that are popular and best fit their needs, other than the special features they want developed.)

      So, not to discount MaraDNS, but it seems like a dead-end, in regards to support for protocol functionality that are becoming more and more critical month by month...

    4. Re:Thoughts from MaraDNSâ(TM) implementer by Anonymous Coward · · Score: 0

      Thank you for MaraDNS. It's a great piece of software. This incident again demonstrates, that DNS security is pivotal, and that is why I chose MaraDNS to manage my own domain name. It has all that I need, with everything explained in relatively simple terms and the security implications are always well-documented. Thank you!

  39. Re:THIS IS NOT ME... apk by Anonymous Coward · · Score: 0

    Makes no difference. BOTH of you should be forced to use a cholla cactus as a butt-plug.

  40. Re:I'm not quite sure how you're supposed to do it by Shimbo · · Score: 1

    Sure it could. If it is (mis)configured to allow a zone transfer, you could have a bot net send it zone transfer requests for your own domain with the source ip address spoofed to be your target. A little more complex setup than a recursive request, but you still some get good amplification.

    You're less likely to do this by accident. Besides, a spoofed zone transfer will almost always fail on the TCP three-way handshake step.

  41. Re:I'm not quite sure how you're supposed to do it by Alex+Pennace · · Score: 1

    Two other different things...

    1) ISPs could drop out-going tcp and udp packets on port 53 from all their IP address except their own DNS servers. That would stop their customers from using public DNS server outside their networks. But it would also stop this kind of attack.

    It would also have a high collateral cost: diagnosing many DNS issues becomes impossible when you can only work with one recursive resolver (which may be what is causing the DNS issues!) It is necessary to access legitimate open resolvers and authoritative servers on any kind of Internet connection, even residential broadband (don't think of grandma but think of the tech helping grandma).

    In short, we *need* TCP and UDP port 53 traffic unfiltered.

    2) Drop all outgoing traffic that has a spoofed source IP address. This is a very simple bit mask operation. Yes, it requires more compute power than not doing it, but not very much. The ISPs know what IP addresses they own, they can very easily prevent spoofed traffic from leaving their networks, effectively stopping this kind of attack, as well as other types of hacking. At the same time, it would still allow legitimate use of public DNS servers.

    This is what we need more of. Provided, of course, that it isn't applied in situations where it breaks things, but in those cases the customer is hopefully smart enough to implement their own filtering.

  42. Re:It really isn't me... apk by Anonymous Coward · · Score: 0

    I posted that link twice a couple days ago, seeing if some of these posts were from the real APK or not, as he's usually so easy to troll with such things. Looks like some other boring imposter instead. But it is nice others have noticed and carried the flag on. Although I think it is a waste of time until the real APK shows up again. We are Legion... we are "LHC Guy."

  43. How to do rate limiting? by Phroggy · · Score: 1

    Let's say I want to run a public DNS recursive server, that is, I want to allow anyone to issue a handful of queries for any arbitrary DNS records, and in addition to just serving up my own, I want to also service requests for whatever arbitrary thing they requested. Is there an easy way to rate limit these queries based on source IP address, to prevent abuse of this service I've chosen to offer?

    How should one set that up?

    --
    $x='S24;r)>63/* h@<5+oZ)32"5cz';$me='phroggy'x$];
    $x=~y+ -xz+\0-Tx+;print$_^chop$me for split'',$x;
    1. Re:How to do rate limiting? by Koutarou · · Score: 1

      There are some patches for bind that surfaced about 6 months ago during some previous large-scale DNS amplification attacks.

      I'd check nanog or bind-users mailing list archives around that time.

    2. Re:How to do rate limiting? by Anonymous Coward · · Score: 0

      iptables rate limiting.

  44. BCP38 is the fix. by ebiederm · · Score: 1

    The statement that implied DNS servers can implement this is bunk. However BCP38 is the fix. The attack would have been impossible without spoofed IP source addresses.

    An application/reflection denial of service attack is actually possible with SNMP and several other protocols. Even if all of the DNS servers were closed this attack could happen.

  45. Re:It really isn't me... apk by Anonymous Coward · · Score: 0

    I wouldn't be surprised if that is APK trying to draw attention to himself, since he thinks such endless tirades are examples of him winning and make him look good. When people stop paying attention to him, or post actual counterpoints he can't come up with a response to, he'll post strawman troll postings to shoot down, sometimes just copy pasted from previous stories.

  46. Scapegoating open resolvers resolves nothing by WaffleMonster · · Score: 2

    For sake of argument assume you are able to snap your fingers and miraculously all open resolvers have been locked down. What has been accomplished?

    Will anyone still be able to issue legitimate DNS queries using forged source address with impunity for which response is several times larger than request? YES.

    Will DNSSEC with egregiously enormous amplification when configured entire as recommended simply go away? A man can dream. I doubt this will come to fruition.

    The way I see it there are two solutions to this problem. BOTH need to be implemented.

    1. Ingres filtering (AKA tools.ietf.org/html/bcp38) as TFA and many others here point out needs to be implemented with enough specificity to meaningfully raise the bar for successful source address spoofing.

    2. All UDP protocols allowing amplification or resource exhaustion from spoofed source addresses need to be beaten with a clue stick for making the Internet worse than need be. There is NO EXCUSE.

    It does not need to be perfect it only needs to not suck more than the underlying network.

    We know how to do this. There are production protocols which get it right. The answer is stateless cookies. It might require an extra round trip once in a blue moon or a few extra CPU cycles to calculate HMACs... we can easily afford it.

    In return we get UDP protocols at least as trustworthy as underlying transport. Protocols which can no longer be turned into weapons of mass deluge.

    For DNS we have had reasonable solutions for years...yet we sit on our hands and nothing gets done...
    http://tools.ietf.org/html/draft-eastlake-dnsext-cookies-03

    This can easily be phased in conjunction with DNS query rate limiting applicable for requests without cookies.

    It seems to me all the money and political interest follow fools errands like DNSSEC which paradoxically makes the Internet we actually have right now less safe from denial of service.

  47. Re:I'm not quite sure how you're supposed to do it by WaffleMonster · · Score: 1

    Maybe this is over my head. But how would one rung a "safe" DNS server then? My interpretation of the article basically says to let only specific people use your DNS server, but then how would a company run a public resolver?

    The problem is one of degree. The theory is if you don't offer a recursive resolver to the public amount of amplified output you get for your input is diminished over running a resolver that would respond to just whatever your authoratitive for.

    Personally I don't buy much into this theory. There are enough ways to request an earfull from enough properly configured servers we can find much more effective things to be doing with our Internet fixing time.

  48. Re:I'm not quite sure how you're supposed to do it by Anonymous Coward · · Score: 0

    It could, but only if they knew what domain your server was authoritative for when they picked your DNS server at random.

    dig @$IP -x $IP should give you the hostname and thereby the domain of the DNS server.
    You can easily run that command some time prior to the spoofing attack, the domain probably doesn't change that often.

  49. Re:It really isn't me... apk by Ash-Fox · · Score: 1

    A corrupt slashdot luser has infiltrated the moderation system to downmod all my posts while impersonating me.

    It's not corrupt, the moderation system is working as intended. :)

    Sorry folks - but whoever the nutjob is that's attempting to impersonate me

    It's not an attempt if it was done. :)

    & upset the rest of you as well, has SERIOUS mental issues, no questions asked!

    I do not believe that is a goal of his, but rather a side effect of his campaign against the super power known as APK. :)

    * Personally, I'm surprised the moderation staff here hasn't just "blocked out" his network range yet honestly!

    Woha, you just mentioned using something other than hosts files, you are clearly an imposter. :O

    --
    Change is certain; progress is not obligatory.
  50. Re:Thoughts from MaraDNS' implementer by MaraDNS · · Score: 0

    lack of EDNS support is a potential problem

    "Potential" being the operative word. Truncated DNS packets still have enough information in them to answer DNS questions, and the only time I've really seen truncated packets is with some of the byzantine DNS packets Yahoo has.

    DNSSEC support is critical

    But not critical enough for someone to send me the money to make DNSSEC happen with MaraDNS: http://maradns.org/products.html It's really the same problem IPv6 has: All kinds of geeks talk about how great it would be if IPv6 were everywhere, but they don't put out the money for IPv6 to happen more quickly.

    It's still possible to resolve domains and surf the web without DNSSEC. I know: MaraDNS 2.0 (Deadwood) is being used to resolve Slashdot.org (and all the other places I go) so I can make this posting. Yes, there are issues with someone with a packet sniffer forging DNS packets on the same network, and I do agree DNSSEC is needed on a larger network with infected machines, and is needed for a DNS server that calls itself secure, but it is working for me right now.

    (For sites where forgery is a real problem, such as online banking, I use a special virtual machine and make sure the HTTPS certificate is kosher)

    DNS resolvers should not be usable by the world.

    Google, OpenDNS, and heck, Level3 disagree with you. That said, I mostly agree: That's why there are no examples in MaraDNS' documentation showing how to make a recursive nameserver globally resolvable, and why it has never been a default configuration in Mara.

    Any DNS server that provides recursive DNS ought to not simultaneously provide authoritative DNS from the same service, or from the same IP.

    That's the design MaraDNS 2.0 has: I removed the recursion from the "maradns" daemon and completely, from scratch, reimplemented recursion in a separate daemon, which has to run on a separate IP. Not one line of code is shared between the two.

    I fully expect any government or corporate grants will go towards DNS server implementations that are more widely used

    I understand your sentiment, but, software monoculture is a bad thing and software diversity is a good thing.

    When DNS first showed up in the 1980s, there were a number of different implementations. By the time I started MaraDNS 12 years ago, there was only one usable open-source DNS server out there. When I finished MaraDNS, there were five or six (depending on whether Unbound/NSD counts as one or two) different actively maintained significant open-source DNS servers out there. That number has since gone down (none of the djbdns forks came out with a release that fixes CVE-2012-1191). I hope that number continues to be higher than one.

    An attitude of "let's only support one DNS server" can return us to the world of a DNS monoculture. EDNS, DNSSEC, and all of these extensions to DNS do not help.

    I don't like how CSS, Javascript, and HTML have become such a mess that it requires multi-million dollar grants to keep a browser current, and where Opera finally threw in the towel because they just couldn't keep up with the nonstop update treadmill browsers are on. Dillo doesn't even try to be current (I think they made a mistake trying to support CSS at all, but that's another discussion for another day).

    While I disagree with DJB on a lot of things, I understand why he rejected DNSSEC and proposed DNSCURVE: He wanted to keep DNS simple, to keep DNS something that a single talented developer can implement in their spare time.

    For better or for worse, DNSSEC won, and now DNS is no longer can practically be implemented by a one-man show any more.

    PowerDNS

    I agree PowerDNS is a good choice, especially for people who want a database back end, but I'm disappointed it took them over a year to patch CVE-

    --
    MaraDNS is an open-source DNS server.
  51. Re:I'm not quite sure how you're supposed to do it by Trolan · · Score: 2

    Actually, transit providers are one of the groups that can't reliably apply BCP38 or RPF. BCP38 and RPF is very easily applied at the edge, where you know specifically the IPs involved, since they're either connected or statically routed. Now, when you get into things over BGP, it gets dicey. You may see traffic over a BGP-managed link from an IP that isn't involved in the received prefixes, but yet still belong to the specific peer. Is this an error? No. Is dropping the bits on the floor because you're not seeing that prefix an error? Most definitely. Not announcing a prefix over a link is a common traffic engineering practice, so this isn't an uncommon scenario. Another option to work around that would be to have a prefix-list with all of that peer's possible prefixes and build an ACL off that, but that's also not always tenable when you're potentially dealing with 1,000s or 10s of 1,000s of prefixes for the larger networks. Nice thing is, at this level, usually you can bust out the sFlow/NetFlow-fu and find out where the spoof is coming in from, and then whack it at that point.

    But looking at the OpenResolver project list, when broken out by ASN, it really looks like a huge amount of those open recursors are CPE gear with WAN-facing DNS services, just based on the ASNs. China Telecom (AS4134), Uninet (AS8151) and Turk Telecom (AS9121) accounted for 3.5 million (15%) of the recursors alone.

  52. Re:Thoughts from MaraDNS' implementer by MaraDNS · · Score: 1

    TL;DR The grandparent complained about MaraDNS not having more features. He responded to my "show me the money" reply by saying "why should anyone pay you if you don't have more features". My reply: "Because DNS shouldn't be a monoculture".

    (As an aside, I actually somewhat respect the parent poster because he does a reasonable job of articulating his points. His thinking is a little rigid and absolute "this is how it must be done" for my tastes, but he at least has clue, something becoming rarer and rarer as Slashdot slowly goes the way of the horse and buggy)

    Another thing I forgot to add: Why use MaraDNS.

    Since I have Karma to burn, and since it probably would be best if my Karma went to hell, discouraging me from wasting time on Slashdot, here's my thoughts on the negative moderations:

    Sure, the first post came off as an ad. I wrote it too quickly, and I can see why a moderator didn't like it. I can also see why a moderator--perhaps the same one--didn't like the parent to this. A good number of Slashdot readers still live in that "everything should be free and no one has bills to pay since they all live in my mother's basement [1] like I do" neckbeard fantasyland probably don't like how I pointed out that it's going to take real money for MaraDNS to get DNSSEC or have rate limiting. They probably stopped there and moderated down (the post was also too long, but a long post deserves a long reply).

    [1] In other cultures, multiple generations living under the same roof is normal; I feel the idea that a kid has to move out of the house at 18 to be a real man is one that is bad for families. It's actually in many ways good when a 45-year-old man still lives in his mother's basement, since he will become the one taking care of his aging mother instead of sending her to a nursing home.

    OK, I'm out of Slashdot for the rest of 2013. I will not post here until the beginning of 2014. The moderators hath spoken and I really need to get out of the shithole Slashdot is becoming. MaraDNS is the past; it's time for me to make a new mark on the world!

    --
    MaraDNS is an open-source DNS server.
  53. Re:I'm not quite sure how you're supposed to do it by jon3k · · Score: 1

    You're compounding two things. One is providing RECURSIVE RESOLUTION to clients and the other is providing an AUTHORITATIVE NAMESERVICE for particular zones. I'll explain the two briefly:

    1. Recursive resolver - this is a nameserver that you can ask to resolve any domain name and it'll do just that. If it isn't authoritative for it (meaning you RUN the zone and it's in a config file locally) it will go through the recursive resolution process for you. It will look at it's root hints, talk to the root name servers, find the TLD zone, ask for the next nameserver to ask and on down the chain. This is "recursive resolution" it's how clients find things on the internet. This is the dangerous thing and what you want to secure. You can do this in BIND for example by writing a bind ACL and only allowing recursion to clients you trust, typically the RFC 1918 address space (aka "private IP addresses").

    2. Authoritative Nameserver - this is what you put on the internet if you want to run your own nameservice for your domains. This will only answer questions to clients about domains that it runs specifically. So if you own abc.com and a client asks about www.abc.com it will provide the answer. If you ask it to resolve google.com it will kindly tell you to fuck off (or possibly provide root hints, by an old convention).

  54. Re:I'm not quite sure how you're supposed to do it by green1 · · Score: 1

    Actaully, I wasn't confusing the 2 at all. But I don't think that we should be banning public resolvers and forcing people to use the resolver operated by their ISP when those resolvers have frequently been messed with for profit by the companies running them. The article would propose killing OpenDNS, Google DNS, and many, many more.

    The correct solution is not to break the internet by banning a harmless and very useful feature, but to fix the internet by blocking IP spoofing. Why on earth are there any ISPs out there that still allow spoofed traffic off their network? this is not a new issue, and should have been fixed ages ago.

  55. Things that used to not be threats by billstewart · · Score: 1

    DNS used to not be a threat; that's been changing. Rate limiting wasn't an issue. Source address verification was a problem for ISP routers (to prevent address spoofing), but it wasn't a problem for recursive DNS servers (who were willing to serve anybody, not just their own customers), and it especially wasn't a problem for authoritative DNS servers, because they're supposed to tell anybody the address for www.yourdomain.com, and aren't in the right part of the network to verify whether a UDP DNS request came from a forged address (that's an edge problem, not a center problem.)

    Unfortunately, it's easy to have DNS configurations where a response is larger than the query (sometimes even a lot larger.) The emerging standards have been to require TCP if the responses don't fit in a single UDP packet, but not everybody supports it (and since not all clients support it, servers can't always enforce it), but even then there's a sweet spot where you can still send a request that's under 100 bytes and get up to 576 bytes of response (or sometimes even 1500), depending on what records the DNS server is configured for.

    And rate limiting is a server software feature, but record sizes available for querying are very much a user data issue.

    --

    Bill Stewart
    New Fast-Compression-only CPR http://preview.tinyurl.com/dy575ks
  56. Filtering UDP works fine - uRPF is IP layer by billstewart · · Score: 1

    An ISP can filter out spoofed UDP packets just as easily as spoofed TCP packets - the filtering happens at the IP layer in the router, not at the transport or application layer. Unfortunately, as another Anonymous Coward points out, it has to be done at/near the ISP where the spoofed packets originated, and that ISP may be spammer-friendly and have an upstream that's not enforcing anti-spam policies or using strict-mode uRPF (because that's something that normally you don't do except on leaf nodes.)

    An authoritative DNS server can't do much about spoofing except rate-limit and try to keep response sizes small, but a recursive DNS server can do more than that. If you're an ISP providing DNS resolution for your customers, and you filter it so you ONLY accept requests from your customers' addresses, somebody can still use your DNS server to spoof attacks against your customers, but can't use it to attack people who aren't your customers. It's a good start.

    --

    Bill Stewart
    New Fast-Compression-only CPR http://preview.tinyurl.com/dy575ks
  57. Re:I'm not quite sure how you're supposed to do it by jon3k · · Score: 1

    If you read my later posts in this thread, you'll see that I agree that source address filtering should be our #1 concern.

    With that said, there are ways to provide recursive DNS resolution to clients openly, but without being used as an attack vector. Specifically by rate limiting the requests.

    The reason ISPs are allowing spoofed traffic is simply one of two things: ignorance or laziness. It's very easy to write an ACL that mirrors your BGP announcements then apply that as an outbound filter at your peering points. It's absolutely as trivial as it sounds. The Tier 1 carriers need to start de-peering anyone who's found to not filter traffic they're not announcing.

  58. DIfferent things you can verify by billstewart · · Score: 1

    Sure, all ISPs ought to be following BCP38 and blocking spoofed-source packets, and at $DAYJOB we've been doing it since the mid 90s, but for some reason spammer-friendly ISPs don't do that. And you can't properly run strict-mode uRPF except on single-homed customers.

    But there are two kinds of DNS servers - authoritative, and recursive. Authoritative servers are the ones that domain name owners use to resolve queries about their own domains, and they're supposed to reply to everybody who asks. They can do things like rate-limiting responses, and trying to configure their data so that small queries only get large responses over TCP, not UDP, which makes spoofing much much harder, but that does require careful administration.

    Recursive DNS servers are the ones that ISPs, Enterprises, and sometimes even individuals use so that end users can send one query for www.foo.bar.com and have somebody else do the work of querying the different servers that handle the root, .com, bar.com, foo.bar.com, and www.foo.bar.com, and ideally keep a cache so that most of those names are remembered locally instead of needing queries. An "Open Recursive DNS server" will accept recursive queries from anybody, but you really don't have to do that - you can limit your servers to accepting queries from your own users. That doesn't prevent somebody from using spoofed UDP DNS requests to attack your users, but it does prevent them from using your DNS server to do spoofed attacks against people who aren't your users, keeping the internet safer for everybody.

    There are businesses who have good reasons for running open DNS servers - half the machines in my lab are configured to use Google's 8.8.8.8 because it's an easy-to-remember number and because different parts of my lab aren't always connected in ways that let them reach my corporate DNS servers. I don't know the architecture of Google's DNS servers, but my guess is that they've got lots of servers deployed over anycast, and that they've probably done their own anti-spoofing so they'll only send out replies over the connections the requests came from.

    --

    Bill Stewart
    New Fast-Compression-only CPR http://preview.tinyurl.com/dy575ks
  59. Re:I'm not quite sure how you're supposed to do it by Anonymous Coward · · Score: 0

    You're still missing the point. Some companies who do not run public resolvers but are still answering recursive queries need to configure their servers so that this stops. We don't need millions of Google DNS, and the low number of companies that do want to get involved in that sort of thing can take their own measures to reduce the damage they cause.

  60. Re:I'm not quite sure how you're supposed to do it by green1 · · Score: 1

    How is an accidental public resolver an issue if IP spoofing is impossible?

  61. Re:I'm not quite sure how you're supposed to do it by green1 · · Score: 1

    Unfortunately many common DNS packages do not include rate limiting options. I wouldn't blame this on the admins running those machines as much as on the package maintainers who don't seem to think that's an important feature.

  62. Re:I'm not quite sure how you're supposed to do it by Anonymous Coward · · Score: 0

    Are you seriously asking why a potential DoS an issue?

    And there are classes of attack that do not require IP spoofing.

  63. Re:I'm not quite sure how you're supposed to do it by jon3k · · Score: 1

    I don't believe this should be handled by the DNS software. We shouldn't have to add rate-limiting code into every individual service we run. It's easily implemented using a firewall. Even iptables (software firewall) supports rate limiting:

    http://wiki.opennicproject.org/IPTablesRulesToBlockDDOSTraffic
    http://falkhusemann.de/blog/2012/07/iptables-dns-query-limiting-with-burst-rate/

  64. It's not I folks: It's Jeremiah Cornelius... apk by Anonymous Coward · · Score: 0

    THIS is why he's doing it & proof of it, here -> http://interviews.slashdot.org/comments.pl?sid=3585927&cid=43295193 when others pointed out Jeremiah Cornelius forgot to submit one of the "first post spams" (masquerading as myself, by posting as AC & using some old posts of mine or other b.s. he put up), & JC mistakenly submitted one of the impersonations of myself as his registered 'luser' name here on /. forums.

    Pretty pitiful actually, but like every up to no good idiot does? He screwed up & submitted it under his registered 'luser' name here, instead of his ac submittals he's been doing.

    * Jeremiah Cornelius: DO YOURSELF, and the rest of us, A GIANT FAVOR MAN: Seek professional psychiatric help!

    (Since Jeremiah Cornelius obviously can't get over the fact he made a spelling error on what it is HE ALLEGEDLY DID FOR A LIVING? That's not MY fault... it's HIS!)

    APK

    P.S.=> I seriously must have dusted JC (in his mind @ least) for his BAD spelling error & it "got his goat"...

    I.E.-> Catching what he claimed to do as a job, for YEARS he left "PENETRATION" (correct) spelled as "PENTRATION" (incorrect) on his resume on LinkedIn & I pointed it out as he & his friends trolled me as usual (webmistressrachel, gmhowell, & crew (probably ALL JC no doubt using alterate emails or TOR to do it as a possible - I've caught "them & theirs" doing it before, ala Barbara, not Barbie = TomHudson (same person))).

    So THAT is what has gotten his goat in a technical debate & his "geek angst" could only come up with *trying* to "impersonate me" in every news thread on /. for the month of March 2013 so far!

    (Just to attempt to 'discredit me' as a spammer here obviously)

    Doing so, by posting that "$10,000 challenge" &/or reposts of my old posts on hosts file value to end users into EVERY SINGLE NEWS ARTICLE POSTED on /. ...

    It's all I can think of that *might* cause such a mentally troubled 'reaction' like the Jeremiah Cornelius is doing & there's NO QUESTION he's the one doing this spamming of nearly every posted article masquerading as myself...!

    ... apk