Slashdot Mirror


Millions of .de Domains Unreachable For Hours

An anonymous reader writes "Due to an error on behalf of DENIC, the German DNS registrar for second-level .de domains, millions of .de domains fell over the edge (auf Deutsch) of the Internet today. The cause of this GAU (GröYter anzunehmender Unfall = maximum credible accident) is still unknown, as DENIC officials haven't answered any questions from journalists at the time of writing."

83 comments

  1. So... by Rotten · · Score: 1

    Domains and DENIC officials were both unavailable, the only difference is that officials will be unavailable a bit longer...i bet it sucked to be them today.

    1. Re:So... by sopssa · · Score: 0, Insightful

      It's a single point of failure for the "distributed" internet. Just imagine if this happens to ICANN. Yeah you can still access the IP addresses, but that doesn't really help casual people.

    2. Re:So... by Anonymous Coward · · Score: 0

      IPs ought to be enough for anybody

    3. Re:So... by JWSmythe · · Score: 2, Interesting

          I wonder if this had anything to do with my own DNS outage yesterday. There seemed to be a rolling DoS attack which hit a couple of my nameservers. It hit a slightly out of date version of bind, which made it barf. Of course I have the servers monitoring themselves, so they kept bringing it back up, just to be knocked down again a few minutes later. The solution? Upgrade to current.

          Did anyone else see this, or was it two isolated (and unrelated) cases?

      --
      Serious? Seriousness is well above my pay grade.
    4. Re:So... by net28573 · · Score: 2, Interesting

      I experienced an array of network cuts recently as well! i thought i was the only one but this confirms my suspicions that something in the network is buggy. I use clearwire as does my mom and just as she was calling me claiming that the internet didn't work mine was acting buggy too. Whats stranger is that despite that all the diagnostics detected errors in the network connection, i could strangely remote connect to moms computer from mine! after this i did do another netstat to see what was going on but it showed no connections. it may have been due to the fact that i was connecting to the desktop there rather than trying to access youtube or another site that was possibly glitchy. anyone else experience something similar?

      --
      RIP TRICERATOPS, YOU NEVER EXISTED
    5. Re:So... by Anonymous Coward · · Score: 0

      I'd rather wait for a reply by the people trying to fix the error than wait for the people replying to fix the error.

  2. So it looked something like by wiredog · · Score: 2, Funny
  3. auf Deutsch? by Anonymous Coward · · Score: 1, Insightful

    Tell me, what is the point of putting a warning aimed at people who don't speak German in German??

    1. Re:auf Deutsch? by kju · · Score: 4, Informative

      Why complain? It's nothing else than the typical bad work of the so called "editors" of slashdot. They also did not notice that a charset conversion error occured. The german phrase is "Größter anzunehmender Unfall", not "GröYter anzunehmender Unfall". But why should we expect that paid editors do actually work?

    2. Re:auf Deutsch? by Anonymous Coward · · Score: 0, Insightful

      Vielleicht sind sie davon ausgegangen, dass auch dumme Amerikaner können das Wort "Deutsch" und die Bedeutung des Ausdrucks zu schließen.

    3. Re:auf Deutsch? by tomhudson · · Score: 5, Funny
      How hard is it to figure out this?

      Denic Probleme mit den .de-Rootservern? (Update 2)

      Derzeit lassen sich viele .de-Domains nicht auflösen. Schuld daran könnten Probleme auf Seiten der Denic sein, die die Rootserver für die Top-Level-Domain .de betreibt. Mittlerweile ist das Problem behoben.

      Problems with the root .de name server. Of course, it's funnier if you don't know that "die" is "the" in german: "die die Rootserver für die Top-Level-Domain .de" so in germglish it becomes "die, die, tld .de rootserver" OMG terrorist threat!

    4. Re:auf Deutsch? by Anonymous Coward · · Score: 5, Funny

      Unicode on slashdot? UNPOSSIBLE

    5. Re:auf Deutsch? by Anonymous Coward · · Score: 0

      Really, if you couldn't figure that one out, just go throw yourself off a cliff and raise the average intelligence of the planet a bit.

    6. Re:auf Deutsch? by Anonymous Coward · · Score: 2, Informative

      Stop calling it root server (Shame on you, Golem.de!). The root servers serve the root zone, which contains the top level domains. The affected servers in this incident were the de-TLD servers which serve the second level domain records.

    7. Re:auf Deutsch? by Anonymous Coward · · Score: 0

      Google Translates: Perhaps they are expected to stupid Americans can also close the word "German" and the meaning of the expression. Me: *_*

    8. Re:auf Deutsch? by Anonymous Coward · · Score: 0

      "kennen", dummkopf.

    9. Re:auf Deutsch? by Anonymous Coward · · Score: 1, Informative

      If you want to troll, look for a better online translator.
      Everything after "Amerikaner" is gibberish.

    10. Re:auf Deutsch? by Arancaytar · · Score: 1

      Die Die Die is a term of endearment I frequently use while at a Windows PC. :P

    11. Re:auf Deutsch? by Anonymous Coward · · Score: 4, Informative

      Also, "GAU" is probably better translated as "worst-case scenario".

    12. Re:auf Deutsch? by tomhudson · · Score: 1

      "Oy vay! What do you expect from a golem? Probably got distracted by. some shiksa. Give the servers some chicken soup, already!"

      "Chicken soup won't help!"

      "Couldn't hurt ..."

    13. Re:auf Deutsch? by Hurricane78 · · Score: 2, Funny

      So it does not mean “district” anymore? ;)

      --
      Any sufficiently advanced intelligence is indistinguishable from stupidity.
    14. Re:auf Deutsch? by gweihir · · Score: 1

      GAU = Groester anzunehmender Unfall = Worst Accident that can reasonably be expected to happen

      A worst-Case Scenario is more likely a "Super-GAU", i.e. when you take political and commercial "interpretations" away and only look at what could actually happen. And, yes, "Super-GAU" is a proper term, not my invention.

      --
      Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
    15. Re:auf Deutsch? by xouumalperxe · · Score: 2, Insightful

      so a GAU is a SNAFU?

    16. Re:auf Deutsch? by Anonymous Coward · · Score: 0

      If there's a massive spill of radioactive material despite all efforts to stop believable accident scenarios in a nuclear reactor it's an accident larger than the GAU (largest accident believed to have a chance to happen) and therefore it's a Super-GAU.

      The term came into widespread use after Tchernobyl, methinks.

    17. Re:auf Deutsch? by oblivionboy · · Score: 1

      And yet you still keep coming back, again and again, after all these years. ;)

    18. Re:auf Deutsch? by KDR_11k · · Score: 2, Informative

      But HTML entities work!

      --
      Justice is the sheep getting arrested while an impartial judge declares the vote void.
    19. Re:auf Deutsch? by Anonymous Coward · · Score: 0

      never did; Gau != GAU

    20. Re:auf Deutsch? by DMUTPeregrine · · Score: 1

      Slashcode supports unicode, Slashdot blocks all but a small whitelist of characters. The block is because people were abusing flow control characters to do "interesting" things.

      --
      Not a sentence!
    21. Re:auf Deutsch? by jc42 · · Score: 1

      Nah; it was just as stated: a charset conversion screwup. The pages I get say <meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1"> in the header section. Do yours say UTF-8 or some other Unicode charset?

      It would be nice to be able to quote things in non-Western languages here, especially now that China+Korea+Japan are the majority of the Internet, and where most of our hardware is now produced. But I guess it'll still be a while before those of us dealing with non-Western languages are permitted to join in US-based forums. Or use standard mathematical symbols in tech forums like /.

      Still, you'd think they'd be able to get a simple 'ß' character right. I wonder where the screwup was this time.

      --
      Those who do study history are doomed to stand helplessly by while everyone else repeats it.
    22. Re:auf Deutsch? by Anonymous Coward · · Score: 0

      http://mybigmonkey.com/gibberish/

      Hope that's helpful....

    23. Re:auf Deutsch? by Pharmboy · · Score: 1

      so a GAU is a SNAFU?

      Technically, no. SNAFU refers to a stituation that is Normal (but always All Fouled Up). GAU refers to the worst possible situtation that could be anticipated, ie: more fouled up than usual, and about as fouled up as your imagination can take you.

      --
      Tequila: It's not just for breakfast anymore!
  4. Sad by adeft · · Score: 0

    It was a sad day for Shiza-porn

    1. Re:Sad by Anonymous Coward · · Score: 1, Informative

      Good miss. The word you were grasping at is Scheisse.

    2. Re:Sad by Anonymous Coward · · Score: 0

      du hast sheisse schwanz

    3. Re:Sad by Dogtanian · · Score: 1

      It was a sad day for Shiza-porn

      Good miss. The word you were grasping at is Scheisse.

      Shiza sounds like one of those districts of Tokyo that nerds dream of going to because it consists of obscure shops that sell flavours of Pocky not available in the United States, like vodka-scented curried tayberry, or the infamous "Pocky flavoured Pocky" whose very meta-ness has driven some Westerners mad....

      Sorry, where was I again?

      --
      "Slashdot - News and Chat Sites Deviant". (Click "homepage" link above for details).
  5. Wow, an umlaut by Anonymous Coward · · Score: 0

    The word is "Größter" though.

  6. Some more details about the outage by kju · · Score: 5, Informative

    The problem did not affect all domains and it did not affect all nameservers for the german TLD. The nameservers which are reached through "c.de.net" (== c.nic.de) and "s.de.net" (== s.nic.de) more or less worked fine during the outage. Only for a short period of time they did not answer. The other nameservers for .de however lost the knowledge of most domains under the TLD and only returned NS-records for the domain names starting with a digit or with the letter a to e. So for example br-online.de worked fine, while web.de did not. The really bad part is, that the affected nameservers did not refrain to answer but instead answered with NXDOMAIN. So they told that they do not have a record for the query, which in turn effects to "This domain does not exist". Unfortunately such negative answers are cached for a time determined by the authorative nameserver. DENIC's nameserver tell clients to cache this result for 7200 seconds, therefore the outage continued to make problems for up to two hours after the problem was fixed, unless the DNS caches were cleared.

    One more thing to notice: Some sites claim that four of the six nameservers for .de were affected because six hostnames are listed as nameservers for .de and as i told, two of them did work. However both a.nic.de and z.nic.de resolv to anycast IPs which will be routed to a number of different servers around the world depending on your own location. So it are more than six servers in total.

    1. Re:Some more details about the outage by Anonymous Coward · · Score: 0

      This is the most detailed account I've read so far, including German sources. Mod up.

    2. Re:Some more details about the outage by nullchar · · Score: 4, Informative

      According to the DENIC registrar's mailing list, this was just an administrative fuckup. DENIC apparently runs Bind, (on at least the 4 affected logical servers) and they reloaded Bind with an empty zone file. Since the six logical servers are all authoritative, the empty-zone-file servers replied with NXDOMAIN (as they should have).

      The parent is correct, non-existent domain responses should only be cached for 2 hours.

      Since .de is the largest ccTLD (by count of registrations), this is a pretty big deal. On April 3 2010, there were 13.5 million registered .de domains. I wonder how long it took Bind to start with that many zones!

    3. Re:Some more details about the outage by mseeger · · Score: 4, Interesting

      The DE-NIC finallly spoke out. If you don't speak german, the statement doesn't contain anything that wasn't already well known: Yes, there was an problem starting at about 13:00 and it was fixed around 15:45.

  7. Hungry anyone?? by PeopleMakeMeLOL · · Score: 1

    All your wienerschnitzel are belong to me! :D

    1. Re:Hungry anyone?? by owlnation · · Score: 1

      Wiener Schnitzel = Austrian. Not German. (Wien is Vienna) Nice try. Close... but not close enough.

    2. Re:Hungry anyone?? by Anonymous Coward · · Score: 0

      You know, zere was a time vere siz was ze same...

      Captcha: Bogeymen - Now, why does this make me think of men in black leather coats with skull insignia?

    3. Re:Hungry anyone?? by Anonymous Coward · · Score: 0

      Bogeymen: Humphrey Bogart's gang?

  8. DENIC officials haven't answered any questions by Anonymous Coward · · Score: 3, Funny

    Meanwhile I'm sure Hitler will be happy to discuss the situation on youtube.

  9. OH NO!!! by Anonymous Coward · · Score: 1, Insightful

    Where will people get their bizarre latex fetish watersports dungeon porn now!?!?!?!!

    1. Re:OH NO!!! by grimJester · · Score: 2, Insightful

      .jp, obv.

  10. "Official" response by Anonymous Coward · · Score: 5, Funny

    Here is the response I found on the denic.de site : http://www.denic.de/typo3temp/pics/i_64bbbffdb3.jpg

  11. ref by Anonymous Coward · · Score: 1, Funny

    Du.de, where's my si.te?

  12. DNSSEC to blame.... by mseeger · · Score: 4, Interesting

    According to my informations (DFN NOC) the problems resulted from a botched experiment with DNSSEC. Unluckily the DE-NIC is still silent about the incident.

    1. Re:DNSSEC to blame.... by Anonymous Coward · · Score: 1, Interesting

      The zone information was only partially available from some servers. That could be the result of the size increase caused by the additional (large) DNSSEC records. Perhaps some automated zone update process ran out of space or time. This is only speculation though.

    2. Re:DNSSEC to blame.... by kju · · Score: 1

      I heard this claim coming from the DFN as well, but i really suspect that it's bullshit. Why? As far as i understood (i admit lacking proper knowledge of DNSSEC) the introduction of DNSSEC might only affect clients which are actually capable of doing DNSSEC and which will request the nameserver to do DNSSEC, as DNSSEC is done by additional records in the DNS. Old clients will just request records as they did ever and will get normal answers like they got ever.

      Also as told above, domains starting with a digit or the letters a to e (like br-online.de) did work all the time, while requests for other domains got a NXDOMAIN on the greater part of the authorative nameservers. I don't see any valid explanation how such a scenario should be caused by experimenting with DNSSEC. It seems more that a number of nameservers only got a incomplete zone file ending after domains starting with e.

      I really think that the DFN NOC is making a wrong claim out of their ass here.

    3. Re:DNSSEC to blame.... by Anonymous Coward · · Score: 1, Interesting

      Another speculated cause is that DENIC messed something up when they moved registry services from Amsterdam to Frankfurt yesterday.

    4. Re:DNSSEC to blame.... by mseeger · · Score: 2, Interesting

      We wouldn't need to speculate if the DE-NIC would give out more details. Concerning myself, the DFN NOC holds more credibility than the DE-NIC.

      There are hundreds of ways to get a DNSSEC deployment wrong. The error is not disturbing by itself. The time needed for a rollback on any change they made is IMHO. As well as the lack of concept about what to do in case something like this happens. Don't get me started on the information policy...

      CU, Martin

    5. Re:DNSSEC to blame.... by kju · · Score: 1

      Wow, someone decided to mod me down as overrated. Talk about mod abuse.

      However, it is told that the DNSSEC testbed worked fine during the outage, so this is a strong indicator that DNSSEC was not the culprit. I also got a credible statement from a DENIC technician that DNSSEC was not the reason and the DFN NOC is - as i said - making a ridiculous claim without any background knowledge. DENIC still has not provided an explanation but it appears that for some reasons the zones were only transfered in part, which explains why domains up to a specific point worked and the domains after that point didn't.

      The abusive mod may now choose to mod me down again.

    6. Re:DNSSEC to blame.... by mseeger · · Score: 1

      The reason is AFAIK not DNSSEC itself, but the process of the introduction. Why should someone delete zone files if not due to changes made to the zones? I would guess, any nameserver gets for each update only a diff and not a full dump. In this case the diff contained empty zones (my guess).

      Don't try to understand the modding here. I've given up on that one.

      CU, Martin

  13. Is there a Downfall video meme yet? by BitwiseX · · Score: 1

    There's potential to bring humor back to that meme.
    Damn my laziness!

  14. German Spammers demand Rescue Package by gomoku · · Score: 1

    The Association of German Spammers has already claimed billions of dollars in losses due to the outage. The association chairman claims: "We need a rescue package to recover our losses". Billions of SPAM emails to valid accounts were flagged as "does not exist". Using the same calculations as the music industry the rescue package is estimated to exceed 50 billion euros to recover todays losses.

    --
    Track your fitness and strength gains with www.trackmytraining.net
    1. Re:German Spammers demand Rescue Package by SmackTheIgnorant · · Score: 1

      oh no! their children's children won't be able to afford cheap herbal viagra, knock off rolex's, and penis enlargement treatments in their own homes!

  15. We call that... by Anonymous Coward · · Score: 1, Funny

    Also, "GAU" is probably better translated as "worst-case scenario".

    We call that a clusterfuck in these here parts.

    1. Re:We call that... by Hurricane78 · · Score: 1

      I think, since GAU is the term for a worst-case scenario in a nuclear reactor, it would be best translated as “nuclear clusterfuck” ^^

      --
      Any sufficiently advanced intelligence is indistinguishable from stupidity.
    2. Re:We call that... by Jesus_666 · · Score: 3, Insightful

      Actually, we reserve the term "Super-GAU" for that. "GAU" translates to "most severe expected accident"; it's still something you design your facility to handle. Consequently, a Super-GAU is an accident that exceeds what you planned for. An important point is that nuclear plants are required not to emit any radioactive material even in case of a GAU. Therefore, any accident during which the plant does release radioactive material is a Super-GAU.

      Three Mile Island is a good example: Back than it was a Super-GAU as nobody designed reactors to handle gas buildup. With modern reactors it's a regular a GAU since modern designs are required to consider that failure mode and mitigate it.

      In short: A GAU is "well, I guess after we're done decontamining and repairing the plant we'll need to do quite a bit of lobbying to get it back online". A Super-GAU is "we just contaminated how much land?".

      --
      USE HOT GRITS WITH STATUE OF NATALIE PORTMAN (NAKED AND PETRIFIED)
    3. Re:We call that... by Mindcontrolled · · Score: 4, Informative

      True. The engineering term for a GAU is "Auslegungsstörfall" - you gotta love German composita. It roughly translates to "design basis accident" - the biggest accident covered by you fail-safes. The "GAU" acronym is mostly misused these days.

      --
      Ubi solitudinem faciunt, pacem appellant.
  16. Re:Wow, an umlaut. typoinsummary by Anonymous Coward · · Score: 0

    GröYter, yes, that is Größter or where ß, which is not beta, is not available, Grösster.

  17. HTML and spaces are now allowed in domain names? by Hurricane78 · · Score: 2

    What is a “<nobr> <wbr></nobr>.de” domain? And why are there millions of them?

    Or is that just another epic failure of someone using a WYSIYFH (what you see is you failing hard) interface, caused by the idiocy that is “K.I.S.S.”?

    --
    Any sufficiently advanced intelligence is indistinguishable from stupidity.
  18. DE-NIC by mseeger · · Score: 3, Interesting

    Once upon a time, the DE-NIC was very respected in the german internet community. But several things happened lately, that let the trust erode. There were internal power struggles, the rising influence of domain traders inside the DE-NIC and the surprising distribution of the two-letter-domain-rush (25% of all domains ending in the hands of a single person). Perhaps this outage will be a wakeup call. If we only count the time spent on customers calling the hotline, the damage for my company is several thousand dollars.

    CU, Martin

  19. Re:HTML and spaces are now allowed in domain names by Jesus_666 · · Score: 1

    What is a “<nobr> <wbr></nobr>.de” domain? And why are there millions of them?

    It's just Slash demonstrating that it speaks neither Unicode nor HTML.

    --
    USE HOT GRITS WITH STATUE OF NATALIE PORTMAN (NAKED AND PETRIFIED)
  20. Schon. by CorporateSuit · · Score: 4, Funny

    Lufthansa (in German): "Ground, what is our start clearance time?"
    Ground (in English): "If you want an answer you must speak in English."
    Lufthansa (in English): "I am a German, flying a German airplane, in Germany. Why must I speak English?"
    Unknown voice from another plane (in a beautiful British accent): "Because you lost the bloody war."

    --
    I am the richest astronaut ever to win the superbowl.
    1. Re:Schon. by dwarfsoft · · Score: 1

      Die Tränen greiser Kinderschar
      ich zieh sie auf ein weisses Haar
      werf in die Luft die nasse Kette
      und wünsch mir dass ich eine Mutter hätte

      Keine Sonne die mir scheint
      keine Brust hat Milch geweint
      in meiner Kehle steckt ein Schlauch
      hab keinen Nabel auf dem Bauch

      Mutter...

      --
      Cheers, Chris
  21. K.I.S.S.? by circletimessquare · · Score: 3, Informative

    you mean "Keep it simple, stupid"?

    the KISS principle is perhaps one of the greatest principles in engineering, and frequently keeps people's minds grounded in the deliverables, and prevents them from spinning out of control into overly complex solutions, which are in fact the source of most software bugs, not the solution to them

    if this is the principle you are referring to, i don't know where the source of your animosity to it lies, nor why it has anything to do with this particular subject matter

    --
    intellectual property law is philosophically incoherent. it is your moral duty to ignore it or sabotage it
    1. Re:K.I.S.S.? by Anonymous Coward · · Score: 0

      After re-reading that post a few times, I've concluded that by "K.I.S.S.", he's referring to the band.

  22. Constantin Films/YouTube/Der Untergang by BenJeremy · · Score: 4, Funny

    Looks like they put a DMCA takedown notice on the entire country.

    ...I will forever wonder what Hitler would say about this.

    1. Re:Constantin Films/YouTube/Der Untergang by tool462 · · Score: 1

      DENIC macht frei?

    2. Re:Constantin Films/YouTube/Der Untergang by ignavus · · Score: 1

      Looks like they put a DMCA takedown notice on the entire country.

      ...I will forever wonder what Hitler would say about this.

      Don't know: Hitler.de couldn't be contacted for a comment.

      --
      I am anarch of all I survey.
  23. What really Happend by Anonymous Coward · · Score: 0, Redundant

    from their webside: http://www.denic.de/typo3temp/pics/i_64bbbffdb3.jpg

    1. Re:What really Happend by Anonymous Coward · · Score: 0

      Du willfähriges Mitglied des fefe-Zeitbinderbotnetzes!

  24. Re:Wow, an umlaut. typoinsummary by YttriumOxide · · Score: 1

    GröYter, yes, that is Größter or where ß, which is not beta, is not available, Grösster.

    Or when neither "ö" nor "ß" are available, "Groesster" would also be acceptable.

    --
    My book about LSD and Self-Discovery
    Also on facebook as: DroppingAcidDaleBewan
  25. What happened to the Germany water website? by InvisibleSoul · · Score: 3, Funny

    .de nile of service!

  26. Obligatory by RevWaldo · · Score: 2, Funny

    ACHTUNG!

    Alles Touristen und Non-technischen Looken Peepers! Das Machinekontrol ist nicht fur Gerfingerpoken und Mittengraben. Oderwise ist easy Schnappen der Springwerk, Blowenfuse, und Poppencorken mit Spitzensparken. Der Machine ist Diggen by Expertzen Only. Ist nicht fur Gewerken by Dummkopfen. Das Rubbernecken Sightseenen keepen das Kottenpicken Hands in das Pockets. So relaxen und watchen das Blinkenlights.

    .

  27. Re:Wow, an umlaut. typoinsummary by Anonymous Coward · · Score: 0

    or, to sum everything up it would be: Nein, Nein, Nein, nein nein. (while banging his fist on the table) you just gotta love tarantino.