Slashdot Mirror


Verisign Certificate Expiration Causes Multiple Problems

We had to do a little sleuthing today. Many readers wrote in with problems that turned out to be related. A certificate which Verisign used for signing SSL certificates has expired. When applications which depend on that certificate try to make an SSL connection, they fail and try to access crl.verisign.com, the certificate revocation list server. This has effectively DOS'ed that site, and Verisign has now updated the DNS record for that address to include several non-routable addresses, reducing the load on their servers. Some applications affected include older Internet Explorer browsers, Java, and Norton Antivirus (which may manifest itself as Microsoft Word being very slow to start). Hope this helps a few people, and if you have other apps with problems, please post about them below.

35 of 360 comments (clear)

  1. Now I'm confused. by grub · · Score: 5, Funny


    (which may manifest itself as Microsoft Word being very slow to start)

    But.. I thought this SSL certificate expired just today..

    --
    Trolling is a art,
  2. The reason is obvious by Anonymous Coward · · Score: 5, Funny

    In an effort to have us forget about SiteFinder, they're going for an even bigger fuck-up.

    Nice try, guys... now turn the CRL server back on.

  3. Hmmmm... by TWX · · Score: 5, Funny

    Well, it's good to know that not only crackers or script kiddies are good at taking down Verisign's services, that their own staff is good at it too.

    --
    Do not look into laser with remaining eye.
  4. A little testy... by tcopeland · · Score: 5, Funny
    ...from the article:


    Although VeriSign has been providing instructions on how to manually install
    the new Global Server Intermediate Root CA to all GSID customers since
    December, 2001, it is possible that some customers may not have noticed the
    reminder and are unaware of this issue.


    Heh.
    1. Re:A little testy... by schon · · Score: 5, Funny

      Although VeriSign has been providing instructions on how to manually install the new Global Server Intermediate Root CA to all GSID customers since December, 2001, it is possible that some customers may not have noticed the reminder and are unaware of this issue.

      Of course they neglected to include that the notice was on display on the bottom of a locked filing cabinet stuck in a disused lavatory with a sign on the door saying 'Beware of the Leopard.'

  5. Re:Who needs them? by grub · · Score: 5, Informative


    Self-signed certificates are fine for Joe-Hobby website, but when you're about to enter a credit card number online it's assuring to see that the SSL cert is signed by a real organization and not "l33t_d00d@hotmail.com"

    --
    Trolling is a art,
  6. If people are getting errors coming to your site.. by nharmon · · Score: 5, Informative

    saying that your certificate is expired or not yet valid...except that it is...you need to go here.

  7. Progress by Patrik_AKA_RedX · · Score: 5, Funny
    they fail and try to access crl.verisign.com, the certificate revocation list server. This has effectively DOS'ed that site
    They DOSed their own site? Damn, they've made script kiddies obsolete.
  8. Duke Nukem by pantycrickets · · Score: 5, Funny

    and if you have other apps with problems, please post about them below.

    I can't get the DOS version of Duke Nukem to run in Windows XP. Is this at all somehow related? Is there a fix??

  9. Fixed this today... by heironymouscoward · · Score: 4, Informative

    On one of our customers' systems (IIS). Turns out they had already installed the new Verisign intermediate certificate but had not removed the old one. IIS happily used the old one...

    Lesson: if the certificate expired yesterday, remove it from IIS and then reboot the thing.

    --
    Ceci n'est pas une signature
    1. Re:Fixed this today... by Soko · · Score: 4, Funny

      One fix up to this:

      Lesson: if the certificate expired yesterday, remove IIS and then reboot the thing.

      HTH. HAND.

      Soko

      --
      "Depression is merely anger without enthusiasm." - Anonymous
    2. Re:Fixed this today... by nettdata · · Score: 5, Funny

      Or, in the case of MS:

      Lesson: If __________________, reboot the thing.

      --



      $0.02 (CDN)
  10. Re:Who needs them? by djh101010 · · Score: 5, Insightful

    Unfortunately, unless you buy a cert from one of the officially blessed cert authorities, your users get this ugly-looking "security warning" popup from their browser. While this is fine for clued individuals, or internal sites and so on, things that are public-facing are more sensitive to that sort of thing.

    It galls me every time I have to give someone on the officially "blessed CA" list money to do something I can do for myself in less time, but I don't know of an alternative that allows the public users of a secure website to not get alarming messages on their browser when they try to give us money.

  11. Re:Who needs them? by winse · · Score: 5, Insightful

    unless your an average user who doesn't read certificates anyway, and will just click yes on pretty much everything

    --
    this sig is deprecated
  12. Heh. by American+AC+in+Paris · · Score: 4, Funny
    We had to do a little sleuthing today.

    In other news, Microsoft, Red Hat, Oracle, Sun, and Apple had to do a little coding today.

    Rumors abound that Arnold Schwarzenegger had to do a little governing today, but these allegations remain unconfirmed at this time. More at eleven.

    --

    Obliteracy: Words with explosions

  13. null routing Certificate Revocation List Server. by Dengue · · Score: 5, Insightful

    I find it particularly disturbing that their solution to too much traffic to their CRL server is to use non-routable addresses in DNS. As a result of this action, they have reduced the integrity of their certificates (yes, that means diluting TRUST, which is the foundation of PKI) by making the revocation lists unavailable. Without CRL checking, Verisign certificates have no inherit integrity advantage over self-signed certificates. This is what we pay for?

    Non-authoritative answer:
    Name: crl.verisign.net
    Addresses: 10.0.0.1, 10.0.0.2, 10.0.0.3, 64.94.110.11
    198.49.161.200, 198.49.161.205, 198.49.161.206
    Aliases: crl.verisign.com

    --
    Go figure.
  14. Windows Explorer by thedillybar · · Score: 4, Informative
    I noticed this happening yesterday on my WinXP machine. After clicking Start->Programs and right-clicking on any icon, c:\windows\explorer.exe attempts to connect to crl.verisign.com [198.49.161.200], port 80.
    As the article states, this also resolves to some unroutable IPs:
    198.49.161.205
    198.49.161.206
    10.0.0.1
    10.0.0.2
    10.0.0.3
    64.94.110.11
    198.49.161.200
    Windows Explorer also appears to freeze (at least temporarily) if a firewall (or presumably a lack of Internet connection) prevents this from being made. It's possible, however, that if crl.verisign.com will not resolve, it will not freeze as it will if it resolves but cannot connect. Unfortunately, this is still a problem even if you have an Internet connection because of the stability (or lack thereof) of the Verisign site.
  15. Fee was too high by sphealey · · Score: 4, Funny
    I bet their CFO wouldn't approve payment of Verisign's tremendously high fee to renew the certificate. "'Highway robbery,' he fumed. 'We aren't paying that fee!'".

    sPh

  16. VeriSign is lame by Anonymous Coward · · Score: 5, Insightful

    It is stupid for VeriSign not to have taken the steps necessary to keep their CRL available under these conditions seeing that they get paid a lot of money to do only 2 things:

    1) Be trustworthy
    2) Be competent

  17. Re:Who needs them? by John+Hasler · · Score: 5, Funny

    > ...when you're about to enter a credit card number
    > online it's assuring to see that the SSL cert is
    > signed by a real organization...

    Unfortunately, we usually have to settle for Verisign instead.

    --
    Warning: this article may contain humor, sarcasm, parody, and perhaps even irony. Read at your own risk.
  18. Re:Who needs them? by Roogna · · Score: 5, Insightful

    The most unfortunate thing about this. Is that with VeriSign especially, I find them to be one of the _most_ untrustworthy companies on the planet (How many times have they mis-issued certificates now? And lets not forget all the screwups related to their DNS scams). So the question is, who do you go to for certificates? Can't sign your own because users may feel you're insecure (justifiable or not) and can't trust certificates from the "official" CA's, because... well that's like trusting the goverment to make sure you get all your tax deductions whether you knew they were owed you or not ;)

    I just really wish I could find an affordable CA that I felt was trustworthy enough themselves as to feel safe making my customers trust their certificates.

  19. problems by chunkwhite86 · · Score: 4, Funny

    ...if you have other apps with problems, please post about them below.

    Well, now that you mention it, my mother hasn't been able to print for a week, my uncle's PC keeps running checkdisk on startup, and I'm having trouble compiling kernel 2.6.0.

    Oh yeah, and Unreal 2k3 has crappy frame rates on the 'Antalus' level, but maybe thats just my old ti4200 card.

    Um. I think that's it for now. So when are you going to help me with these?

    --
    I'd rather be a conservative nutjob than a liberal with no nuts and no job.
  20. Re:Who needs them? by attobyte · · Score: 4, Insightful

    I would have to say more users click on "yes" for everything. I have to reinstall several family members computer because of spy/ad ware and a ton of other crap because the click yes to everything.

    --
    I didn't use the preview button, so get over it!!!!

    Mike

  21. What are you talking about? by Pieroxy · · Score: 5, Funny

    Unless you have a P75, I don't see what you are talking about. MSWord has always started in less that 3 seconds on my system (PIII 700) and I can tell you that sometimes it is terribly bloated (My system, not Word).

    Wait, did I just admit running Windows on slashdot? Bye bye Karma.

  22. Verisign isn't the only game in town by justMichael · · Score: 4, Informative

    I use Instant SSL cheap, good service and I haven't seen any compatibility issues.

  23. Workaround to Explorer problems by BigJavaGeek · · Score: 5, Informative

    Because of the crl problems, Explorer has been acting slowly doing some seemingly unrelated activities. Copying or right-clicking on folders often is followed by a several second hang. To workaround, deselect "Check for publisher's certificate revocation" under the Advanced setting for IE (even though it is not IE running, that's where the setting should be changed). After this, no more Explorer hangs. Hope this helps someone. If you know why Explorer is checking crls for anything when doing a copy operation on files, please post.

    1. Re:Workaround to Explorer problems by JoeShmoe · · Score: 4, Informative

      I think you missed something in the blurb about this problem. The problem is Norton Antivirus, not Explorer. Norton is probably doing some kind of check on its virus signature files by validating their signature. This function is probably being handled by IE as the default browser function, which is getting hung up on the unroutable revocation site.

      So, to clarify, when you try to do a file operation, like copy, Norton intercepts the operation so it can check the file for a virus, then gets itself held up while waiting for IE to tell it if the signature is valid so it can check for that virus. End result is that Explorer never gets an answer from Norton and the operation hangs. Ditto for Word and other applications Norton watches closely.

      I too had this same problem on one of two Dell laptops. One used the default McAfee ScanShield that came with it, the other had been reloaded with Norton Anti-Virus. That machine had all sorts of crazy errors, such as Word hanging during opening, hanging when you right-clicked a file, hanging when you tried copying files.

      The system also had ooodles of pending updates from Microsoft that had been downloaded but not installed. I'm willing to bet one of them was a root server update or similar. Of course, the problem could be on Norton's end, meaning they need to update the security cert on their server? I'm not sure exactly how it works.

      - JoeShmoe
      .

      --
      -- I wonder which will go down in history as the bigger failure: the War on Drugs or the War on Filesharing
  24. Re:Who needs them? by LostCluster · · Score: 5, Informative

    There's software out there so anyone can sign a certificate. Who needs the suits at Verisign?

    Because a cert signed by you is useful for nothing more than "This conversation is encrypted, and I say I'm me." A cert signed by a Verisign translates to "This conversation is encrypted, and Verisign says I'm me."

    What good is that? Well, not much among geeks, we don't trust Verisign further than we can throw them, but we're depending on them to keep this silly DNS thing going. However, web browsers are set with a default list of trusted "Certificate Authorites" who are allowed to sign certificates. Companies who are on those lists can sign a certificate that'll work without errors, anybody else's certificate will prompt a message indicating that the name's right, the time's valid, but the issuing authority isn't on the list of authorities you trust. (You can manually add a new authority if you want... but try convincing users to do that!)

    The problem is, so many cheapskates have now signed their own certificate that the bogus authority error isn't stopping users since it's so common when nothing's really wrong. As a result, we're seeing a lot of look alike sites use SSL to get the padlock to come up, and users not being phased by the red-flag alerts that this doesn't seem to be the site they think it is.

  25. Re:Who needs them? by KlomDark · · Score: 5, Informative

    Uh, Thawte is owned by Verisign, smart guy...

    But they are a lot cheaper for some reason... Go figure...

  26. Unroutable, schmunroutable by marnanel · · Score: 4, Interesting

    Unroutable addresses? Anyone on private corporate networks which are large enough to use 10.0.0.0/8, who are unfortunate enough to have been allocated the IP addresses 10.0.0.{1,2,3}, may be experiencing a little more network load than usual today as every machine in the place tries to query them.

    --
    GROGGS: alive and well and living in
  27. Its happening on most servers. by Steepe · · Score: 5, Informative

    Very nice of them to.. I don't know.. let someone know before today. We spent a ton of staff time this morning trying to figure out why we could connect to our servers but not the payment engines via ssl. 4 hours later we figured it out.

    Couple of nice links.

    http://sunsolve.sun.com/pub-cgi/retrieve.pl?doc= fs alert%2F57436
    http://www.verisign.com/support/ven dors/exp-gsid-s sl.html

    --
    Just three more hours seapeople and you can finally take me away from this crappy God Damned planet full of hippies
  28. Why should expired cert => CRL traffic spike?? by Y2 · · Score: 4, Interesting
    I'll take the risk of looking stupid and ask the musical question: Why should the expiration of a certificate cause an increase in traffic to a CRL server? Once a certificate has expired its revocation status is irrelevant. Revocation lists exist solely to cancel a key before its certificate expires.

    Or is it merely that some software automatically calls the mothership for new information on expiration, and the hostname of the mothership happens to start with "crl"?

    (Antidisclaimer: I operate five private CAs and delude myself that I basically understand this stuff.)

    --
    "But all your emitter and collector are belong to me!"
  29. Warning: broken apps you might not think about by Delirium+Tremens · · Score: 4, Insightful
    if you have other apps with problems, please post about them below.
    Interestingly enough, apps that use the old Verisign certificate and that didn't have visible problems today are also to be considered broken. Those apps have a much bigger problems that the apps that broke today. Those apps should have failed today. The fact that they didn't proves that their certificate checking logic is buggy and shows that they are actually prone to attack. Those applications are much less secure than the ones that broke today. Actually, the apps that broke today didn't actually break. They were the only ones to behave correctly.
  30. Not the first Verisign CRL certificate problem by securitas · · Score: 4, Interesting


    This vaguely reminds me of the fraudulent Verisign / Microsoft code-signing digital certificates that Verisign issued a few years back.

    While not an identical problem, an essential element of why those certificates were potentially harmful was also because of a problem with the CRL checking. Verisign didn't support CRL distribution points in their certificates and you all remember the problems that ensued.

    I found security researcher Gene Spafford's comments on the PKI / Verisign issue interesting, which were picked up in Bruce Schneier's Crypto-Gram. Schneier's comments on the incident as well as the Microsoft response are also worth reading.

    It's unbelievable that Verisign which claims to be in the business of Internet security and SSL/TLS digital certificates - the dominant company with 95%+ market share - could let their Root Certificate Authority expire, then force its users to effectively patch their systems by importing the new certificate for the root CA after the fact. That's just bad engineering.

    Yes, end-users need to take some responsibility for their systems, but PKI and related technologies are complex and not for novices. It's no better than the keep-your patches-updated-and-use-a-firewall comment that Bill Gates made a couple of months ago. That's a bandage, not a solution.

  31. Re:Who needs them? by Ben+Hutchings · · Score: 4, Informative

    Self-certificates are worthless except when distributed through an existing secure channel. Without a proper certificate, all I know is I'm encrypting the session key with someone's public key, but I don't know whose it is. I might as well send the contents in the clear.