Slashdot Mirror


The Leap Second Is Here! Are Your Systems Ready?

Tmack writes "The last time we had a leap second, sysadmins were taken a bit by surprise when a random smattering of systems locked up (including Slashdot itself) due to a kernel bug causing a race condition specific to the way leap seconds are handled/notified by ntp. The vulnerable kernel versions (prior to 2.6.29) are still common amongst older versions of popular distributions (Debian Lenny, RHEL/CentOS 5) and embedded/black-box style appliances (Switches, load balancers, spam filters/email gateways, NAS devices, etc). Several vendors have released patches and bulletins about the possibility of a repeat of last time. Are you/your team/company ready? Are you upgraded, or are you going to bypass this by simply turning off NTP for the weekend?" Update: 07/01 03:14 GMT by S : ZeroPaid reports that this issue took down the Pirate Bay for a few hours.

11 of 284 comments (clear)

  1. Re:How is this an issue? by swalve · · Score: 4, Informative

    When NTP tries to say that it is 12:34:61 and the computer only expects 1-60.

  2. Re:How is this an issue? by mgscheue · · Score: 5, Informative

    It actually goes 23h 59m 59s, 23h 59m 60s, 00h 00m 00s. See http://www.nist.gov/pml/div688/leapseconds.cfm

  3. Re:How is this an issue? by bunratty · · Score: 3, Informative

    Because that would be the opposite of a leap second maybe?

    --
    What a fool believes, he sees, no wise man has the power to reason away.
  4. Re:Haha by alexborges · · Score: 2, Informative

    Windows Azure is DOWN AS WE SPEAK: http://blogs.msdn.com/b/windowsazure/archive/2012/03/01/windows-azure-service-disruption-update.aspx ... congrats on paying for your non working OS without any indemnity either.

    --
    NO SIG
  5. Re:Goddamned Java by Anonymous Coward · · Score: 3, Informative

    Normally java is just in "waste memory" mode. Now it's "waste memory AND CPU".

  6. Yes! by antdude · · Score: 5, Informative

    https://twitter.com/redditstatus/status/219244389044731904 just said so -- "We are having some Java/Cassandra issues related to the leap second at 5pm PST. We're working as quickly as we can to restore service." :D

    --
    Ant(Dude) @ Quality Foraged Links (AQFL.net) & The Ant Farm (antfarm.ma.cx / antfarm.home.dhs.org).
  7. Re:Leap second got Reddit? by smasch · · Score: 3, Informative

    Yup, Reddit got nailed.
    Here's the tweet on @redditstatus. According to them "We are having some Java/Cassandra issues related to the leap second at 5pm PST."

  8. Re:How is this an issue? by certsoft · · Score: 3, Informative

    Unfortunately some GPS vendors don't get it right. I was testing conformance of a IT530 from FastRaxGPS which uses the Mediatek MT3339 receiver.

    It put out the sequence 23:59:59, 23:59:59, 00:00:00 repeating second 59 instead of using second 60.

  9. Having issues with java/systems? try this by mwhahaha · · Score: 4, Informative

    /etc/init.d/ntpd stop; date; date `date +"%m%d%H%M%C%y.%S"`; date;

    Fixed the issues I was having. Credit goes to https://twitter.com/SilvioSantoZ/status/219250677522767872. I didn't have to restart anything after running it. YMMV

  10. Re:How is this an issue? by __aaltlg1547 · · Score: 3, Informative

    When NTP tries to say that it is 12:34:61 and the computer only expects 1-60.

    That will never happen.

    Leap seconds are always asserted at UTC midnight on the last day of a month. I think the convention is only to have leap second opportunities at the end of March, June, September and December. Typically, they try to assert it at midnight December 31. It's unusual to have a mid-year leap-second.

    Since the normal progression is 23:59:58, 23:59:59, 00:00:00, the extra second makes the time 23:59:60. 61 would be TWO leap seconds which won't happen any time soon. The Earth's rate of rotation would have to change by nearly two seconds in 3 months.

  11. Re:How is this an issue? by msauve · · Score: 5, Informative

    A day is one Earth revolution, relative to Sol. It varies slightly because of a number of factors, and is called UT1. UT2R is a smoothed version, and but variations due to unpredictable events are left. UTC is based on the atomic second. The value chosen for the atomic second is such that, on average, there have been slightly more than 86400 of them in a day. So, just as a year is more than 365 days (a day is slightly shorter than 1/365 year), so an occasional leap day needs to be added, so to an occasional leap second is needed.

    Contrary to what the GP said, the solar day is not too fast. It is what it is, by definition. Rather, the second is a bit too short.

    On average, since the leap second was introduced in 1972, one has been needed about every 18 months. Over the long term, that rate will increase as tidal acceleration slows the earth. 1 sec/18 months ~= 2e-8, so that's how much the second has been off on average since 1972. The atomic value for the second is 9,192,631,770 periods of the radiation corresponding to the transition between the two hyperfine levels of the ground state of the caesium 133 atom. So, a better value might have been 9,192,631,967, which would make us about even to date. (Although, since leap seconds aren't distributed evenly, they would still have occurred, both positive and negative, just not as many.) The original value was based on measurements made over less than 3 years, and has worked for some shorter periods (there were no leap seconds between 1999 and 2004, for example), but the value chosen has proven to be too short over the 40 years of leap seconds.

    --
    "National Security is the chief cause of national insecurity." - Celine's First Law