Slashdot Mirror
Managing the Most Remote Data Center In the World
blackbearnh writes "Imagine that your data center was in the most geographically remote location in the world. Now imagine that you can only get to it 4 months of the year. Just for fun, add in some of the most extreme weather conditions in the world. That's the challenge that faces John Jacobsen, one of the people responsible for making sure that the data from the IceCube Neutrino Observatory makes it all the way from the South Pole to researchers across the world. In an interview recorded at OSCON, Jacobsen talks about the problems that he has to face (video), which includes (surprisingly) keeping the data center cool. If you're ever griped because you had to haul yourself across town in the middle of the night to fix a server crash, this interview should put things in perspective."
I think you're almost certain to have to fix problems in the middle of the night down there, after all they are about 6 months long...
What I find even more impressive is how NASA, ESA and others manages space probes I think, that's really extreme conditions in every way. Often huge communication delays and poor bandwidth, absolutely no chance of at least eventually fixing a problem on-site, hardware constantly being subjected to intense radiation and extreme temperature differences. Imagine that rather unpleasant feeling you get when you reboot a remote server and you know you won't be able to go on-site any time soon to fix it if you did something wrong, then take that feeling and add the fact that you can _never_ fix it, that it costs millions or even billions to send it there, that lots of valuable science might be lost or never take place, and that you'll be guaranteed to read about your mistake in the news the following day. I guess it calls for rather extreme levels of testing before doing any changes at all.
But then a bunch of penguins could sneak in and replace all their copies of Windows 2008 server with Linux. Wait, this plan actually sounds better and better every second...