Rugged Linux Server For Rural, Tropical Environment?
travalas writes "Last year I moved to Rural Bangladesh. My work is pretty diverse, everything from hacking web apps to designing building materials. Increasingly a Linux VM on my MacBook Pro is insufficient due to storage speed/processing constraints and the desire to interface more easily with some sensor packages.
There are a few issues that make that make a standard server less than desirable. This server will generally not be running with any sort of climate control and it may need to move to different locations so would also be helpful if it was somewhat portable. The environment here is hot, humid and dusty and brutal on technology and power is very inconsistent so it will often be on a combination of Interruptible Power Supply and solar power. So a UPS is a must and low power consumption desirable, so it strikes me that an Integrated UPS a la Google's servers would be handy. Spec wise it needs to be it needs to be able to handle several VM's and some other processor storage intensive tasks. So 4 cores, 8GB of ram and 3-4 TB of SATA storage seems like a place to start for processing specs. What sort of hardware would you recommend without breaking the bank?"
Get a laptop or 3.
Portable - check
UPS - check
Able to handle no climate control - check
4 cores & 8GB - check
4TB of storage - Get an external drive bay. (Do you really need that much storage? really?)
Some of the XPS line from Dell or other 'Gaming' laptops should do the trick.
"The price good men pay for indifference to public affairs is to be ruled by evil men." ~Plato (427-347 BC)
Sure, get a Dell XFRD630. Which is a 630 with a hardened rubber cover and latch doors for the ports. What that does for heat or ruggedizing, I have no idea. It dies if you dump any water on it. It dies if you press too hard on the keyboard even. Total POS.
I've played with most ruggedized systems available on the market in humid, hot, desert, cold, snowy - you name it - climates. They all are pretty much useless. I prefer using just a regular laptop. If it breaks, it breaks. The ruggedization has $$$ cost and inconvenience associated with it, and the first thing that suffers is human interface. Since I brought the computer to DO things, that is not negotiable. If you just want something pretty and expensive that you don't use, get a ruggedized system.
HBI's Law: Frequency of calling others Nazis is directly correlated with the likelihood of the accuser being Communist.
You could get an external drive and possible cluster them together for the enhanced processor power? Dont know but this taptop seems to be able to handle the enviroment you want it to. Also UPS plus Solar Panels = headache so be prepared!
Sounds like you want plain ole standard commercial grade server hardware mounted in a tiny RV.
Extensively shock mount a relay rack, put in somewhat bigger AC/batteries/genset than usual, and you're good to go.
You can use the living quarters to house the armed guard, which will be required for expensive equipment in that corner of the world.
Trying to buy super tough server hardware will simply be more expensive than a RV and much harder to replace / maintain when it breaks.
Admittedly I'm mystified what you'd do with such immense computing power in a rural area without electricity. Maybe a really nice mythtv backend? Educate the locals using SimTractor?
You do realize that Bangladesh is like 1 foot above sea level, so no need to engineer this to last forever when its going to get washed into the sea every couple years by storms etc. Using a RV could help in the evac, assuming there is any place safe to evac to...
Alternately, split your workload transparently across maybe 50 smaller machines, and start purchasing replacements when attrition nears 75%.
"Science flies us to the moon. Religion flies us into buildings." - Victor Stenger
I know some guys who were running some wi-fi gear on a roof with a small linux server etc andto beat the elements (many days a year of driving horizontal rain and gale force windows) they submerged some low power components in a metal tool chest filled with mineral oil. Their set up had 4gb CF and USB keyfobs for storage. There was a 12VDC input power car-PC-style supply that handles variable input (goes as low as 6v) and they ran long wires down to a small 240v/12v transformer in the building. This meant that even if moisture got in, the components were very well protected as water would sit at the bottom of the oil, and there was utterly no dangerous voltage exposed to the outdoors. They later they went with a smaller o-ring sealed aluminum box filled with proper transformer oil, but the original hack was working fine after 1 year.
From my own experience with dunking rigs in oil, you only need to watch out for a few things, one being the mineral oil leaching plasticizers out of wire insulation - they eventually become brittle. You also need to seal your electrolytic caps with a little epoxy so the rubber seal doesn't get eaten alive. Interestingly most caps seem to survive a long time like this, but personally I'd recommend motherboards with solid aluminum caps.
However these things don't become a problem for months, so you'd likely get away with just dunking your rig and leaving it. You also cannot dunk a HDD, as the oil will get inside it and foul things up. I haven't tried it, but it would be possible to seal up in a box or 'pot' a mechanical HDD in epoxy, but best to stick with SSD / Compactflash.
After logging in slashdot still does not take you back to the page you were on. It's been that way for 20 years.
Buy a used 1U rack Dell server with redundant power supplies, Pentiums, ethernets and HDs on a RAID. Then replace the HDs with Flash SSD. Then put the whole thing in a plywood box with an air conditioner mounted on top, tubes blowing cold air in and three .00 grade nylon layers over the out vents, the upper layer removable. Seal all cracks, especially around cable slots, with silicone caulk. Run the whole thing as a unit, cleaning the air conditioner filters and out vent screens twice a day (so get two sets of those filters).
Keep spares of each redundant part. Buy two of those whole units (including air conditioners), because one unit will die anyway.
Run them on an ethernet switch, one powered down except once a day or so to sync their RAIDs.
Or rent a server at some global datacenter, and get WiFi/pringles antenna to an ISP somewhere.
--
make install -not war
What would you suggest? Lesser hardware? Surely there must be a solution somewhere in the middle of "I want this" and "I can use this".
Yep, there is. But it's not always where you think.
Shameless (but hopefully useful) self-promotion:
I've been living and working in Least Developed Countries in the tropics for nearly 6 years now, and for the last 2, I've been writing a weekly IT-related column called Communications. There's a ton of advice in there. Go take a look. Check my tag cloud for relevant topics.
Here are a few fundamentals:
-1- The first thing to do is to adjust both hardware and - and this is important- software to the circumstances. Focus on the task first, then avoid confusing how that task is completed in a North American office environment with 'the right way' to do things.
-2- Scale everything down, in order to make the cost of failure of any single element as small as possible. This way, you get a solution that's replicable, affordable and - most importantly- easily replaced when (not if) it breaks.
-3- If you have unreliable power, then do two things first: Make your system tolerant to current fluctuations[*], and then plan for an intermittently available service. Forget about trying to keep it running at all times. Just minimise the cost of interruptions. A surge suppressing electrical switch on the wall where your main power source enters the building will cost you less and save you more than anything else.
[*] Bad (i.e. poor quality) power is the source of about 80% of hardware failure where I live. Every time the local power company hits us with brown-outs and spikes, I'd get a surge (heh!) of customer service calls.
To me, this situation screams 'require redundancy'. I understand this was not given as an option originally, but with the environment described I would certainly not want to rely on one single server.
Yes, redundancy is good. Cheap, small, easily replaced devices are good. Snap-shotted VMs are also good. The bottom line is that you need to keep the cost of failure low, because the system is certain to fail due to environmental factors. A good motto for working in the Developing World is: If you can't beat 'em, at least don't lose too much.
The best way to do this is to try to run on hardware that's about 3-5 years behind the curve, or to go straight to the bleeding edge of low-power tech.
To the submitter: I have a personal interest in Bangladesh, by the way. You can reach me by leaving a comment on my website. Good luck!
P.S. Unless money and space are no object, you'll never run full-time computing services on solar power. Especially in monsoon season. IMO, best not to try.
Crumb's Corollary: Never bring a knife to a bun fight.
We have both interruptible and uninterruptible power supplies here. The difference is that IPS's take about a second to switch over to the batteries
I haven't done Bangladesh, but in Thailand if I had it to do over again I would go for four low-spec machines, and a sealed enclosure with compressed air cooling. It isn't the most energy efficient approach, but having a sealed (and slightly positively-pressurized) enclosure does wonders at keeping out moisture, dust, and ants.
The general idea is to have a couple small compressors (with check-valves) feed into a common reservoir that has adequate time to cool to ambient temperatures. Ideally, you would run at about 300 psi/20 bar, and have a pressure reducing valve inside the enclosure to drop the air to about 10 psi with a 1/16" orifice into the enclosure. (You might have to experiment on orifice and pressure.) Provide a pressure relief valve to keep the enclosure under 2 psig. (Another constrained orifice would work, but you will lose more air.)
Keep a spare machine in a pelican box with desiccant along with two or three spare hard drives. Keep a backup external USB hard drive in a separate pelican box with dessiccant and only open it up when you are doing a backup.
I'd also second comments about running everything in virtual machines and being willing to make compromises when one of them isn't working.
Back in my day, getting 12V power supplies wasn't nearly as easy as Google makes it sound. (You need to have a high enough float voltage to charge the batteries, and have a regulated output that will handle the end cell voltage of the batteries.) The logical alternative is to use 48VDC power supplies which are much more expensive. They are designed to operate within the float/ECV requirements of a VRLA. Don't forget your blocking diodes! Try to stay away from car batteries if you can and find some real deep-cycle batteries. Getting through monsoon season on battery isn't realistic without a huge battery plant. Our island's phone switch was pretty well equipped, but for two months a year the phones only worked when the sun was shining.
External connectivity was always my nemesis; when the phone switch was down, everything else crapped out. Satellite phones weren't viable from a cost perspective; the consumer satellite service was too unreliable to even be considered.