Slashdot Mirror
Ask Slashdot: Server Room Toolbox?
jandersen writes "I am the system manager in charge of a smallish server room (~50 servers, most in racks), and I am going to buy a set of tools; but first I want to hear what other people think would be a good idea. Certainly a range of good quality screwdrivers — slotted, Phillips, Pozidriv, Torx. But what else? Tape measure? Spirit level (for aligning the racks)? Any meters or cable testers? A wood lathe? I can probably get away with a budget of a few hundred GBP, but there ought to be some mileage in that."
Certain embedded NICs on laptops and notebooks have a cable diagnostic mode built into them, now... which with the addition of the fact that they are a full system, can perform more than hardware level diagnostics for networks.
All your good tools will be stolen, just buy the cheap stuff so noone wants to takem. Its better to have cheap tools then none at all. (Or you could nuy nice ones and lock them up and then pray you NEVER leave the tools box unlocked)
Don't forget a good hammer for when all else fails.
In fact, you should have it on you at all times when you're working, or at least within easy reach (because they're kinda heavy).
the game
The dust thrown out by the wood lathe is a good idea for ensuring a constant turnover of hardware in your server room, but I find that dust that is conductive works even better, so I'd recommend an angle grinder over a wood lathe.
Mechanical tools: screwdrivers, wrench kit, pliers, cutters (plier style), cutters (x-acto), hammer, metal file (to round an odd sharp corner), tape measure, heavy-duty duct tape, lots of plastic cable ties. I also needed a drill to install an odd rack shelf, so throw one with some drilling bits if your budget allows. I don't know what cables you use, but tools to fix cabling may come in handy (multimeter, soldering iron and solder, shrinkable tubes, special tool to terminate cables, etc.). If you have fiber optics, get a good push-action connector cleaner.
17779 eligible voters in a district, 17779 'vote' as one. This is Russia.
always prove useful. And some ammo.
Irrelevant. He's a server-room system manager, so that implies he's in wizard mode and not getting his score counted.
You can hold down the "B" button for continuous firing.
Or as we call it, a "beer storage array".
Help stamp out iliturcy.
Don't forget:
- a rubber hammer (for failing hard drives without visible traces)
- a cattle prod (for failing "visitors" without visible traces)
- a sledgehammer (for failing anything if you don't mind visible traces)
- thermite (to get rid of visible traces)
I gave up sigs almost a year ago.
Utility knife for opening boxes and stuff.
A cheapo multimeter. You're working with electronics, having one of these is a requirement even though many people in IT try to get by without them.
Perhaps a soldering iron and solder sucker. Hopefully you'll never need them but weird shit happens.
A set of precision screwdrivers is sometimes needed for taking stuff apart, and can be pushed into extra duty as pin extractors or whatever else.
A dedicated Ethernet tester can be pretty handy too. And get a crimper for these if you don't have one already.
Cause in a real emergency they ALWAYS work. And are fast.
Three Squirrels
A toner that works on live network cables
a cable qualifier
a fluke nettool or equivalent
A set of loopbacks
a set of console cables
a buttset
A cage nut tool
2 sets of screwdrivers, including torx, hex, etc.
telescoping magnet (part retriever)
Box cutter
work gloves
flashlights
ear plugs
a jacket
scissors
pliers
crimpers
a jackrapid if your patch panels are modular
a crashcart
power screwdriver
a cordless drill
a rack lift
velcro spools
a stockpile of cage nuts and (matching) bolts
The first few on that list will break the bank.
Most of the time, all I really need is a screwdriver with bitset, a leatherman wave with bitset, a cagenut tool, a flashlight, and a console cable.
Because sometimes you want to test the wires that are not connected to a server/workstation.
Get a good hand-held time domain reflectometer. I prefer Fluke but I'm sure that others are just as good.
This will not only tell you that the wires are correct, but if they are broken it will tell you how far away they are broken. VERY handy for hunting down problems.
It all depends on how big your server room is, how actively it changes equipment, and a number of other things.
For a few hundred (anything), you're not really looking at much of a tool set. There are some 'bare minimums', and 200-300 will be eaten up in very short order. Here's a list of what I consider to be bare essentials:
* A multi-set of philips, flathead, etc. screwdriver bits. Make that two sets, they're cheap. Pick up an extra multipack of #2 and #3 Philips driver bits for another couple bucks. Forget independent screwdrivers, that's just wasteful, and you'll never find the one you want because it's awkward to keep them all together and sort through them. In all likelihood, you'll need #3 and #2 philips only, as more and more systems come toolless; this would be for rack equipment.
* A manual torque driver is a must (batteries can fail) - don't be that guy who over-tightens everything and it's impossible to get crap out of a rack without shearing screw heads and stripping bits. You can pick up some pretty decent ones for $10-15. I like the ones with the recessed rear caps which have a cylinder full of different bits.
* A good multitool. MUST MUST MUST. SOG are awesome, I love my PowerAssist. I have done emergency recabling jobs with nothing more than a Spartan Swiss Army Knife. Currently, I'm liking my Gerber Balance (and I keep extra bits in my pocket, just in case). This is your tool; it goes in your pocket, and it's your last line of defense against not being able to fix something because someone ran off with the tool you need.
* A good flashlight. I'm not talking about a $120 surefire, a cheap $10 Trustfire from DX or the like will do just fine. It just can't be crap. (Personally, this is something I always keep on my person anyway.)
* cable tie offs, velcro, cat6 jack heads, spare power and ethernet cables,, etc. - you'll want a supply, because you will probably need them.
* RJ punch down tool (to crimp onto your cat6) - the alternative is to buy all pre-cut lengths, and this makes a mess in short order while wasting a fair amount of money.
* A network continuity testing tool, preferably one that'll allow you to test things thoroughly and not just give you a 'good' light.
* A hardware ethernet tap. You can get a good one for $15 or so.
* compact cordless Makita torque/impact driver, preverably the one with the pivoting head. I have spent a lot of time rebuilding etc. racks, and you never know when you'll need
A very nice to have: compact cordless Makita torque/impact driver, preverably the one with the pivoting head. I have spent a lot of time rebuilding etc. racks, and you never know when you'll need it. IMO a 'must have' but only because I've redone entirely too many racks manually.
This list can balloon quickly, depending on how reliant you are on vendors, and how
~/ssh slashdot.org ssh: connect to host slashdot.org port 22: too many beers
Definitely get a sonic screwdriver. Most shops don't carry them, and the ones that do are always out of stock whenever I ask for one, but I've seen them used before and they can do anything.
Seriously. Hang a thermometer a foot or two (okay, 30 or 60 centimeters) from the center of the ceiling. Keep an eye on the little guy. Compare it to the thermostat's reading. The "real air" temperature in the room can often be much different than the temperature on the where the thermostat is attached, _especially_ if it's an exterior wall that's being pummeled by sunshine or winds.
I've seen places where the temperature fluctuated so wildly as day and night cycled that it screwed with the equipment, Every time you have a failure document what kind, the thermostat temp and the thermometer temp. If you spot a pattern you might consider calling in the HVAC guys for a recommendation.
Trying not to duplicate stuff above..
- A cordless drill kept charged in the server room can definitely speed up SHTF moments. Keep a good set of miscellaneous screwdriver bits and drill bits with it.
- Vice grips. It never fails that you find a screw, bolt or nut that are too stripped. Get a regular pair and a needle-nose pair. I even have a miniature one that is great for tight spaces.
- For when the above fail, an E-Z-Out bit set or reverse drill set for when you finish breaking the head off the screw/bolt.
- If you deal with serial at all (yes, it still exists in many modern datacenters), you may want to get a BlackBox sniffer setup, a good BOB (break out box), etc.
- You want at minimum a basic RJ-45 UTP tester, preferably a large multi-type cable tester. A big expensive unit like a Fluke Netmeter may be great to have, but it will take a long time to pay off when there are other ways to troubleshoot issues like that.
- If you ever work with 66 or 110 blocks with any regularity, get yourself a good spring-loaded punch, usually a Paladin. If you don't get one with a pick, get a basic set of picks as well to keep with it.
- Small prybars. The first time you go to change batteries in a UPS and find out the old ones have swollen badly you'll be glad you had them. A pair of very large flat head screwdrivers can substitute, but be prepared to break them.
Not counting ridiculously expensive stuff like Fluke Netmeters, Sunset xDSL kit, and other specialized gear, my basic sysadmin-oriented toolbag is probably around $1500 USD. Unfortunately in my current environment we have no tools around so I have to bring in all my personal gear for it. Very annoying.
Sounds like you have no cue
I am unsure why you would recommend a cue as being a good tool for someone to possess when running a server room. Is it for asking users "have you ever been poked?" and then giving them a good jab? Or perhaps for turning on the lights or kettle when you cannot be bothered to get up from your desk?
label everything
Karma: It's not just a good idea. It's the law.
Something to use as a serial terminal is still useful at times. I use a real one, an odd IBM thing where the screen and electronics is a frail and fragile thing that flexes alarmingly when you plug in a cable but the keyboard is an early model M than could be almost be used to bang in nails (seems more solid that the PS/2 versions).
Old laptops with a real serial port also work very well, netbooks with USB to serial are a less reliable second but more portable. A serial to TCP/IP converter moves things into a state where just about any networked PC, tablet or phone can be your serial terminal.
This is the dumbest question posted here (in a long time).
You may well be right. However, the stupidest question is always the one that isn't asked.
Because right now you sound like a complete ignorant who don't even know what a server is.
And you sound like somebody who feels the urge to put somebody down because it makes you feel a bit less bad about yourself. Alas, it didn't work - I don't really give a toss about what you say; if you believed in yourself, then you wouldn't be afraid of asking, even if it makes you look less than divine.
And if you look around at the answers I've got, you will see that a number of people have given some very good advice. Some of it I already know, but there are some good, new ideas that I hadn't thought of.
You lose a man point for even asking that.
Man points? Who cares about man points? A real man is not afraid of looking stupid, if he needs to learn. The only stupid question is the one you don't dare to ask.
I'll just go with what's in my Stanley blue steel cantilever toolbox (the plastic ones are absolute shite and don't like being stood on):
Stanley 99E retractable boxcutter w/5 spare blades
1 snipe nose plier/multitool
1 8" adjustable wrench
2 6" mole grips
2 sets Worx drill/driver bits (comes in a little box. 10 different HSS drill heads, 20 driver heads including Torx, Pozi, Philips, slotted and square and 1 1/4" socket adapter, and 1 extender)
1 set (usually comes in 20's) 1/4" Whitworth bi-Hex sockets in metric and imperial and 2 Neiko 1/4" ratcheting arms: one 6" and 1 10".
2 1/4" Gator Grips: 1 1" and 1 1/2" for those stripped heads
1 14oz claw hammer
1 Bondhus combination balldriver L-wrench set
1 bag case thumbscrews
1 bag chassis screws
1 set (32 pc) precision screwdrivers (better if you can get hold of the case hardened ones, they don't chew up if you hit a particularly hard screw)
1 Challenge 18V cordless drill/driver w/spare battery
1 butane blowtorch
1 can lithium grease
1 Cree LED anglepoise (yeah the arm is custom)
1 13-amp plug with earth pin connected to a wrist strap and two alligator clips
1 QTech PCI diagnostic card - and that just blew the budget on its own
1 QTech diagnostic CD/DVD/FD set
1 copy Knoppix LiveCD
1 CF-IDE module with Knoppix installed on a 16GB card, and several spare cards for recovery
1 bus powered USB DVD burner
1 80GB USB hard drive (custom cased low-drain job... Hitachi if I remember right)
Operation Guillotine is in effect.
You listed a lathe on a budget of a few hundred GBP?
That one was a joke - it's something we are prone to in UK, sorry.
I thought of suggesting a scythe, but that sounded kind of rural, so ..., well you know how it is.
Ah, you get turned on by the sight of the raw computing power? Me too.
PS: What is a fleshlight? Is it just 'flashlight' as pronounced by 'Her Mejesty'?
Sorry for not answering to everybody individually, but there has already been loads of good ideas. Some of them I already have or thought of, but there are many that I hadn't thought of.
And I note that my budget of a few hundred GBP seems too low - I should have guessed, since /. is predominantly American. I work for an American company here in UK, and while we try to get by on a meagre budget, our colleagues in the States aren't as shy about the zeroes at the end of the numbers. Maybe we just need to upgrade our case hose :-)
Cannot recommend this highly enough. Label both ends of every cable and the back of every power plug -- then you'll know what to expect when you pull it out.
Second only to this - two ring bound folders and a hole punch. Seriously.
Then you document cable layouts, server details (serial numbers, IP/MAC addresses, configuration details, software licences....) in your favourite tool and take a print out. File the printouts - one in the server room and one elsewhere. It may seem old tech but it will save your skin when you lose connectivity/database/application... -- by all means keep a copy on your own PC/Tablet and or a DVD backup but do keep paper copies -- spoken from experience
Of course this requires discipline to track changes and keep the records up to date but it will save you much more time in the long run than the occasional trip to the shops to buy a specific screwdriver bit.
Finally, I agree with a lockable cabinet -- tools can evaporate faster than a puddle on a hot summers day ;-)
Something I have not seen mentioned is a telescopic inspection mirror for viewing in tight spaces. Can come in very useful for seeing obstructed things. Helps if you can read text backwards.
We've got a toolbox worth a good bit more than $1000 sitting in our east coast data center (800 miles away) because if and when there's a problem and someone has to show up on site, it's always at an inconvenient hour like 3AM when no stores are open.
Local maps with the locations of Graybar, ADI, etc., marked (dates the toolbox to "before smartphones" eh)
A mini notebook
Sharpie fine points in several colors
Screwdrivers, nutdrivers - actual tools not bits, useful in many cases
Mini MagLite and headlamp holder
Utility knife (do not use for box cutting!)
Xacto (do not use for box cutting!)
6" Bit extension
8" flexible bit extension
Screwdriver bits of all sorts
Pin extractors for connectors that can't be easily extracted without
Scissors
Metal nibbler tool
Surgeon's Clamp
Neon voltage tester
Wire strippers
Terminal crimping tool
EZRJ45 Crimping tool
Set of 3 pliers (multi sizes)
Lock-jaw pliers
9" #2 Phillips bits- Made by Senco for a rapid drywall screw installer, these combine with a power screwdriver as THE single most used tool we have.
22" #2 Phillips bit - unobtanium but very useful for screwing stuff into rack rails you can barely get to
Large needle nose pliers
Curved long nose pliers
Other similar "larger" pliers
4" and 6" adjustable wrench
Milwaukee Power Screwdriver #6546-1 and spare battery - completely mandatory tool to prevent wrist fatigue, can tighten screws with the greatest of finesse due to the variable clutch
Victorinox Swiss Cybertool
Dental tools (picks, scrapers, mirror)
AC outlet wiring tester
Telephone line tester
Tone generator and probe
PDI CT340 Computer Cable Tester
Wire wrap tool and wire
Pencils and a cheap sharpener
Anti-static wrist strap
OK Logic Probe #PRB-50
Tool magnetizer - because the tips of all your screwdrivers should be very lightly magnetized, just enough to be able to touch a screw and lift it out of that awful corner
Digital multimeter
Soldering iron & solder
Electrical tape
Heat shrink tubing in multiple sizes
66/110 Punch Tool
US/Metric Hex Key Sets
1/4" socket drive set and hex bit adaptor for them
Tap and drill sets for common rack, computer sizes (6/32, 10/32, 10/24, etc)
20' Tape measure
Small Hammer
Rubber mallet ("compliance tool")
BIG flat, Phillips screwdrivers ("small pry bars")
Box cutter - utility knife with large handle
Torpedo level
Small drill
First aid kit
Dual D-cell Maglite
Test leads (alligator and hooks)
A decent clamp-on ammeter
A good labelmaker (harder to find than you might think)
Cans of air, WD40, adhesive remover, alcohol wipes, contact cleaner
2" Velcro One-Wrap in the cut-it-yerself roll. There are other options specifically made for tight wiring environments but this stuff is just overall a super-handy consumable.
External DVD-RW drive and a pack of blanks
External floppy disk drive and some disks (yes really, never know what stupid stuff a BIOS update for an odd system requires)
USB thumb drives
"All of life’s problems can be solved with two things—duct tape and WD40. If it moves and it shouldn’t, you need duct tape. And if it doesn’t move and it should, you need WD40."
No, I'm rather serious!
When you have a board that is flaky, that works "most of the time" and fails intermittently, 10 seconds in a microwave is a wonderful way to make sure that the part fails as expected without causing any of the visible damage that might get your RMA rejected.
Few things suck worse than sending in an RMA and getting the same item back. (I've verified that this was happening by putting a few very discreet marks on the edges of the card with a permanent marker)
No, it doesn't have nearly the satisfaction of a hammer, but you can still cackle inwardly while you count to 10...
I have no problem with your religion until you decide it's reason to deprive others of the truth.
In my work, I primarily use
A sturdy cart with an LCD monitor, keyboard, and mouse.
A label maker
An electric rechargeable screwdriver and assortment of bits
A rechargeable flashlight
A magnetic pickup tool and/or a claw tool for dropped kit.
A well-made phillips #2 and #3 manual screwdriver, for loosening screws that are too tight for the electric screwdriver.
A large pair of channel lock pliers for loosening screws that have been rounded out.
Needle nose pliers for removing stubborn cage nuts.
A box cutter for opening boxes.
Hearing protection.
Wire cutters
A 6 foot ladder.
An inexpensive hand-cart for moving boxes.
My preferences for manufacturers are Klein screwdrivers, Channel-Lock pliers and wire cutters, and Dymo labelers. I don't use the specialty made-for-cables labelers, as I can't justify the extra cost. For the crash cart, I like the composite plastic one made by rubbermaid.
The Crash Cart:
Get a power strip with a long power cord and mounting holes.
Permanently mount the power strip to the cart.
Secure the LCD Monitor stand to the cart to prevent tipping.
Get long MtF extension cables for the LCD, Keyboard and mouse. Bundle them together in an umbilical and secure one end to the cart. Remove the screws from the server end of the umbilical. You want this cable to fall off if someone knocks the cart away from the servers.
I used a stack of 4 Plastic Drawer Bins screwed to the cart bottom shelf to hold tools, USB sticks, labeler cartridges, spare cage nuts, a small stock of patch cables, and a CD case that held _copies_ of commonly used install medias.
If you manage a number of servers without CD/DVD drives, permanently mount a USB DVD drive to the cart.
Permanently mount the screwdriver and flashlight chargers to the cart.
Find a comfortable stool or rolling chair at an appropriate height for the crash cart.
Other notes:
I occasionally use a tone and probe to trace wires. I would not buy one if I didn't already have it.
I used a multimeter to check the wiring when we moved in and when we upgraded UPS. Haven't needed it since.
An Ammeter (the clip on kind) will help you if you don't want to track your power budget properly^W in a spreadsheet.
I used wrenches and a socket set to assemble our racks. Haven't needed them since.
I used an impact drill to drill holes for concrete anchors to bolt down the 2 post racks. Haven't needed it since. The concrete floor was not level, and I used washers to shim the racks level.
For full racks, level them with the adjustable feet before tightening everything up.
If your racks lock, put a spare key outside the DC. You will forget/lose the primary key at an inopportune time.
I painted the plywood where the other telecom kit mounts. It looks neater.
You may be tempted to make your own Ethernet cables. Don't. The TCO is significantly higher vs. maintaining a stock of patch cables.
Don't use zip-ties for cable management. Get a big roll of the velcro wire ties instead.
Put a trash can, broom, and dustpan in the DC.
Put a "no food or drink" sign in the DC.
Put a rat poison bait station in the DC.
Drywall dust is very very bad for servers and UPS. Don't remodel without protecting your boxes.
If you don't have any monitoring infrastructure, setup a PC to monitor and record temperatures. Have it monitor a mains powered device so you'll get a page if the power goes out.
A phone in the DC is nice _if_ you can be heard over the fans and HVAC.
Tape off a parking place for the crash cart near an outlet so you don't forget to plug it in/charge the light and driver.
If you have a raised floor, get a tile lifter. If you don't have budget, get a suction-cup-dent-puller from an auto parts store. Also, please don't leave the floor open and unattended.
A quality cable tester exceeds your budget severalfold. If you suspect a bad cable, test by substitution. If the cable is confirmed bad, cut the ends off before you throw it away. Otherwise, someone (probably you) will grab it and use it again.
Many years ago (when dinosaurs roamed the earth) I was installing a cd rom drive in a computer that didn't have one. This is back when cd roms drives were a new thing and cost a pretty good chunk of change (and so did the computer).
The computer had a drive bay to install this into, but there was a piece of metal that was spot welded over the bay. Lovely.
Since I couldn't pry it off with a screwdriver, I ended up having to use a cold chisel and a hammer to beat that metal cover plate off of the frame. Which did the job but as I was doing it I remember thinking, "Boy, I hope nobody walks in on this little scenario."
If you're a zombie and you know it, bite your friend!
The Cybertool series from Victorinox has been a great addition to my kit for years. Sometimes it does better than dedicated tools. Model 29 is small an light enough to have in your pocket for daily use. Much lighter than the Leatherman, it is more tuned for tech use than outdoors.
http://www.amazon.com/Victorinox-Swiss-Cybertool-Pocket-Knife/dp/B00005ML8H/ref=sr_1_1?ie=UTF8&qid=1354234788&sr=8-1&keywords=cybertool+29