Slashdot Mirror
Required Practices for a Network Operations Center?
hayduke.com asks: "I've recently been assigned to a program that is designing a 'Network Operation Center (NOC)'. I started to look for books, online material and other sources to help define a baseline for the Services Level Agreement for our intended customers. Not having any customers yet we are trying to incorporate the design elements that will provide the best possible level of service to the largest number of customers. A search on my favorite search engine brings up a lot of articles that have companies boasting that they have been recognized for being 'Best Practice' leaders in their respective fields but there are no references as to what those practices are. As this will be a NOC (pro-active) as opposed to a Call Center (reactive), I would like to know what other people think that NOC should be at bare minimum or if there are 'standards' that all NOCs should be held to."
2) Lots and lots and lots of blinking lights.
3) Biometric-based access, such as finger, palm and retinal scanners.
4) Big, ugly dude guarding the front door.
5) Hire Linux weeniers from slashdot to run it all for you.
I started to look for books, online material and other sources to help define a baseline for the Services Level Agreement for our intended customers.
Host a box at Exodus or Level3 and have a read of the SLA they give you. Beter yet, just call them up and ask for a quote and a salesman to call, no need to spend any of your own money. It's probably copyrighted so you can't just use it for your own customers, but it'll give you an idea of where to start.
I strongly recommend you read this, definitive guide to establish your procedures and develop your SLAs.
Not a flame or anything, but seriously. Get someone who knows what the hell they are doing to do some consulting for you. There are lots of them on the market, and you can get them cheap. Hey, you plan to make money with this, right? Don't want to lose your ass? Then you need someone with experience. You woudn't start a business without consulting a lawyer and CPA would you? While you don't mention what experience YOU have, I'm assuming that you have SOME, but not much based on your questions.
If you are gonna provide an SLA, you want TECHNICAL advice and LEGAL advice. Most SLA's are actually toothless in real life. The lawyers give you enough outs that you will never have to pay up with most customers (a few have the talent to see through the crap and make changes to your contract to put teeth back in.) Even though lawyers are expensive, it pays for itself in the long run.
The advise on slashdot is going to be spotty at best, especially in the light that so many NOC's are run poorly. Without experience on hand, you will run into the SAME traps / problems that most NOC's with inexperienced leaders run into.
Well, here are a few things that you may need.
A TESTED disaster recovery plan for servers, network, power, and cooling.
A trouble ticket system customized for your needs usable by inside and out (internally generated tickets and customer generated tickets.)
A network monitoring / management system that tracks not only subsystem availability but performance and keeps a history.
A customer management system that can bring up EVERYTHING you need to know about a customer, their syetems, their people, notification proceedures, etc. (this is VERY non-trivial)
A change control system - what happened, who approved it, who did it, how long did it take, what did they do, how did they do it, when was it active, how do you revert, etc.
Sigh. Setting up a NOC correctly is one of the most difficult tasks in IT.
If you're in the Silicon Valley you'll want some industrial or retro funiture, but if your company is located anywhere else, you'll want the "me too" look that only Aeron chairs can provide.
I know we're just joking about these requirements, but they're scarily familar to three NOCs I've been involved with. I think there must be some unwritten ruleset that goes something along these lines:
1) 50% of NOC budget must be spent on funriture and flat-panel displays.
2) Trendy lighting in NOC must seriously interfere with trendy displays. (example: if room is equiped with halogen spot lighting, at least one non-movable light should be aimed at a projection screen).
3) NOC must be located in the most inconvenient area of the most inconvenient building.
4) Actual NOC computers must be running the latest, untested wiz-bang buggy software on the latest, untested wiz-band buggy hardware.
5) Half of the NOC staff must be completely unskilled, impersonal, and unwashed.
6) The other half othe NOC staff must be anal, uptight, and permanently pissed off.
Server Room layout is another story... but does match rule #2 quite well... the perfect server room is often located as far from the building's loading dock as possible. With a proper pallet jack, it should take at least 30 minutes to haul a crated SGI Origin or Sun Enterprise server from the loading dock to the server room. Smaller items should take no less than 15 minutes. Shaky ramps, cramped elevators, and narrow hallways are a plus.
The only book you need is the US Code, Title 11. Pay special attention to Chapter 13.