Feds Discover 1,000 More Government Data Centers
1sockchuck writes "The US government has 2,094 data centers, nearly 1,000 more than previous estimates, according to an updated inventory by federal agencies. The finding underscores the scope of the challenge facing the Obama administration as it seeks to streamline the government's IT infrastructure in a massive data center consolidation."
Any Presidential administration that comes into the federal government promising to combat bureaucracy and duplication is either lying (most likely) or is truly epically deluded. No agency in the federal government is going to let some johnny-come-lately President who's going to be gone in 4-8 years come in and fundamentally change the way they've worked for 60 years or more. Oh sure, they'll TELL him they'll do it. They kiss the ass of their new director (aka his political toadie appointee, also to be gone in 4-8 years). But the most they'll *actually* do is stall, make token gestures, lie, and basically find other ways to run out the clock until the next administration comes in (with a whole new set bullshit streamlining promises). There are long-term professionals in these agencies who've been playing out that scenario since the Carter administration (maybe even some old Nixon/Ford guys).
Bill Clinton said it best (and I'm paraphrasing here) "The most shocking thing I discovered about the Presidency is that people don't do what you say."
SJW: Someone who has run out of real oppression, and has to fake it.
Why do I get the image of an Indiana Jones style character pulling back overgrown bushes and thorns to reveal the long Lost Temple of Data Storage...
Possibly being chased by some legacy system throwing strange errors at him while he trying to escape a rolling ball of ethernet cables
There is no -1 disagree
Eh, if you've worked in a multi-billion dollar F100 company this isn't surprising at all. Any random department can buy a couple of servers and set up their own "data center", and when you have 100,000 employees, it's hard to keep track of. Now imagine you are a multi-trillion dollar company, which is basically what the federal government is, with three million employees. Things get complicated.
Just because I can hook a shark from a boat, I do no offer to wrestle it in the water.
If only they had some sort of facility that could house devices that could hold lists of things they could do a better job of keeping track of these types of places. Alas, some day I won't just be a dreamer ...
"Oh, HERE they are! silly buggers, I though you ran away!"
seriously though, stuff like this DOES happen. the UK Government just shut down what, hundreds of websites that they didn't even know they had been paying for?
sprawl != organised.
Whats a datacenter?
As a fedgov employee (US Army) in the early 90s I had two big green unisys btos machines each with three terminals running a database Admittedly no outside world connection except 110V AC but the terminal things did have at least a hundred feet of cable. For the purposes of this report, would by old office be defined as a "datacenter"?
"Science flies us to the moon. Religion flies us into buildings." - Victor Stenger
...literally _lost_. The servers respond to ping, work completely. I just can't figure out where in the country it is.
"Always forgive your enemies; nothing annoys them so much." - Oscar Wilde
Why don't we provide a small number of locations, the destruction of any of which would significantly cripple our government. I can't imagine who would find such a consolidation helpful to their goals.
"Who is the Journal of Quantum Physics going to believe?" --Stephen Hawking
i did a 1 year contracting stint at a US Army Corps of Engineers office 10 years ago. the DC was less than 10 servers in a closet for 140 people. the local offices had more people and more servers. in a few cases the local IT people refused to go with the mandated domain plan and kept separate domains. word was that the managers couldn't make them do it either. this was back in the NT4 days. with Windows 2003 and 2008 it's a lot easier to consolidate the domains and data centers but in the end they will have to force the local IT people to give up passwords so they can consolidate things. think the idiot from SF type problems
I don't understand how you can "find" data centers? Can someone explain that to me.
hm. I've lost a machine.. literally _lost_. it responds to ping, it works completely, I just can't figure out where in my apartment it is.
http://bash.org/?5273
Federal government salary and compensation levels have systematically crept up over the last 20 years to to point that they are now 30% to 100% of comparable public sector jobs. How about freezing salaries for 10 years or so until inflation brings them more inline. It is crazy that Federal employees got a 1% raise this year in an environment of near zero inflation and high unemployment.
In a normal business, you serve a client.
In government, the client is yourself, and you must "justify" that position with lots of public activity.
That activity does not need to be effective, it only needs to look effective. By definition, there's less risk in ineffective activity.
This is why government is often ineffective, and why both left and right wing parties want to streamline it.
Futurist Traditionalism
From the way the headline reads, you'd think they went on some sort of archeological exploration or something.
Supplies!
but if it appears on our network without previous authorization all hell breaks loose. Whether from internal or external auditors to just the network people freaking out. SOX reporting pretty much insures anything for us that can store information, even in transition, is documented, accounted for, and has its approvals all in order.
No, government is in a league of its own, there number of redundant programs and such is probably worthy of three to five years worth of investigation. They don't answer to anyone because no one bothers. A bunch of little kingdoms with no accountability because their budget entry is buried
* Winners compare their achievements to their goals, losers compare theirs to that of others.
My impression is that in most cases, consolidation can reduce apparent IT costs, but produces a not just centralized computers but a centralized bureaucracy.
And when you have a centralized bureaucracy, the individual agencies will be subject to data centers that act on their "requests" more slowly if at all. (Note that when you lose control over your data center, what used to be an order now becomes a request.)
In general, it seems like centralizing things can help with some issues, but creates a boatload of other issues.
...underneath the Carribbean Sea built amongst the lost City of Atlantis.
;-)
Seriously, how could the US Government NOT know about or keep track of their own infrastructure and resources???
He who knows best knows how little he knows. - Thomas Jefferson
This is what would happen if my "boss" was in charge of this initiative.
(Superceding other hits as: "Let's just use one database", "Let's just make that field bigger", and "just guess")
Congratulations, you found the backup datacenters.
They should've asked the Chinese straight away. They would have known.
Sure makes it hard for terrorists to target key data centers if the government doesn't even know how many they have or where they are.
Obama is just playing right into the hands of the terrorists...
Moreover, it's a lot easier to exploit your cash flow for personal gain when accountability doesn't get in the way. Every year the US government fails to properly account for billions of dollars in cash flow. Gee, I wonder where that money ended up -- it certainly wasn't used to fix the roads I'm driving on.
According to the article, linked memo, and linked data center tier definition, the meanest little closet holding a box with blinking lights is a "data center". The survey referenced does limit them to over 500 square feet but even that number can be kinda meaningless.
At this moment, I'm sitting on the other side of the wall from a "data center" for a major TLA. It was once a monstrosity with dozens of Pyramids the size of refrigerators, racks of Windows-based servers for files and email, and a few dozen Unix servers that I administered.
Through consolidation and virtualization to larger data centers, it's lost nearly everything. Two file servers sit in a rack in the middle of a gigantic room with a raised floor, cooling, and excellent redundant power. There's also one tower-format file server. Technically, it's a data center. In real life, it's three servers sitting in the middle of thousands of empty square feet. At least it was until a couple of weeks ago; we've chained off the area into separate rooms for other uses and other departments, so the server rack now sits in about 500 square feet.
When the hardware in the rack fails, it won't be replaced; it'll be virtualized elsewhere. At that point, the one server that must remain can be put into a glorified closet with a good lock on the door and we'll no longer have a "data center". All this is a result of consolidation efforts that have been going on for years at my agency.
I wonder how many of the data centers in the fine article are equally as far from what most people think of when you say "data center"?
Anywhere you have IT governance that delivers more policies than solutions, rogue IT fills the gap.
In the case of the Federal government, I can imagine this getting out of hand. I wonder how many virtual machines are sitting there in the Amazon cloud quietly doing the government's business?
Let one datacenter rule them all?
Yes, OMB changed what they consider a "datacenter" - previous Datacall regarded anywhere that had 5 servers, a switch, and a router as a datacenter. Now they've lowered the bar to (3 Servers) -or- (1 server + 1 switch) -or- (1 switch + 1 router) -or- (1 server + 1 router). Frankly, I'm surprised the number only roughly doubled, I would've thought there were a LOT more sites with a server, switch, router setup...
Massive Data Center Consolidation = VITA = awful mess
Remember that their definition of "data center" is more than a little self-serving, it can include any re-purposed office closet or "server room" in any of the tens of thousands of government offices in the thousands of government buildings.
The requirement for "data center" is 500 sq. feet. So all they need to do is cut them into smaller blocks (eg, shipping containers, or just moving the walls), and suddenly, although it's now more "data centers" each one won't qualify, and so will reduce the count.
Or, we change the usage of the rooms -- that stack of cases of paper in the corner? That room's no longer 'devoted to data processing', and therefore, not a 'data center'. We already store spare parts in our 'not a data center' (also, my boss's office, but when we move, he won't be co-located, so I don't know if it'll be added to the count), but someone might argue those parts are indirectly for 'data processing'.
And poof ... data centers magically disapear, for loss money than it'd cost to consolidate, without all of the headaches. (okay, the walls could create dust, which the machines might not like ... the cases of paper is potentially a less risky option).
Build it, and they will come^Hplain.
I'd be more impressed if they found the two back-up Federal Governments, and the President-Alternate.
Before everyone gets all spun up on government waste, inefficiency, etc - I'd like to point out that numbers like these are never accurate. (For the record, I work for the feds, in the IT field).
The problem with "The feds have X datacenters" as a metric is that various audits occur at different times and by different auditors. These auditors almost always have differing definitions for what a datacenter actually is.
In one audit, a group can come through and define "Datacenter" as a big room where servers are co-located and services run on behalf of others. They'll find 2 at my center. Then a year later, a different group comes in and defines "Datacenter" as anywhere that more than 5 computers are running and left on all night. They'll find 200 at my center. Yes, this actually happened! The auditors came through dozens of science labs, found project servers sitting in the labs, and labeled each lab a datacenter.
Now here is the trick to why the statistics are complete mush. A normal IT guy would walk through the lab and say "Hey, that server should be in a datacenter!" -- but the auditors make the reverse conclusion. "Hey, this lab is a datacenter".
Yes, there is waste in the federal sphere and we absolutely need to take action to be more efficient at all levels. However, this article is basically pushing a number that came from someones' imagination, and pretending it's meaningful.
Apparently, I can't spell "MOD". Or maybe I've been doing so many drive mappings this morning that I've just got "map" on the mind.
Sheesh...
Did they happen to find a data center that was mistakenly sealed inside a wall?
There's a real problem with this analysis, esp. when you start defining what I'd call server rooms, things at 500'sq, as datacenters. We've got two large rooms, one probably bordering on that 500 ft, and no, you *cannot* "consolidate" that into a large one, for a number of reasons... like purpose and usage. If you're doing ordinary services, yeah (assuming you can trust them to keep them working, as opposed to the Department-wide login that just went down two days in a row - test boxes? h/a failover fallback? Huh?), but for special purposes - high performance computing, doing research, or some things I'm sure the military uses - there's no way to consolidate. You'd get long lines waiting for time on the systems, when the users are doing something so intensive that on small clusters they take *days* to run.
You just can't lump it all with dumb, large boxes.
mark
ObDisclaimer: I work for a federal contractor, on site.
Trust me on this.
deleting the extra space after periods so i can stay relevant, yeah.
If only there was an already existing model for dealing with large amounts of different kinds of data, some of it sensitive, spread across a geographically diverse area. Alas, there are no existing examples of how to do this, so we might as well give up. -sigh-
but have you considered the following argument: shut up.
The government doesn't even care about their data centers enough to count them. I bet you they missed 10 and those sys admins are building a bomb out of paperclips and data exception printouts right now. Seems to me like the number of data centers in potentially threatening countries might be a better number to guess at, but I guess when you're an ex-ACORN employee weighing in at 340 you're not exactly going to Iran any time soon, so this is all they could find for you to do. Thanks MGMT
With of course many overlapping positions being consolidated too. Aren't they trying to create jobs? Just saying....
It's like having one power plant that serves all the federal agencies across the US. What happens when it goes down? Oh sure, fail-over to a remote site that is slower. Still too vulnerable to attacks (physical or cyber) and the whole country suffers when there's a problem.
You know, with all this talk and desire of centralization and begging of the federal government to do everything for us, why do we even have states?
How can you possibly have to estimate how many data centers you have. I'll bet google knows how many they have.
No sigs in BETA. Beta SUCKS.
Perhaps you have had better luck with bosses then me.
Generally speaking and in my experience there is great rejoicing when management is fired.
The higher the rank of manager fired the more rejoicing there is.
This is less true in small business.
I expect government follows the big business model of PHB's galore.
John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
Under that stack of unsolicited credit card offers, coupons, and bills that arrived yesterday? Last time I saw your data center, it was right there next to your car keys. No, I didn't move it.
So fire them. Hire someone that will do as you say.
Not always possible. Lots of federal employees are unionized. Lots more of them don't actually report to the president, even indirectly. Even those that do are much harder to hire/fire than you suppose and most really important jobs actually require Congressional approval. We limit the President's power for very good reasons and while this has some undesirable side effects, I'm not about to vote to give anyone unlimited power over staffing in the federal government.
CEO's do it in the real world every single day.
The president isn't a CEO and the two jobs bear little resemblance to one another. Seriously, the two jobs are nothing alike.
And if there are laws in your way, get those changed first.
Only Congress can change laws. The president can influence, suggest, cajole and threaten but it's up to Congress to actually change the laws.
Failing that, line-item-veto any spending for their salaries and wait for them to quit.
The President of the US does not have a line item veto. President Clinton briefly held that power but it was declared unconstitutional in 1998 for violating the Presentment Clause.
Failing even that, use your executive ability to set their schedules to nil, or require them to report to Alaska, etc.
Again, lots of people don't report to the president and his ability to hire/fire is far more limited than you seem to suppose. Even if he fires someone, many jobs require approval from Congress to fill and that is not something any president wants to try to get more than necessary. Sometimes the president does direct those who report to him to de-fund programs and use his executive authority to circumvent the law and the federal bureaucracy but the president is just one man and has some (thank $diety) severe limits on his power and is badly outnumbered.
It really isn't that hard.
Bullshit. If it was easy it would have already been done. People in power will use any powers they have. If it were so easy to fire people and otherwise shape the federal bureaucracy it would be done.
People made this same argument towards Ron Paul's campaign promises, and they failed to see the same simplicity of it.
No they didn't. The world is a more complex place than Ron Paul makes it out to be and most people dismissed his rhetoric as populist nonsense. Perhaps he appeals to you but most people think of him as a fringe weirdo, myself included.
Id imagine this datacenter would be the aim of pretty much 100% of all the hackers in the world and as soon as it gets lol wtfpwnt wftpwnt lol we're all fucked.
Has anyone looked at the definitions of Data Center Tiers? http://www.dntp.com/news/pdfs/Data%20Center%20Tier_Classification.pdf You could put your desktop computer in a 2 car garage w/ an Internet connection and it would qualify as a 500 sq/ft Tier 1. Jim G
This Orwellian government that is taking every opportunity it can to pry into our private lives, increase its control over us, destroy liberty, and ruin our free republic is so out of control. When are people going to wake up and kick the Orwellians out? Let's get back to the Constitutionally-mandated government -- which is what govt. officials are sworn to uphold, but which most ignore, making them liars and traitors. 9/11, which is what spurred their "mandate" to increase Big Brother snooping, was an inside job, designed to do just what they have been doing -- destroying liberty from the inside, having been given their "excuse" to do so. What thinking person can really believe that those three World Trade Center towers could have come down at near free-fall speed (actual free-fall speed in the case of Building 7 that wasn't hit by a plane) without the help of pre-placed demolition charges. It was a conspiracy, and if you keep buying into that lie (that it was just an act by foreign terrorists), you're helping them keep their control over you and us. Big Brother is the terrorist. The ones calling for the war on terror are the terrorists. Get them out. And the government insiders are just puppets for the real criminals calling the shots here, which include the huge banks.
Tomorrow's news yesterday -- the bleeding, visionary edge.