US Government Begins Largest IT Consolidation in History
miller60 writes "Saying 1,100 data centers is too many, the federal government has begun what looms as the largest IT consolidation in history. Federal CIO Vivek Kundra has directed federal agencies to inventory their assets by April 30 and prepare a plan to reduce the number of servers and data centers, with a focus on slashing energy costs (full memo). Kundra says some applications may be shifted to cloud computing platforms customized for government use."
I predict a rash of job openings that you can get hired for provided you can spell "Cloud Computing"
[signature]
Dinner is served! Please approach the money trough in an orderly line...
See, the last time we upgraded we put everything on eleven hundred windows 95 machines with 1 gig hard drives. That did pretty good for a spell, all things considered. Now we're thinking about one of them pointy computers... whaddya call em? Blade servers? Yeah, we hear good things about those.
This being a government IT project, I predict it will take 5 years longer than planned, cost 10x the initial budget, and still never really work quite right.
We don't have data centers! We have "Computer Rooms"!
Finally, IT is on its way to being considered a commodity, as it should. There's no reason for every organization to maintain their own IT infrastructure any more than there's reason for every organization to maintain their own electricity generation and distribution. Of course, the hordes of IT people won't be happy, as the number of It jobs will continue to fall precipitously, but such is life. Because everybody has access to relatively significant computing power, society as a whole gets to reap the rewards, as opposed to 20 years ago, when only the largest organizations had the money and the manpower to maintain an IT network of any kind.
I don't respond to AC's.
If Virginia's IT overhaul is any indication, this is going to be a slow-motion cluster of a mess for the next 10-20 years
Every business I've ever worked for has had that one dusty 8086 off in a corner. It would run a single batch file every few hours. No one would touch it, because no one knew what it did-- just that whatever it did do was mission critical.
Thus, the US government should just consolidate everything down to a single batch program run by a 8086. I'm sure there's a spare closet in the White House or something they can use as a server room.
UTF-8: There and Back Again
The memo isn't clear if this project is only for what i'd call "paper shuffling" agencies, or if Department of Energy, NASA, DOD, etc, are going to be required to participate as well. I doubt they would be, but they're also the ones who require the most computing resources, I would think. Of course, it seems they put the CIO of DHS in charge of this (for what reason, I don't know, but probably a nefarious one), so who knows what sort of ridiculousness is going to come of it.
In for some way overpriced consulting gigs. :)
"A classified review of the United States Secret Service's computer technology found that the agency's computers were fully operational only 60 percent of the time because of outdated systems and a reliance on a computer mainframe that dates to the 1980s, according to Sen. Joe Lieberman, I-Conn. "
(loc. cit.)
CC.
TaijiQuan (Huang, 5 loosenings)
Oh, Vivek, what brilliant thing will you think of next? How much energy will it take to replace all of these server farms? How much energy will be required for the taxpayers to earn the money necessary to pay for it? What about security concerns of consolidating all of this data?
I think Vivek wants to make himself look useful after being exposed as a fraud by John C. Dvorak. http://www.dvorak.org/blog/2009/08/12/special-report-is-us-chief-information-officer-cio-vivek-kundra-a-phony/
Well, this strikes me as a good way to create one large highly vulnerable target. I understand conserving energy and creating a single uniform and tight security standard, but putting all your eggs in one basket is like putting up a neon sign that reads "ALL HACKERS WELCOME, HOURLY RATES APPLY"
-- Kind Regards whtdrgn101
All that's left to do now is pick curtains for my sea side villa in the Carribean.
We have 89 users and twenty five servers. The cost to move to managed hosting is 3x our current annual cost. We also still need bandwidth to servers that used to be local as well. It makes no sense at all. On top of that the managed services do not allow any bleeding edge deployments.
I work for a government project in a Federally funded building right now and all I can say is... it sound promising. Common sense, proper planning and innovation gets put on the back burner for under-estimated budgets, bad trade studies, botched planning and wrong decisions being made by the wrong people. In the end, everything will still be money driven and the stove-pipe approach to IT infrastructure will remain the same: everyone will take their OWN budgeted money and set up their OWN infrastructure that will be completely different than project-A over project-B, so you'd spend double that to consolidate it. If you want to use some of project-A's setup (e.g. authentication, storage, ect.) because mis-managed budgets being a huge concern, project-B will get quoted a ridiculous amount of money to jump aboard to do it; much more, in-fact, than it would take to do a trade study, setup of a proof-of-concept test, purchase what you need and implement it. Thus that's how stove-piped approaches become what they are: a mess.
Didn't read the article, but my experience with government entities is that they receive a specific value of funding each year to spend on gear, training, energy costs, etc.
The nature of the funding goes that if you don't use all of it this year, you get a reduced amount next year. Now this may seem logical -- it may seem like a policy that governs spending. Instead what it is is a policy that drives UNNECESSARY SPENDING.
The places I have been were frugal but appropriate in their spending throughout the year. As the funding for the year would approach a close (in October), all-of-a-sudden the leadership would start spending money like crazy because they had a large surplus. Money would be spent on things that were not actually necessary; if they were necessary, why not get them at any other time during the year?
In several cases, seeing this strange frenzy of spending I would ask the leadership what was going on. They explained the 'use it or lose it' policy and that in order to maintain the funding they got this year, for next year, they *must* spend it all. I was in conflict because I was taught integrity/honesty and there is no integrity in spending up dads helpful money on worthless junk so as to appear that you still have 'need'.
------
The reason I bring this up is because I am curious if the units that will save money via IT consolidation will actually save us money or if they will be (by obvious standing procedure) driven to spend it in pointless/needless ways.
Discuss? Anyone else experience this?
Now just wait for a data center to be scheduled to close in some Congressman's home district and see how big of a block is put into place.
III.IIVIVIXIIVIVIIIVVIIIIXVIIIXIIIIIIIIVIIIIVVIII
I wonder if he will insist the new computers will use "Cobol Data" and "skip logic". These are BS concepts he used in one of his early speaches. should should not act like he knows about IT when he obviously doesnt.
http://www.dvorak.org/blog/2009/08/12/special-report-is-us-chief-information-officer-cio-vivek-kundra-a-phony/
Basically he claims to have been the CEO of a company with 2 employees. A guy like that should not be holding his Role
Move along... there is no sig here.
I have no problem with the CONCEPT of consolidation, but Virginia's IT outsourcing/consolidation project to Northrup Grumman happened on Kundra's watch. It is an unmitigated disaster.
Years into it, there's not even a complete inventory of the systems that NG is supposed to be managing for the Commonwealth, and at least as of a few months ago, NG couldn't even produce an invoice for the Commonwealth to pay that had more than six or eight line items on it.
I sat through a special meeting of the House Committee on Science and Technology on the issue a few months ago, and the legislature is NOT happy about the situation. Privately, you will hear from them words like "gross negligence" to "I'm convinced it's corruption". The Delegates who engineered the legislation enabling the IT outsourcing are especially pissed.
No disrespect to Kundra, but I don't think he's the right guy to oversee it.
To run a sovereign state, it is necessary for all systems to be based on free software and to be run on public infrastructure. That means no privately hosted cloud computing and no proprietary software. How else are we to ever find out how our government is run?
I was halfway through the description and intended to make a "Let's move everything to the Cloud!" joke, but I see the OP beat me to it. How disappointing. Let me give you a little tip: the person who sets up the joke isn't supposed to then tell the punchline. C'mon, Abbot and Costello 101 here, people. I don't know! Third base!
It'll fail and be another boondoggle. The federal government is an incredible diverse organization with varying degrees of competence. Much of it, mainly the DoD and DoJ, can't even safely use cloud computing environments except in strict isolation from the rest of the world. Those two departments alone account for the overwhelming majority of federal employees.
Can I say, 'that's a paradox?'
I thought cloud computing was about adding more servers but sharing resources more efficiently, and not reducing your datacenters to a mainframe environment, which is what consolidation results in. What he is proposing, is like saying Google, Apple or Microsoft are reducing their datacenter/server inventory to that advantage of cloud computing...
Nothing is for 'Free'. Sure they can cloud compute and ship the same # of servers to specific locations, but they'll hit there bandwidth maximum within a year I bet.
Does CIO Vivek Kundra have budget authority over these data centers? If not, then the agencies will do with him what they do with every other "czar:" Flip him the bird and go right back to the way they were doing things before.
'Nuff said.
Regards;
4 8 15 16 23 42
More Government! They can't do anything right...! unless it's nation building....! and militarily outspending the rest of the world combined...!
I hereby declare that we all to trust the gov to build walls along borders and spend $700 annually on building better annihilation technology... but when the gov starts handing out free cheese, we need to wake up! Then we've got full blown socialist tyranny on our hands people!!!
AAAAaaaaHaaVietnam!
This being an Government project, I predict it will take 5 years longer than planned, cost 10x the initial budget, and still never really work quite right.
Whereas a private sector project it would take 2 years longer than planned, cost 3x the initial budget, and still never really work quite right.
Fixed that for you.
Fixed that for YOU.
Government incompetence and stupidity is always a factor of 5 times private projects. Why? Because Government has much less accountability than private - it just gets buried in the bureaucracy.
is such a colossally bad idea. Government data living on any system ultimately controlled by a corporation on that corporation's property is so rife for abuse, we are really opening perhaps the biggest Pandora's box of our times. Future Americans will likely rue the day the government gave all control of its data to Corporate America.
Did you ever wake up in the morning, with a Zombie Woof behind your eyes? -- FZ
Great, now hackers will only have to bypass a few firewalls and hack a few servers instead on 1100.
Letting politics dictate security has always been a surefire way of decimating an empire,
I am going to go get some popcorn and come back to watch...wait for me?
The potential for saving is great - assuming they can get it right. I am a defense contractor and I go to military bases that have thousands of one-off servers that are dedicated to a single, specialized contract tasks and are probably being utilized at around 1% of their potential. One base I went to told me they spend $25 million on electricity for their primary data center each year. This base is now requiring all new systems to be virtualized and they are converting all their current systems to blade servers running 20-40 environments per blade. This setup reduces their electricity use significantly and reduces their management costs. Now, imagine if the federal government could do this for every site, every project.
This will make it much easier to take down the government. We will only need 100 bombers to take the data centers offline instead of 1,100. Just think how many fewer families we will have to reward for that.
Actually, it does sound like a good idea, but after working for larger companies, it will not go as smooth as they would like since someone will be holding onto an old AS/400 that no one knows how to change the IP configuration and the pointers to the printers.
I'm pretty sure I'm seeing some of this where I'm at now. Basically it has become a bad word to suggest you need a "server". There's the hardware cost, operational cost, and then most importantly to those signing the checks - the bureaucracy costs involved with running such.
The push has now become to just acquire a slot on the virtual machines they've started to toss up which has actually worked out damned well. What used to run on two giant racks now runs on one little blade server. Definitely a newer angle that I'm glad to see is finally taking hold nowadays.
...if you don't already have some, sounds like now ought to be a pretty good time to buy up some stock in VMware.
The NSA has 1) the mad hax0r skillz, 2) massive reserves of hidden computer power, and 3) the security chops to actually create a secure U.S. government computing cloud. If they can keep their own codebreaking and intelligence records secure (when was the last time you heard about the NSA getting hacked?), they can do it for the government as a whole.
Anyone who loves or hates any language, platform, or manufacturer, doesn't know what they're talking about.
Is this a cabinet post that had to be vetted through Congress or is it another one of those Czar posts that Obama created without anybody's consent?
If this is a Czar, Kundra can "go outside and play a rousing game of Go Fuck Yourself" as that position has NO power.
A department I work with is undergoing a transition to "cloud computing" now. The data stored is public information and some network downtime would not be catastrophic, so there's no reason why it must be kept in house. The biggest advantages I see are better hardware management and economies of scale. The current servers are not properly cooled (AC has gone out causing HD failures) and the staff managing them are incompetent. This department's server performance needs are pretty low and can be met with a single server or even a VPS.
The cost estimate is $200 per month, which includes backups at two sites. Of course you will need someone with the expertise to set things up and fix things when they go wrong, but that's really another issue and affects in house setups too. You get to eliminate hardware maintenance and hardware upgrade costs. Don't underestimate the cost of upgrades. I can't come up with a cost for in house hardware management, but I'll say as a tax payer and someone familiar with operations that $200 per month is a really good value.
Obviously there are things that should be kept in house. You must assume that whoever has access to the physical hardware has access to your data. You can encrypt, but not from where the data originates b/c the key is there. If you can't do with some network downtime you must keep your apps in house. Also, if going from a LAN based setup, security needs to be thoroughly evaluated. You may want to limit access to VPN or IP address blocks and such. For those what qualify, if well planned and executed I think there are big savings to be had.
You forgot Reagan and Bush 1. Yet you mention Carter who did not do as much as any of the other recent ones.
Obama has just gotten started and is not on their level yet. The bailout wasn't on his watch (and is largely payed back no thanks to Bush and Republicans who never wanted the bailout money back... or ANY measure to prevent a repeat kissing bankster ass to the extreme. except ron paul and his hopeless move to audit the fed.)
Democracy Now! - uncensored, anti-establishment news
Nixon did immeasurable harm; we are still feeling the damage today. HMOs, bad food, family farms dying, rise of GM food; and going off the gold standard to the oil dollar standard; putting us at the mercy of OPEC... Starting of trade with China for the purposes that came to fruition later; don't think for a second that wasn't the intention. it was.
Democracy Now! - uncensored, anti-establishment news
I've actually done a lot of smaller server consolidation projects. In most cases, the results are great...those lonely database and file servers that get hits 5 or 6 times a day are all combined into one big box that actually uses all the hardware capacity.
The biggest problems I've seen with VMs are the project managers who treat it as magic, never-ending capacity. The new favorite phrase in IT project management circles seems to be, "Oh, we'll just build a VM for it." Problem is, unless someone else is hosting your data center, you can't just call up and order more capacity without paying for more hardware.
Second-biggest with a consolidation like this is incomplete requirements. Lowest-bidder contractors are not going to do a good job of gathering every single requirement...even high-bidder contractors have problems with this. And the problem is that the more they miss, the worse the fallout. A certain large company I used to work for found this out the hard way moving their inhouse data center to one of the big IT services companies. I'm a systems guy, and had all my stuff well documented. Others were pissed off they were losing their jobs and intentionally withheld information...the contractors didn't follow up, and a lot of last minute scrambling had to be done to complete the migration.
Third problem for a government IT consolidation? Some huge services company like Accenture or IBM is going to win the bid and staff the project with dumbasses they pulled off the street in order to maximize profits. (Yes, this happened in my case in point #2 above...the sales staff presented the A Squad and swapped them out as soon as the contract was signed.) Not that government employees are rockstars, but they at least have a vested interest in keeping the data safe. IBM will probably win the contract too, given their involvement with government systems already. IBM has been so India-happy over the last ten years that I wouldn't be surprised if a lot of the (non security critical) work ends up there.
Just like PMs treat VMs as magic hardware, CIOs treat outsourcers as magic black boxes that flawlessly run their IT operations. Unfortunately, the reality is not as sunny beneath the surface!
I can only assume that IBM will play a role in this major effort, since Sammy P and Obama are such big pals. Right now, as I type this, my fellow IBMers are receiving their walking papers. I expect I may join them before the day is over. They/we will be replaced by offshore resources in India, Brazil, Argentina, etc. How do we as a country continue to let this happen; let money hungry megacorps like IBM take our jobs and our personal/classified governement information and put them in the hands of people in other countries? Is someone with a 21 syllable name sitting in Bangalore really concerned about how well he manages a job he's doing for someone 10000 miles away? Does a band 3 worker hired in Dubuque, Fishkill, or Boulder as skilled as the band 6-7-8 person he replaced? IBM wants their customers to believe this is the case, but ask anyone who is still stuck in this corporate rathole and has had an opportunity to work with these groups.
STOP SENDING GOVERNMENT MONEY TO COMPANIES WHO OFFSHORE
I post this anonymously because I fear for my job. I need to pay my bills.
Gimme one of those yummy gub'ment jobs!
http://www.microsoft.com/windowsazure/
XML parsing failed
XML parsing failed: syntax error (Line: 80, Character: 8)
Reparse document as HTML
Error:
mismatched end-tag
Specification:
http://www.w3.org/TR/REC-xml/
Double Fail.
It seems to me this is a bad idea. If for no other reason than when all the different programs are together in larger clusters of applications and data storage, it makes it easier for someone in the government (or someone hacked in) to do more cross application data browsing. I'm not sure that we trust the government or the security of a data government data center to make private information secure. Not to mention covert clandestine operations we don't know about.
The second bad idea is that governement programs come and go. When the computing resources are closer to the program, it is easier to manage and in some cases turn off if defunded. With all the computation and data storage co-mingled, which is how you get the savings, then boundries and clean removal of all aspects of a project will be much much more difficult. Not to mention the nightmare of accounting for the resources used by one project vs another.
I remember hearing the story (I don't know if it is true) that AMTrak or one of its ancestor incarnations did an accounting dance, charging the passenger lines passing over track 100% of the maintenence cost whereas they did not charge any of that to the freight traffic over the same track. As I understand basically wanted to find a way to kill the passenger service by loading it up with expenses. The Chicago CTA did something similar I understand with switching the sides of two CTA runs, giving one of the lines the two least used ends and the other parallel route the most used. They then tried to claim losses on that line and planned on shutting it down. Luckily the Government stepped in and said, no problem, just pay back all the money from the Government that was given with the condition that those lines be kept open. We still have both lines, one it the one that goes close to my house.
So combined facilities means games with cost accounting that may or may not favor one type of application over another and may also be used for hiding black budgets more easily.
Perhaps, trying to do better in a cyber war ought to have a higher priority, than consolidation?
The rest of the article is scary too:
Yes, Silicon Valley's support for Obama's candidacy was not in vain...
Oh, again, the "greenness" goes before the cost. Hey, I have this $100 fan, that uses 1/3 less electricity, than the $10 fan from my polluting competitor. Per the Administration's instructions, you must buy my equipment...
In Soviet Washington the swamp drains you.
We've been consolidating for the last few years in the Air Force. Needless to say the whole experience has been on par with getting punched in the face everyday. The concept of cloud computing works great until you realize that you have to pay for all that bandwidth when people actually want to use there computers for something other than email and a few web based portals.
Their solution has been to disable just about every usefull function since data transfer is no longer hopping a free ride across the base network. That combined with the fact that when the network at our primary factility goes down so does everyone else's since those oh so lovely portals that link us to everything else are only served up there.
The concept of cloud computing looks great on paper and actually does work for really light applications such as email, but who ever thought that converting everything including locally shared data over to the cloud (cloud served but still restricted to local access??!!) should be forced to lick the toilets in every office, just after lunch time while they are still warmed, in every office they've inflicted this crap upon.
I was born in Missouri, my family is from Virginia, and I've been all over this country from California to Texas to Massachusetts to North Carolina to New York to Montana and lots of places in between. I love the people of this country, and I wish people wouldn't be so divisive when it comes to those from other regions. It's truly sad. The South, the North, the Midwest, the East, the West all have their treasures and things to be proud of. It's sad that so many people are ignorant of this fact, and use any opportunity to put others down. (I am guessing it comes from some arrogant, deep-seated insecurity, but I am no psychologist.)
Nixon was also to blame for getting out of Vietnam, normalizing U.S. relations with China, and ending the draft.
-- Terry
So it will basically be this on a larger scale?
The Navy did the "biggest IT contract ever let" and it was pretty much an expensive bloated disaster. See http://www.itsmwatch.com/itil/article.php/3813651 I'm beginning to think that "too big to fail" means "too big" and that failure is inevitable.
FTA..
"This growth in redundant infrastructure investments is costly, inefficient and unsustainable and has a significant impact on energy consumption"....
In other words, that mission critical server that does the whole income tax thingy..e-file i think its called, that only needs one server. Two servers with the same data are not required, they just waste energy and if it goes down due to a hardware failure (because parts are readily available on 10 year old servers) you will have to wait till we can rebuild the server and restore for tape. oh wait, tape is redundant data, we got rid of those too.
Well i didnt like paying income tax's anyway.
WOW Whata Punk!
Some separations are for a REASON.
For instance:
Tax data is separate from criminal investigative data because access to tax information without a VERY hard-to-get warrant is prohibited.
Similarly, gun transfer information is supposed to be destroyed after a small amount of time to prevent compilation of a database for confiscation - either by a runaway government or an invading power trying to disarm a potential resistance movement. (Also: It's tax information because the only way they could get federal gun bans and tracking passed back when congress and the courts paid more than lip service to the constitution was to disguise it as a tax. That's why BATF is part of treasury.)
Many other classes of information are confidential and access restricted to small groups of people with a particular need to know. Examples: Medical information. Competitive bidding information. Company secrets disclosed to regulators. I could go on.
Keeping this information restricted to the personnel of the agency with the need-to-know is easier if it's in the agency's own I.T. operation. Then other agencies don't have automatic access to it - and interdepartmental rivalry works to keep the information bottled up. "Consolidate the IT operations" and you have a much larger I.T. staff with back-channel access, while need-to-know compartmentalization is a bolt-on to the unified database, with enormous potential for failure or bypassing (if it's implemented at all).
So consolidating the IT operations is a grand opportunity for both foulups leaking data outside their authorized compartmentalization and the clandestine creation of a "Total Information Awareness" Big-Brother superstate.
Bantam Dominique roosters crow a four-note song. Once you've heard it as "Happy BIRTHday" you can't NOT hear it that way
What exactly are Vivek Kundra's qualifications? He's a bozo with business interests IN India, so of course he wants us to close US IT facilities and offshore the work. Someone needs to bitchslap that jackass publicly, and unmask him for the worthless mouthbreathing piece of shit he is.
Remember kids, if you're not paying for the service, YOU ARE THE PRODUCT THAT IS BEING SOLD.