Slashdot Mirror
The FBI Software Upgrade That Wasn't
Davemania writes "Washington Post reports that the FBI's attempt to modernize their department has once again failed. The 170 million dollar Virtual case File system, the agency's second attempt to go paperless is reported to be useless. The finger seems to be pointing at the FBI leadership, greedy contractors and bad software management." From the article: "It appeared to work beautifully. Until Azmi, now the FBI's technology chief, asked about the error rate. Software problem reports, or SPRs, numbered in the hundreds, Azmi recalled in an interview. The problems were multiplying as engineers continued to run tests. Scores of basic functions had yet to be analyzed. 'A month before delivery, you don't have SPRs,' Azmi said. 'You're making things pretty. . . . You're changing colors.'"
Personally, I'd prefer the FBI not go paperless. Because (a) paper trails are nice in investigations and such (y'know, when the FBI finally goes up against the Supreme Court) and (b) stuff that doesn't have a hardcopy tends to get lost more often than physical objects...especially embarassing things...especially by government agencies.
Yes. I'm slightly paranoid.
Anyone else think the comments just weren't rendering right before they turned off ABP and saw ads?
Call me crazy, but it sounds like the FBI didn't know what it wanted and SAIC was too scared and proud to play contractor hardball with its client to get the job done. The FBI is legendary for its fractured leadership, fiefdoms (makes most agencies look like a single organism it's so bad) and crap like that.
I've never understood why the government (whose inefficiency in regards to monetary spending has become almost cliche) doesn't set up a system for these sorts of big projects where the funds for it ARE someone's money.
As you said, there would be much more motivation if it wasn't just taxpayer money, so why couldn't they use a system whereby they have several firms fund and set up different solutions and then the best solution gets a predetermined amount of money from the government?
Since the firms would be initially shelling out their own money on the projects without a guarantee of reimbursement, you had better believe they would be busting their asses to make sure the products did what they needed to do quickly and efficiently.
I'm living in a magical dream world, aren't I?
Software problem reports, or SPRs, numbered in the hundreds,
If this software system runs under Windows, they started with a Problem Report baseline in the thousands. If they got it down into the hundreds, Kudos!
That quote was just too funny. In any huge huge huge project the state of play a month before is usually going through the thousands of trouble reports, deciding which features you will turn off so you can ge the release out, figuring out work arounds for the rest of them, discovering that the analysis was flawed on some functions and of course by now you ditched many other features because the analysis was not done at all. And yes you change a few icon colors to keep key users happy and get your sign-off. This is for a successful 1.0 implementation.
Rereading the summary, the submitter has it wrong - "FBI's attempt to modernize their department has once again failed" implies that Sentinel has failed - which is definitely not the content of the article. Even the snippet quoted is about VCF having problems, not Sentinel.
It really sounds as though the FBI needs a real IT department of their own, not the isolated geeks helping out Mulder and Scully. And, if some "CIO" type waddles in and recommends another outsourcing, maybe the sidearm arguement should be used.
Outsource, and this is what you get. They must hire MBA's. Really, sensitive government data projects like this one should never be outsourced, if only for national security reasons.
"We are all geniuses when we dream"
- E.M. Cioran
The new project is even worse than the old. No software, with the possible exception of truly safety-critical stuff like missle-control or nuclear power plants, needs to cost $425 million and take four years. You could have a custom OS written in pure assembly for a quarter of that!
Media that can be recorded and distributed can be recorded and distributed.
-kfg
What TFA describes is the current state of general software development for hire, which has changed very little in the 18 years I have been programming.
It doesn't matter how well planned the project is, or how well educated the customer is, or the proper allocation of project champions on the client side, we all end up getting hit with b.s. look-and-feel complaints that end up taking higher priority than fixing bugs.
If you give the client the option between tweaking a template to a report, and tweaking the queries that feed the damn report so it runs 10% faster, the client will ask you to first make it pretty, then worry about the queries. If you dare ask them why, they will give you a b.s. explanation that it is all about perception. That the pretty page looks more "professional" and it looks like more work and care was put into it.
A word of warning to those of you that are new to for-profit programming: whenever somebody uses the "it looks more professional" gambit, it usually means he has no excuse and is hoping you will drop it. He asked you to do it simply to please himself. HE wants the damn color of the page changed, or that heading two pixels taller, etc.
Every couple of years we get hit with new programming methodology fads, but those don't help us with dealing with difficult customers. When you are pulling millions every year from the same two or three government contracts, the last thing your project manager wants is to piss off any of the primaries for the contracts. Extreme programming won't suddenly make your client listen to you.
Why the hell do you think that programmers are so rabidly enthusiastic about working for free for a specific open source project? These same programmers will drag their feet and hate life in general when working at their salaried jobs. At the free project a hell of a lot of the people involved in running the project will actually have a clue, while at the projects at the salaried job the norm is a lot of the people in charge won't have a clue.
Pedro
----
The Insomniac Coder
I'm an editor at IEEE Spectrum. Spectrum laid out out this story in September '05. (I submitted a link to Slashdot at the time, but the editors in their Infinite Wisdom rejected it). Despite our story being prominently featured in google, wikipedia, winning awards, etc, and using similar sources, and so on, the Washington Post didn't acknowledge any of Spectrum's reporting, which has prompted Spectrum's Editor-in-Chief to complain to the Washington's Post's Ombusdman thusly:
Dear Ms. Howell,
We were startled to see that the article "The FBI Upgrade that Wasn't" by
Eggen and Witte in today's Washington Post is taken directly from an article
we did in September 2005 called "Who Killed the Virtual Case File," by Harry
Goldstein (http://www.spectrum.ieee.org/sep05/1455). His article has won 5
major magazine awards. Neither Harry or Spectrum gets credit or attribution
in the Washington Post piece.
Your writers reinterviewed all our sources, including Matthew Patton, whose
only press interview until your story today was in the Spectrum article.
They filed the same FOIA, etc.
Is this plagiarism? Not exactly. Is it shoddy, lazy journalism? You bet.
Sincerely yours,
Susan Hassler
"Just once, I'd like to meet an alien menace that wasn't immune to bullets." -- The Brigadier, Dr. Who
We've learned this over and over again at my company. The likelihood of scrapping the whole thing because you've got nothing is logarithmic to the cost. That is, the more the costs go up, the more likely you scrap the whole thing.
The project has to be bitten in chunks. Lay out the functionality, and then start implementing it one small piece at a time, integrating as you go along. The Big Bang approach is always doomed to failure, or explosive costs, especially when you get to the reality that to deploy you need to shut down the business for two weeks to manage the data conversion. Lot's of small $1 million projects are more likely to succeed and be at budget then one big $20 million project.
This isn't news. It's the whole momentum behind a lot of modern development techniques such as Agile, or architectural such as SOA.
There's also a corrolary that any project involving a big consulting company like EDS, CSC, Anderson(or whatever the hell their name isnow), etc. is more than likely going to cost double what it should.
full disclosure: I wrote the "Who Killed the Virtual Case File" story for Spectrum, which ran last September.
Here's some more food for thought about the "reporting" behind the FBI story:
What's the news angle that warrants front page attention in the Post? That the Post reporters obtained the "unreleased" Aerospace report? Not news: the report was released to Spectrum at the end of April after nine months of litigating a Freedom of Information Act Request.
All the Post reporters had to do was google "virtual case file" and voila! the story pops up as number 1, right there for them to rewrite!
But say they are too lazy to bother googling. They just want the summary. The Spectrum article is the basis for the Wikipedia Entry on the Virtual Case File and the only external link. http://en.wikipedia.org/wiki/Virtual_Case_File
The Spectrum article was the first and until the Post article, the only one to mention Matthew Patton, who was unearthed by dint of investigative reporting nowhere acknowledged in the Post article.
The Post article purports to turn a spotlight on SAIC, in part by quoting David Kay, the Iraq weapons inspector, who was a former SAIC VP--but who had absolutely no firsthand knowledge of the VCF project.
The Post article uncritcally takes FBI CIO Azmi's word that the follow up project Sentinel is on-budget and on-time, when other news outlets have recently reported about a growing sense within the FBI that this project is doomed to a fate similar to the VCF's.
The problem isn't really that it's someone else's money, cause that's true at all companies. How much of your company's market cap did you or your boss or your boss's boss put in? In most cases, approximately 0 - it's Wall Street's money, which means it's millions of pension-payers' money rather than millions of tax-payers' money.
The driving problem is the rigidness and stagnation of the government's bureaucracy. The impulse to build this kind of lumbering bureaucracy was a good one - it's called civil service, and it's basically a way to insulate long-term government functions from short-term politicians, keep government employees from becoming the minions of whichever politician wants to build a personal empire. There's no question that the limitations of that approach are killing government. On the other hand, do you really want a civil service that can be downsized or force to work on producing bogus intelligence so we can invade 17 more countries? Or a government whose job is to buy as many copies of Microsoft Vapor Server as it can possibly cram into an appropriations bill? The idea that the government is fundamentally incapable is a useless one, sorta like existentialism, in that it fails to answer the question of what we DO as a result of that insight. Do you seriously propose that the FBI be run by a private interest? I'd rather not have someone like Verizon or ChoicePoint watching my back, thank you - at least the government has a mandate to protect people and not just make money off of them. And there's a name for the head of an large private armed force: warlord.
The article touches on the fact that government has progressively become a comparatively worse place to work than the private sector, because of the bureaucracy and because the salaries don't keep pace with the private sector. A friend of mine is working on Sentinel, and he's been really surprised to find an FBI-side partner who actually wants to oversee the work. If you do think that police work at the federal level should be the job of government, then how do we go about really fixing the FBI?
Government is what citizens make it. And here's the rub: under the past 25 years of leadership of the small-government zealots, we managed to prevent government from making important investments - e.g.: roads (any idea how many bridges in this country haven't been maintained in decades, and what the long-term maintenance will cost on the vast numbers of roads we've built?), emergency planning, a healthy population, an educated workforce, etc. These investments are the infrastructure on which the economy is built. And this stellar leadership has not only managed to give short shrift to the future, but it's utterly failed to address the real problems they correctly identified with government. Anti-government conservatism is a bankrupt ideology - it's nice to kick the government for it's failures real and perceived, but when push comes to shove, it offers no real alternative for building the public underpinnings of our economy and our lives, just faith that the free market fairy will come fix all our problems. We live in an extraordinarily pragmatic age: one where you can assemble data on a large scale to decide if something works or doesn't. It's time to stop carping and give our government a mandate to do this and find its way out of quandaries like the civil service vs. Tamany Hall problem.
Sorry for the rant. Somebody talk to me about fixing the FBI.
This is how big government projects *should* be done. Hire a good contractor, set a minimum and then give bonuses for good performance and penalties for bad. Did the final tally cost a lot in bonuses? Yes. Was it worth it? Yes- they fixed a major problem in amazing time and did it correctly, plus they had a bunch of blue-collar folks make serious coin working triple time, all of which got plowed back into the local economy.
You can argue it wasn't on budget due to the bonuses, but it was assumed from the beginning they'd be paying out. Since the daily economic loss to LA was higher than the daily bonus for finishing early, I'd argue it was actually under budget.
"Seven Deadly Sins? I thought it was a to-do list!"