FBI's New Info-Sharing Software Project Fails 271
Spy Handler writes "After 4 years and half a billion dollars, FBI's attempt to create new information sharing software - called Virtual Case File - simply didn't work.
GREAT MOMENTS IN HISTORY (#7): April 2, 1751 Issac Newton becomes discouraged when he falls up a flight of stairs.
Federal Cost Savings (Score:5, Funny)
Come look for me the next time you need something that does not work. I would be happy to deliver it for the bargain basement price of only $100,000,000.
Re:Federal Cost Savings (Score:3, Interesting)
Large organizations are only truely served by in-house developed software. The trick is for said organizations to hire folks who really know what they are doing.
I can generally tell when a project is going to fail. The whole process begins with sending the project out for bid. For specific projects, yes, farm it out. There is no need to write your own relational database. If you don't have a Unix weenie in-house, it is cheap at twice the p
Re:Federal Cost Savings (Score:2, Interesting)
Large organizations are only truely served by in-house developed software. The trick is for said organizations to hire folks who really know what they are doing.
Agreed. However, there is a mindset in a lot of government agencies that COTS and/or using consultants saves money - no matter how many times they get burned. In typical fashion, the article indicates the FBI ("I" for investigation) has hired two more groups of consultants to investigate the problem.
Offer Accepted (Score:2, Funny)
Your offer has been accepted. You are invited to become part of our Guantanomo Detainee Program (which currently does not produce intel or results).
Please report to your nearest police station for arrest and processing. No personal effects allowed (as your living space is significantly restricted).
Thank You
FBI
Federal Bureau (Score:2)
Actually, you cannot attribute to incompetence the criminal motivations revealed by Sibel Edmonds and others.
Re:Federal Cost Savings (Score:3, Funny)
Government software project fails?! (Score:5, Funny)
Re:Government software project fails?! (Score:2)
Ahh HA ha ha . . . AAk
-nB
Accountability (Score:5, Insightful)
And that blank cheque is the problem. Whatever happened to accountability? It's the tax payers money to begin with.
Re:Accountability (Score:3, Insightful)
That's the problem right there. No tax payer has the time & money to do the auditing! I mean.. my portion of that was about $2. And I just don't have the time & energy to audit them for my $2. .. like.. hire someone.. to do it for me?
Can't I
What? I Do??
Damnit! Okay, I revise this. It's because we can't kick government auditors out of office for not auditing my $2!
Wait, can we?
Re:Accountability (Score:2)
Re:Accountability (Score:3, Insightful)
Not always. NASA was given a blank cheque in the 60s to get a man to the Moon. With the advantage of hindsight, we can see that NASA managed the project extremely well and there was very little waste. Contrast this with NASA's subsequent accomplishments once the blank cheque expired: decades of waste.
Sometimes a blank cheque is just what's needed to get something accomplished efficiently. Apparently not in this case though.
Re:Accountability (Score:3, Insightful)
The difference being, I think, is that for Mercury/Gemini/Apollo those working on it actually gave a damn and weren't solely concerned with self-enrichment. Then the disillusionment and cynicism of the 1970's
Re:Accountability (Score:5, Funny)
Commie!
Re:Accountability (Score:3, Insightful)
It's called "elections". They were in November. How many congressmen were voted out?
Re:Accountability (Score:2)
Re:Accountability (Score:2)
Basically, it means that the contracts go to whoever spends 70% of their money on accountability, auditing, documentation, oversight, and bureaucracy. (i.e. EDS [wikipedia.org]) Which is one of the reason government projects cost so much and are so likely to fail.
There's nothing like a 12:1 beancounter to programmer ratio when you're trying to maintain accountability. No prizes for guessing how productive it is though.
Lemme guesss sum1 like EDS or Accenture was @ it (Score:5, Insightful)
Re:Lemme guesss sum1 like EDS or Accenture was @ i (Score:2)
Burpie seed put all its eggs into a basket with a new inventory/sales/everything for everybody system. It didn't work. They lost a LOT of money in lost sales, on top if the bales of money that were burned on the project itself.
It gets worse! (Score:3, Insightful)
And the scariest thing is that they're looking to BAE Systems next. I have (well, had) family there for a while. If their experience is anywhere close to typical, this is not an organisation you want to help you run critical security/intelligence concerns.
Hey FBI. (Score:4, Insightful)
Hm, more seriously.. They must really have tried to make something special. Otherwise WebDAV+SSL would have proven to be a bit cheaper..
Re:Hey FBI. (Score:2)
Sometimes Scrapping the System isn't a bad thing. (Score:5, Insightful)
However, as a programmer I can understand them wanting to scrap the program. If the design has been shot to hell, if their using technology several years past its prime, it's time to start fresh.
And as a tax payer, I'd prefer the FBI to use a system that works, rather than a system that doesn't.
Re:Sometimes Scrapping the System isn't a bad thin (Score:3, Insightful)
Imagine the learning curve! Here we have this monolythic blob of stuff that can do EVERYTHING. Here are the 12 billion source lines of code and a make file that takes 3 centuries to run. The project is 4 years behind schedule and we fired the 10,000 coders that were working on it before, but we asked them to comment their code with nice flowe
In other news.... (Score:3, Funny)
... The MPAA and RIAA have filed suit against the FBI, since their software could be used to share copyrighted material.
Your tax dollars at work (Score:2)
Re:Your tax dollars at work (Score:2)
I'm just saying.
Why do people need to reinvent the wheel? (Score:5, Interesting)
Re:Why do people need to reinvent the wheel? (Score:3, Interesting)
What the government should put into place is a "Middle Bidder" system. In theory, that should encourage contractors to put forward more reasonable estimates of the costs of projects.
Re:Why do people need to reinvent the wheel? (Score:5, Insightful)
In practice this guy is a manager, not a software expert, and he's usually an idiot. I've written dozens of proposals and it's monumentally clear that your job is to impress this idiot. Coming up with an intelligent design is something you spend time on after the bid, not before. And there's usually not time then, because you're busy fulfilling this idiot's pipe dreams.
Not that I'm bitter or anything.
Re:Why do people need to reinvent the wheel? (Score:2)
Re:Why do people need to reinvent the wheel? (Score:2)
This sounds like a perfect job... (Score:2, Insightful)
This sounds like a perfect project for the open source community! We should get Richard Stallman to submit a quote.
Or better yet, Bram Cohen (inventor of BitTorrent) or Jed McCaleb (inventor of eDonkey). Those guys have experience writing file sharing programs after all, and isn't that really what the FBI is asking for?
No, it doesn't. (Score:5, Insightful)
It's classified two ways: first, a lot of this data is privacy protected (the FBI spies on American citizens and that data is heavily controlled). Second, one of the things it needs to store is sources&methods, which are protected even more closely than the data itself. (The most classified stuff is always about sources&methods, not the data itself.)
The open-source community could write pieces of it, but the hard work on a project like this is adapting it to the particular requirements of the customer.
The problems involved aren't abstract ones that can be solved byu an incredibly clever person like Bram Cohen. They're involved in getting a gazillion people to all buy off on a data format, and convincing them that they really can share information without violating their security requirements (which is really just code-speak for "if I let you have this information I won't be the only one with it, and therefore I become less important.")
The security clearance requirement means that they're working with a drastically reduced pool of programmers. Corners get cut, ideas go unused for lack of implementers, internal oversight is practically nil. (They have code reviews but they're an immense waste of time.)
I'm not sure I've ever worked on a government project of even a tenth this size that I considered to be successful, even if it did get deployed. But throwing it out to the open-source community isn't an option.
Re:No, it doesn't. (Score:3, Interesting)
I disagree.
No you don't. All you need is a sample dataset that looks like the real data. Creating suitable simulation data and final testing with real data can be done by a small core of cleared personnel.
Bullshit. That's overpaid consultant-speak. If the requirements are clear, they can be met. I
Re:No, it doesn't. (Score:2)
If you're dealing with classified material, you have to be behind certified security protection, and no data can travel public lines, encrypted or not.
An OSS model for this simply cannot happen for security concerns. OSS tools can be used, but they'll always have to be put together in a se
Ummmmm... (Score:5, Funny)
From TFA: So far the overhaul has cost $581 million, and the software problems are expected to set off a debate over how well the bureau has been spending those dollars.
I'm going to go with "not well."
ill will (Score:2)
The Kazaa approach. (Score:5, Funny)
A little political editorializing going on... (Score:5, Informative)
WASHINGTON -- A new FBI (news - web sites) computer program designed to help agents share information to ward off terrorist attacks may have to be scrapped, the agency has concluded, forcing a further delay in a four-year, half-billion-dollar overhaul of its antiquated computer system.
The half-billion is entire their budget to overhaul computer systems, not how much money they spent on this software.
This is not to say they haven't wasted any money:
Science Applications has received about $170 million from the FBI for its work on the project. Sources said about $100 million of that would be essentially lost if the FBI were to scrap the software.
Re:A little political editorializing going on... (Score:5, Interesting)
Hold on, isn't Science Applications (also known as SAIC) also that company that was so incompetent in creating Pro-U.S. propaganda in Iraq that their contract was pulled from them?
http://www.corpwatch.org [corpwatch.org]
http://www.prwatch.org [prwatch.org]
Why does the government keep giving them contracts when they suck?
Is it still new... (Score:2)
Seems like that's more along the lines of "planned" or "attempted".
I could go for burning a half billion dollars in 4 years - where do I sngn up for their next try?
Time to move on (Score:2, Insightful)
I have an idea! (Score:5, Funny)
Now gimmi my half a billion dollars please! (I do accept paypal)!
Or (Score:2)
How is this possible? (Score:2, Funny)
There was an article about things like this... (Score:3, Interesting)
Software too myopic (Score:5, Insightful)
When I worked for the Department of Justice, a case might have 5 different case numbers: one case number for the DOJ, one case number for the FBI, one case number for the Defense Criminal Investigative Service, one case number for the Naval Criminal Investigative Service, etc. If I only had the DOJ jacket number, it could take me 15 minutes to get the case number for another agency, just so I could talk to one of the investigating agents.
Spend money to fix that larger-scale problem, before flooding the FBI with money to squander on a software application that they will be terminating and starting afresh on.
Waterfall. Genius. (Score:5, Insightful)
A prototype of the Virtual Case File was delivered to the FBI last month by Science Applications International Corp. of San Diego. But bureau officials consider it inadequate and already outdated, and are using it mainly on a trial basis to glean information from users that will be incorporated in a new design.
Science Applications has received about $170 million from the FBI for its work on the project.
A spokesman for Science Applications, Ron ollars, said via e-mail that the company had "successfully completed" delivery of the initial version of the Virtual Case File software last month.
The stripped-down prototype will be running for three months. The bureau plans to then "shut it down, take all the lessons learned and incorporate them in a future case management system," a person familiar with the bureau's plans said.
An outside computer analyst who has studied the FBI's technology efforts said the agency's problem is that its officials thought they could get it right the first time. "That never happens with anybody," he said.
Some sources sympathetic to the FBI defended the process, and said that what has been learned in designing the software has given the bureau
valuable design and user information.
The first time they saw the software was a year after the delivery date. So they must have been using waterfall. Then they defend the process by saying the only good thing they got out of it was the information for the next pass of iterative development. So the best thing about waterfall is that when it fails you can turn it into iterative. Pure genius.
Open the source! (Score:5, Informative)
This is a prime example why public funded software ought to be open source, that way the community as a whole can pick bits and pieces out of it for further use.
Re:Open the source! (Score:2)
IANAA (I Am Not An American), but would gladly contribute to something that might actually help global security. A great many US citizens couldn't get a security clearance to work on the closed source code. How would you feel about foreign citizens writing code for your security?
That said, even just opening the source for outside review would really help security.
Re:Open the source! (Score:2)
Re:Open the source! (Score:2)
@ECHO OFF
COPY C:\FBI\*.* C:\HOMELA~1\
COPY C:\FBI\*.* C:\CIA\
Re:Open the source! (Score:2)
Perhaps using the Duke Nukem engine... (Score:3, Interesting)
Seriously, when you look around it's amazing how many software projects just completely fail with no usable code produced. It's not uncommon for companies to spend several million and just shut the thing down a couple years into it.
I think we're about a century behind our technology. We still try to use industrial age models for 'building' things...and the digital/info/[buzzword] age has major implications that those models just don't take into account.
Re:Perhaps using the Duke Nukem engine... (Score:2)
Re:Perhaps using the Duke Nukem engine... (Score:2)
Hmmmm....I don't know about that. A 747 is pretty complex. A skyscraper is pretty complex. I've seen plenty of art projects that are far more complex than at least one of these failed software project.
Come to think of it, a CPU is pretty complex...and a CPU is a software development area. But in a CPU the physical design seems to keep things in a world that we can manage.
Most of these software p
Fraud? (Score:3, Insightful)
Why don't they do the same for software?
These are the same feds who treat copyright infringement as "theft"; who tack on all sorts of costs to the cost associated with a breakin (where a kid just pokes around the system); and yet they turn the other cheek when these companies waste billions of dollars on badly-executed projects.
As a taxpayer, I am thoroughly pissed at this waste of my money.
Expect the Prime to pay a token couple of million dollars as a "fine" and walk laughing all the way to the bank...
Re:Fraud? (Score:5, Insightful)
That's how it works. You can't ask someone to provide a bid for a thing that isn't designed or built yet, then throw them in jail if their bid isn't 100% accurate. Good luck finding bidders! Your analogy to a car is just fucking retarded.
Re:Fraud? (Score:2)
Why don't they do the same for software?
But if you bought a car, you wouldn't be constantly harrassing the designers with new features ("It must be able to turn 90 degrees instantly! Oh, and I forgot to say I want it to fly!") while they were still building it.
Rich.
Re:Fraud? (Score:3, Interesting)
Why don't they do the same for software?
If you sold a car to the government that didn't run at all, it's probably because the order that the government placed with you was for a vehicle with an 80-gallon gas tank, that can use gasoline, diesel, compressed air, or vegetable oil and run equally well with each, that is no larger than a stationwagon and weighs less than 1000 pounds.
The only way to meet those specs 100% is to
TIERS - Texas Integrated Eligibility Redesign Sys. (Score:4, Interesting)
It gets to be depressing working for the government because you see so many contracts like this awarded simply because some higher up gets his palm greased. Another example of this is the fact that I had to pay Banctec (the company that has our hardware support contract) the standard fee of $340 to replace a CPU FAN in an old machine the other day. So sad.
P.S. - I'm having to post this anonymously because anyone that has even begun to criticize the TIERS software, even internally, has been officially reprimanded or worse.
Re:TIERS - Texas Integrated Eligibility Redesign S (Score:2)
"I'm having to post this anonymously because anyone that has even begun to criticize the TIERS software, even internally, has been officially reprimanded or worse."
You mean the chair?
Gov't IT projects (Score:2, Insightful)
Not a software problem (Score:3, Insightful)
WikI FBI Pedia (Score:3, Insightful)
Ok, my point is now that they have a secure network there are some many great ways to share data, and even rank and Meta-moderate data...
Sure it's nice to build some amazing wild system that totally solves every problem they ever had and ever will have... BUT there is too much risk.
You see this happening again and again in Government, with FBI, IRS, etc. Big huge systems build from whole cloth rarely ever fit or work or are delivered as promised.
Smaller systems with continual or incremental changes work better.
Why no Wiki? (Score:2)
It seems that if they could expand Wiki to also display fingerprints and arrest warrents, then they're golden. Then just set up a good search engine on top of it, and there you go.
I know, put a Google Desktop search on top of it, and run it off a Beowulf cluster...never mind.
--LWM
The Mythical Man Month (Score:2)
Not at all surprising (Score:2)
The companies that get awarded contracts like this are primarily good at writing proposals, great Power Point presentations, holding long meetings (at remote locations), performing requirements definition, alternatives analysis, white papers, security accreditation, various data gathering, data modeling, blah, blah, etc, etc. But rarely are they also good at the actual matter at hand. But I doubt there is anything a govt agency can do about this, since they require all that luggage to show accountabiity to
conspiracy (Score:2, Insightful)
Charge the companies with theft by deception (Score:2)
I wonder if there is a federal equivalent.
You don't just give someone half a billion and get nothing unless someone missrepresented what they were capable of.
A classic case... (Score:2)
Beyond a certain point, it's hard to completely pre-plan large IT projects. The only way to do them is to do large-scale mockups (aka the first attempt).
This just in... (Score:2)
This just in, the FBI invented email!
Not half a billion (Score:2)
Ah! The joys of bureaucracy! (Score:3, Insightful)
I'd like a nice on-line form associated with my tax return, which allows me to pick exactly where my tax dollars are spent.
I'd tick off things like, "Sidewalks and road repair in the region of my choice."
I'd tick off, "Public Transportation."
I'd tick off, "Environmental Conservation" and "Well-funded Free Medical Clinics which employ doctors who really want to heal people and not just get rich." I'd tick off all the other things I want MY money to be spent on. I want to be able to micro-manage where my tax dollars go, what salaries people receive, and who gets to have a job funded with MY money.
Things I'd NOT tick off would include,
"Missile defense systems which A) don't work and B) increase world tensions leading to hugely wasteful expenditures on ever increasingly complex defenses. Which don't work."
"Spineless Yes-Man Politicians More Interested in Keeping Their Jobs than in Serving the People who Bloody Voted for them."
"Free Handouts and Make-Work Contracts for Stupid Corporations Which Don't Deserve Jack Shit, *cough Haliburton* But which Happen to be run by Friends and/or Family Members of Sitting Retard Presidents."
"Education systems which make kids stupid, socially retarded and massively mis-informed."
"Legal and Penal systems which put non-criminals into jails which are designed to shove everybody into beast-mode and encourage them to abuse one another just so that they might survive."
And of course,
"Half-Billion Dollar mis-leadingly named information-consolidation contracts which duplicate other contracts and existing systems which already work a bit too well at putting non-criminals into jail."
If I can't have that tax system, then I'd rather see the whole goddamned thing burn to the ground.
But hey, that's just me.
-FL
Agile (xtreme) Software Development. (Score:4, Interesting)
When will people learn: with extremely complicated systems that humans have to interact with you can not specify it 100% correctly the first time?
Experience in building such systems has lead many of us to realize you must use an iterative approach that allows the end users to be part of the feedback loop.
Release early and release often, let your users use and break the application, and come closer to the ideal system with each iteration.
Now, I wouldn't blame the FBI for the problem completely - after all, they are not software developers. A portion of blame should go toward the contractor for failing to realize the issues surrounding development of such a complex system and taking appropriate actions to determine and meet the needs of their clients. Their contract should have been written to a) specify customer satisfaction as the key measurable for success, and payment of the contract b) put in a rider that basically states any functionality needed to bring the application to minimal usability as discovery occurs will be part of the first contract (this is negotiable - some things are really enhancements and new functionality - and some are required, even though not originally discovered in the first iteration - this allows both parties to recognize up front that 100% discovery of requirements does not take place in practice).
This approach has worked extremely well for me as a manager of vendor development (I have been extremely lucky to have vendors who understand what I am talking about), as well as for my own projects that I develop and implement. While there is a bit of risk involved in negotiating key usability issues discovered late in the development cycle - going out of the gate with an iterative approach ameliorates much of that - and is certainly less risky than giving someone $100,000,000 before I see the first line of code...
Information sharing??? (Score:2)
CTU has all of this figured out (Score:2)
In the real world 1/2 the stuff he asked for would probably be on an old Unisys machine (not supported since 1989) that thinks it is dumping records to a printer that is actually an old OS/2 machine connected to the serial port running a Pascal program that was written by a summer intern back in 199
Another example of Cherry Picking? (Score:4, Interesting)
I am wondering if a similar thing isn't happening here. SAIC is, in effect, being paid to the system analysis, but the most lucrative part of the project will be given to an insider, a crony or for a political payoff.
NAPSTER (Score:2)
Expected to get it right the first time? (Score:2)
"Experience is what you get when you don't get what you want."(unknown)
Why do they (Score:2)
Cripes, give me the $100 Million. I'll set you up with a wiki and a google search appliance and I bet it'd work better than whatever shit their contractor came up with. My tax dollars at work. Grr.
first you have to... (Score:2)
I know it's a trite, overused stereotype,
Re:Fails Like Slashcode?? (Score:2, Funny)
Too bad
Re:Fails Like Slashcode?? (Score:2)
Really, don't repeat that.
Then they would never have the fix their server problems. At least now, when the site is erroring out, no ads are being displayed so they have a reason to do something.
Re: (Score:2)
floor model (Score:2)
Re:floor model (Score:2)
Re:floor model (Score:2)
Governments are much worse at managing money.
Re:floor model (Score:2)
Re:floor model (Score:3, Insightful)
Re:half billion? (Score:2)
Yep, half a billion should cover it. Probably another 100 million for early termination of the contract with the vendors.
100 million (Score:4, Informative)
So, surprise, the slashdot story title is misleading.
Dan East
Re:half billion? (Score:5, Insightful)
steps to gov project.
1. create team of 4-5 people to outline requirements
2. get team staff of 2-3 to support them
3. get place for them to work for up to 2-3 years developing requirements
4. subcontract out requirements analysis to someone
5. hire subcontractor to verify requirements analysis by the first.
6. hire gov people to oversee both contractors
7. hire people to support people overseeing subs.
8. release requirements out for public "auction"
9. review company responses to "auction" by s team of 12-20 people
10. hire crew to support 12-20 people on the responses review.
11. except bid.
12 start project.
there you have approximately 100-200 people working on just ensuring the requirements documentation and bid for 3-4 years before a project even starts. that alone could cost 200 mil or more.
they got off cheap.
Re:What else is new. (Score:4, Informative)
It's impossible to tell what the problem was until we learn more. As someone who works in government contracting, I know that it can be like pulling teeth trying to figure out WTF the government actually wants. I'm sure a typical requirements review went something like:
ScienceApps: So, what do you guys want?
FBI: You know, a case management system that does stuff.
ScienceApps: Care to elaborate?
FBI: Sorry, gotta go.
Re:What else is new. (Score:3, Informative)
ScienceApps: What does the current system do?
FBI: You know, FBI stuff. By the way, we need a detailed budget and schedule by next week.
Re:Only government work... (Score:2)
Only a government would have something that doesn't work, and still pay for it at all...
Re:Why it failed? (Score:3, Funny)
Police work Chief Wiggum style.
Peanuts compared to IRS project: $15 Billion (Score:2, Insightful)
Your tax dollars at work....
Re:How about Chloe and Adam? (Score:2)
You're right, that software kicks.
Me, I just want the real-time satellite surveillance capabilities they have. (Which aren't even possible; you would have to use a high-altitude blimp to accomplish it).