Slashdot Mirror


95% of IT Projects Not Delivered On Time

An anonymous reader wrote " The Globe and Mail reports that 'A new report conducted by market research firm Info-Tech Research Group says 95 per cent of information technology groups are not delivering some number of projects on time or to the full satisfaction of the business executive.' The article goes on to discuss the reasons for this pervasive (perceived?) problem. The article mentions Info-Tech's reasons: unrealistic time frames, staff shortages, and poorly defined project scope. However, the article's author lays the blame with vendors."

24 of 654 comments (clear)

  1. Nah by suso · · Score: 5, Insightful

    I'd say its actually closer to 100%.

    Actually, it really depends on who they would ask in a company. Whether it be

    the business executive (probably a higher estimate)
    the IT middle manager (lower estimate)
    the IT worker (who would think that they are on time)
    or the customer (who sometimes have unrealistic expectations)

    1. Re:Nah by bitchell · · Score: 5, Insightful

      In my experience when planning projects there is never ever enough testing and contigancy time.

      Managers just seem to cut it out of plans because clients don't like paying for it.

    2. Re:Nah by Nos. · · Score: 4, Insightful

      As a developer I would agree that this is where most of the time lies. Allowing 1 week for testing andf fixes for an application with > 500,000 lines of code and interoperations with 4 or 5 different systems is not adequate. If the project took 3 or 4 months (at least) to build, don't expect it to be launch read a week later.

    3. Re:Nah by Anonymous Coward · · Score: 5, Insightful

      To be real-world, just as the server (ha!) brings the coffee to your desk, you should say that you changed your mind and want tea and a poppy seed bagel.

    4. Re:Nah by aoteoroa · · Score: 4, Insightful

      Many business people think building software is like building a house. When the framing is done, it's done. You usually don't spend weeks testing how the wall interacts with the drywall and foundations.

      Non IT people just don't understand why code isn't written correctly the first time.

    5. Re:Nah by computational+super · · Score: 4, Insightful

      I think that's exactly the problem with software expectations. They always assume that building software is like building a house, or a bridge, or a toaster. In other words, they always assume that building software is done by experienced people who've built nearly identical software systems before. And, no matter how many times we stress and repeat this, we can't get it through their thick skulls - if it's been implemented in software even one time in the past, it doesn't need to be implemented again. By definition, every single software project ever undertaken is a brand new set of problems to figure out. The more experienced we are, the better we know what to avoid, in general, but if there are no unknown problems, the program doesn't need to be written. This is true by definition. Designing and implementing software is more like proving/solving a mathematical theorem than it is like building a house - I doubt mathemeticians often get paid to figure out how to prove the pythagorean theorem.

      --
      Proud neuron in the Slashdot hivemind since 2002.
  2. Understanding your art by BWJones · · Score: 5, Insightful

    95 per cent of information technology groups "are not delivering some number of projects on time or to the full satisfaction of the business executive."

    Could it be that marketing is always overselling the product? Seriously. I cannot count how many times I have heard (in the past now I am in science), "oh, yeah....well, you need to include feature X because we told customer Y we already had that feature". This is often followed up by the engineer muttering under his/her breath "Dumb jock. :-) I say that joking, but have seen discussions like this almost erupt into fist fights as the sales staff makes promises to customers that are either 1) blatantly false or 2) concepts under development and are nowhere near "production".

    So, this is another example of why pre-announcing products is a baaaaad idea. Treat your customers with honesty and announce the product when it is ready and not before. Again, this is why vaporware only serves to irritate your customers and build expectation of a product that is not always delivered.

    I also believe the fundamental problem is that managers these days (in many cases) no longer come from the ranks and are not engineers. So, they do not always understand what is involved in 1) building the codebase 2) testing code base 3) proper interface design 4) end user testing 5) documentation 6) making sure it does not suck.

    The last point is where most executives seem to get hung up. More often than not in most companies, executives really have no idea of what makes good code and all too often, what makes a good product. Come on now, a good portion of executives can barely use their personal computers to answer email or browse the Internet. When you have companies run by executives and managers that have come up through the ranks, you are much more likely to get quality which often is much more important than meeting an arbitrary deadline.

    --
    Visit Jonesblog and say hello.
    1. Re:Understanding your art by Sgt+O · · Score: 5, Insightful

      "...they do not always understand what is involved."

      - you hit the nail right on the head!

      I'm working on a project right now (software is installing as I type this) where I'm supposed to migrate an existing web server to a new datacenter accross the country.

      The PM's take on the whole thing was "All you have to do is:"

      - Load the software on the new server.
      - transfer the data
      - ship the server to the new location
      - have the server racked and powered up


      I could tell he though I was just being difficult when I told him:

      - While we're at it we should upgrade the app that's running on it since it's no longer supported.
      - If we upgrade the server will be running a different web server and therefore will need a new ssl cert.
      - Get the network guys engaged so they can punch what ever holes are needed in the firewall.
      - We'll need to do some level of testing.
      - Notify the end users that the look-n-feel will change/new applets will be downloaded, etc.

      And now, as far as upper management is concerned, I'm the one that is behind schedule...

    2. Re:Understanding your art by Phrogman · · Score: 4, Insightful

      I recall when I was working Tech Support for a company, hearing a Sales dweeb asking one of the programmers "Do you remember that utility program you mentioned to me? I hope its available because I just sold it to a customer."

      The utility program mentioned supported one of our products and was for inhouse use only. It had been whipped up quickly in the devs spare time, had no documentation, no time spent on QA, was not an official product of the company, and had a completely unfriendly UI because the dev had developed it piecemeal for his own use. Needless to say once it had been *sold* to a customer as a feature that attracted their interest enough to purchase our product, it became an official product and was quickly rewritten to be more presentable, but that developer told me he would *never* mention anything to a sales guy again because they couldn't be trusted.

      I have seen sales people sell a product based on a feature that they assured the customer the product offered, then once the phone call was done and the sale completed, checked with Tech Support to see if it actually did offer the feature they sold it based on.

      --
      "The first time I got drunk, I got married. The second time I bought a chimpanzee, after that I stayed sober" Arian Seid
  3. This just in. by Anonymous Coward · · Score: 5, Insightful

    95% of the time, the business changes their mind about the project and/or doesn't know what they want, anyway.

  4. Merge it. by mfh · · Score: 5, Insightful

    The Globe and Mail reports that 'A new report conducted by market research firm Info-Tech Research Group says 95 per cent of information technology groups are not delivering some number of projects on time or to the full satisfaction of the business executive.

    The answer to this problem is change, and isn't change always the answer?

    Consider if you will for a brief moment the vast difference between the average executive and the average programmer. Programmers are generally broad-picture thinkers who solve largely complicated problems that regular folks can't possibly wrap their heads around. The executive runs on a schedule and uses reports and correspondance to understand what is going on, because business folks have to judge their employees and projects.

    These two groups are forced to work together, and we expect good results? We need someone to interpret between these two groups! The HR department can't regularly serve in the interpretive capacity, but perhaps they should.

    Managers generally don't want to give the programmers the whole picture, because management often believes that they are superior in rank to programmers, placing the programmers on a need-to-know-basis, only. Huge mistake.

    What programmers and managers need to do is realisticly approach their solutions together. They need to be honest with each other. They need to share each other's thoughts and feelings about the subject matter. It's not happening today.

    The programmers need to come to the table and care about their customers a little more. The managers need to come to the table and care about their programmers a little more. The customers need to be more specific and realistic about how far their dollar can go. Then deadlines will be met and promises kept and successful solutions provided to customers.

    I encourage a no-holds-barred approach to project management. The superior product is developed using the Agile method.

    --
    The dangers of knowledge trigger emotional distress in human beings.
    1. Re:Merge it. by millwall · · Score: 5, Insightful

      Programmers are generally broad-picture thinkers who solve largely complicated problems that regular folks can't possibly wrap their heads around.

      Please...

      I know it's Slashdot I'm reading, but I didn't know readers had that high thoughts about themselves.

    2. Re:Merge it. by Oloryn · · Score: 4, Insightful
      Managers generally don't want to give the programmers the whole picture, because management often believes that they are superior in rank to programmers, placing the programmers on a need-to-know-basis, only. Huge mistake.

      I call this the myth (or culture) of managerial superiority. It tends to go "I'm your boss, therefore I must be smarter than you are." It's one of the reasons that some managers come to resent technical people, whose jobs require that they be smart, and who are not usually reluctant to show those smarts. Maintaining a culture of managerial superiority is difficult when your subordinates often demonstrate that they know more than you do. Too often, the result is either denigration of the subordinates knowledge (You were hired for your expertise in X, but your manager keeps on overriding you on matters relating to X, leading you to wonder "Why did they hire me if they won't pay attention to the knowledge I was hired for?"), or denigration of the importance of subordinates knowledge.

      The fact is, management requires a different set of abilities, not necessarily a superior set of abilities. Acknowledge that, and you've at least opened the door for each side to recognize the others talents and use them together.

  5. In other news by kevin_conaway · · Score: 5, Insightful

    A study shows that 95% of clients don't know what they want.

  6. This is why by nagora · · Score: 5, Insightful

    Us: We can do that for $x in 12 months.

    Customer: But Joe Bloggs says his company can do it for $x/2 in 3 weeks!

    Us: That's simply not possible.

    Customer: Well, for that sort of savings we're going to give them a try.

    11 months later and $x^2 later they're still waiting for Bloggs to finish but by then we're on the dole and Bloggs is laughing all the way to the bank.

    TWW

    --
    "Encyclopedia" is to "Wikipedia" what "Library" is to "Some people at a bus stop"
  7. If an IT department never, ever is late... by TechnoWeenie · · Score: 5, Insightful

    Then they are either padding their project plans way too much, or are really not trying to do anything new.

  8. Adding requirements by Therlin · · Score: 4, Insightful

    It doesn't matter how much time I spend in the pre-planning stage, meeting with users, coming up with all the needs and feature requests. Once the project is in progress, and specially as you start demoing it, the end users will start adding requirements that had never come up before no matter how detailed you tried to be. And of course all the "wouldn't it be nice if"s.

    Sometimes some of the new requirements or wants involve going back and rewriting a good chunk of code, or changing the DB design, etc, no matter how carefully you wrote your code and flexible the code may be.

  9. Methodologies and the lack of it by cOdEgUru · · Score: 4, Insightful

    First of all, the report focuses with Candian firms.

    Second of all, rather than delving in to the varied array of processes and methodologies prevalent in the software development arena and reviewing advantages and disadvantages of each, the report goes in lenght talking about Vendor issues. I dont have a clue why.

    Right from the Waterfall approach, or having no approach as well, we have RUP, XP and a mix of each playing itself out for the last few years. In my past projects, I have implemented each or a customized version of each and has varying levels of success. The biggest issue that I have so far seen is the lack of adequate knowledge in each methodology that someone who starts implementing any approach, either loses interest and resorts to a quick fix at which point the process starts to wither and die. More over, to some of the developers I have worked with, its not process, its documentation. CRC Cards is not a design tool, its documentation, its impediment to writing code. Much of it has to do with no academic background in best design or coding practices. They have heard of design patterns, and probably has used MVC to death, but when it comes to designing a system, its back to "lets start writing code rightaway and maybe the design will flesh out over time". The system gets built, but it suffers from Simplicity, it has very low quality.

    I have seen a lot of firms talk about having a process, they love throwing RUP in the air, but nary a project which has successfully or much less adequately implemented any sort of process. They talk about Use Cases/ User Stories, but when the project gets kickstarted, they resort to SRS documents or less. And then they forget to adequately keep them up to date. Many even have Requirements management tools like Requisite Pro which hasnt seen daylight yet. Fuck the tools, atleast have a damn process. Many dont even define success at the outset of a project, no acceptance criteria either. They end up in a deathly downward spiral towards absolute failure dragging their clients with it.

    I love XP, I love it for several reasons. Having a Client involved during all phases of the project, much less have a day to day interaction with the team is a phenomenal idea. I have had great success with this, but it becomes a bit of a problem, when the project is outsourced. No amount of communication (documents/mail/phone) can stand up to having a person next to you to tell you whats important and whats not. I love pair programming even though I could never fully implement it, when the client doesnt believe in it. I have tried pair design and have had great success. I have a few developers reviewing Test First Design and this has limited success as well. Limited, since the developers rebel, having low discipline and patience to write tests as they code. They are tutored and trained in the ways of "lets code first, maybe manually test it later and let the QA worry about it".

    I would like to hear about other's experiences as well.

  10. or by FidelCatsro · · Score: 4, Insightful

    Could be seen as 95% of IT projects not given enough time for completion by marketing

    --
    The only things certain in war are Propaganda and Death. You can never be sure which is which though
  11. Re:I remember on my first web dev by MisanthropicProgram · · Score: 5, Insightful

    This reminds me of my PM class I had.
    In a nutshell, the instructor said that the requirements, then the specs, then design, ..., then a project plan, then an end date is to be derived.
    The guy next to me who was a PM just shook his head and said, "No, the end date comes first and then we figure out how to get it done." I have had the same experience in my decade+ of experience.
    The instructor said that's why most projects fail.

  12. The Three Failures of Engineering by stlhawkeye · · Score: 5, Insightful
    In my experience, there's three major reasons why projects aren't delivered on time or to the satisfaction of the end user.

    1. Failure to Understand Business Need
    2. Gathering requirements is fine, but there's rarely a strong feedback loop between engineering and business. For example, I see requirements like this a lot: Each customer in the database will have a unique ID. This seems like a good requirement. Adding any more detail moves you into the realm of high level design, right? Well, maybe. In any case, engineering needs to ask important questions at this point. This was an actual requirement I got at a previous job. We assumed, erroneously, that this just meant that the data stream we received and processed would contain a unique ID for each customer and that it had to go into the database. The truth was that customers did not have unique IDs, the business was expecting us to engineer a technique by which to assign them one. For various reasons I won't go into, simple starting at 1 and assigning each user the next available number wasn't sufficient. This misunderstanding didn't come up until late in the project, and it took almost two weeks to understand what all had to go into the unique ID, and then engineer a process to calculate and assign the ID to each customer. It sounds like such a simple thing, but overlooking the simple things is what puts projects behind.
    3. Trying to Solve Training/Documentation Issues via Engineering
    4. There's a problem. We found a flaw in the program. If the user does X, then Y, then Z, then X again, and then Z twice, and then Y while holding down the shift key, the program behaves funny. Well, all of those functions are legitimate uses of the software, and this particular path through causes problems. Not crashes, not erroneous results, just unexpected results. Well, that's a documentation issue. Or a training issue. "What if the user goes in and manually hacks the URL and screws up our query string?" Well, then they get errors or bad results! Engineers often want to solve these problems ("take away the URL nav bar!" "But we have to support IE, Netscape 4.7, Mozilla, and 4 other browsers, plus their Macintosh and Linux versions! What a testing nightmare!") in code, but at some point it's best to accept the risk and just document the hazard. Every problem doesn't need to be solved by engineering.
    5. Scope/Requirements Creep
    6. "Johnson! Real quick, can you add a Print option to this right-click pop-up menu?" "Sure, no problem." Congratulations, you're part of the problem. Yeah it'll only take a few minutes to code it. And update documentation. And update test cases. And test it. But wait! If Print is on the pop-up menu THERE it ought to be available over HERE too! Changing code costs more time than just the few minutes you spent changing code. Pile up a dozen trivial requests and suddenly you've added hidden weeks of effort to the project.
    Join me next week as I discuss the problem with dumbing down your architecture so that you can hire morons for less money to maintain it when all your best talent gets fed up with their 2% raises and quits.
    --
    "I have never won a debate with an ignorant person." -Ali ibn Abi Talib
  13. But what about non-IT projects? by DoofusOfDeath · · Score: 4, Insightful

    How many non-IT projects are done on time?

    Let's see... Boston's Big Dig. Nope. Designing a new aircraft carrier... nope. Red Sox winning the World Series... badly delayed ;)

    I wonder if in general it's creative projects or maybe highly complex projects that suffer lousy under-estimates for completion dates. Many software projects (i.e., MS Longhorn) are both.

    On an unrelated note: I wonder how project planning estimate accuracy correlates with the experience level of the person making the estimate. Because if the IT industry tends to burn out the young people os that there are't many older IT people, that could contribute as well.

  14. Re:misleading headline by 14erCleaner · · Score: 4, Insightful

    True, but think what this implies: 5% of development groups never deliver a project that is late. Amazing...

    --
    Have you read my blog lately?
  15. Bridge not comparable to most business software by GunFodder · · Score: 4, Insightful

    What are the design constraints of a bridge? It generally solves a simply stated problem - get X lanes of traffic from point A to point B. And failure is not acceptable. Due to these constraints millions of dollars and years of planning and construction are available. This might be comparable to the Shuttle software discussed a few weeks ago, but not any projects I have worked on.

    Consider the construction of a house, or an addition to an existing domicile. Price is a significant factor, and the customer has many arbitrary constraints (call them "aesthetics"). In many cases the customer isn't sure what they want until they see what they don't want, which requires rework. There is no official certification process for most construction trades - only specialties like electrical wiring. So it is difficult to know how good a crew is until you work with them. Many (if not most) construction projects like this run over budget or over schedule.

    I think writing business software is more like building a house. The constraints are unique and vague. The workers vary in their abilities. And the customers are cheap bastards. Projects in this environment have very little chance of coming in under budget and on time.