Slashdot Mirror


Is Agile Development a Failing Concept?

Nerval's Lobster writes: Many development teams have embraced Agile as the ideal method for software development, relying on cross-functional teams and adaptive planning to see their product through to the finish line. Agile has its roots in the Agile Manifesto, the product of 17 software developers coming together in 2001 to talk over development methods. And now one of those developers, Andy Hunt, has taken to his blog to argue that Agile has some serious issues. Specifically, Hunt thinks a lot of developers out there simply aren't adaptable and curious enough to enact Agile in its ideal form. 'Agile methods ask practitioners to think, and frankly, that's a hard sell,' Hunt wrote. 'It is far more comfortable to simply follow what rules are given and claim you're 'doing it by the book.'' The blog posting offers a way to power out of the rut, however, and it centers on a method that Hunt refers to as GROWS, or Growing Real-World Oriented Working Systems. In broad strokes, GROWS sounds a lot like Agile in its most fundamental form; presumably Hunt's future postings, which promise to go into more detail, will show how it differs. If Hunt wants the new model to catch on, he may face something of an uphill battle, given Agile's popularity.

56 of 507 comments (clear)

  1. Agile. by serviscope_minor · · Score: 5, Insightful

    DNRTFA, but I think this will be a fun thread.

    Regardless of what Agile really is (a true scotsman?) the abuses perpetrated in the name of agile are appaling. I think a lot of people think agile means something like:

    make bad developers good by not bothering to organise things properly

    Which is really amazingly appealing if completely bogus.

    --
    SJW n. One who posts facts.
    1. Re:Agile. by Anonymous Coward · · Score: 5, Insightful

      ...and make good developers bad by drowning them in meaningless process (i.e. create task for every minute change, span multiple tasks if it takes too long), all while making everyone less productive by wasting time in scrum meetings taking 2 hours every day.

    2. Re:Agile. by Anonymous Coward · · Score: 5, Funny

      I'm in a "stand-up" even as I type this response. Ours are typically only 30 minutes or so. Unless, of course, our PM decides to tack on some estimation at the end, then they balloon to an hour or more. Then our QA lead tacks on a discussion of every recently-active ticket.

      Most of us just check out of it mentally and go do something else (like read /.) after our personal status update.

      And it ended as I typed that last sentence. LUNCH TIME, MUTHAFUCKAS!

    3. Re:Agile. by gstoddart · · Score: 4, Insightful

      Yeah, people put it forward as some universally awesome technique.

      Different teams, different projects, different management .. you can't simply say "yarg, teh agile" and have it work in all cases.

      You don't see most other forms of engineering or building of stuff done in an agile manner .. bridge builders do not wait to design the deck until later, car makers don't just wing it an hope they'll be able to make the parts fit.

      For rapid prototyping and some kinds of projects, sure.

      But I've seen someone try to run a distributed project using agile techniques to build a replacement for a key piece of software with very specific requirements, and which needed to work against published interfaces.

      And the end result was a project which produced a random subset of required functionality, was abysmally late, what it did do it did poorly, and then the project was cancelled. And as often as not the developers were writing the eye candy before the functionality, and adhering to the published interfaces was non-existent because the people involved decided to reinvent the wheel and decided that the existing stuff didn't matter ... because apparently the existing stuff would magically take care of itself.

      Agile is a tool in the suite of project tools ... it's not universal to all projects, it doesn't produce perfect results just for being agile, and it sometimes doesn't even produce the required results.

      Saying "we're going to keep throwing pieces at it and hope that in the end we wind up with what we were hoping for".

      Like it or not, the waterfall method of development and project management still has its place, and it always will. And, likewise, I'm sure there are teams and projects for which agile will be an awesome fit.

      And sometimes the people who decide which method to use are the least qualified to run the project -- I've seen developers insist on agile and fail to deliver anything useful, and I've seen PMs insist on waterfall and do a terrible job of managing it.

      Methodology is a tool, not a magic wand.

      --
      Lost at C:>. Found at C.
    4. Re:Agile. by Guspaz · · Score: 5, Insightful

      We limit our scrums to 15 minutes per day. If it's taking longer than that, you're doing something wrong. Your teams are too big, or your sprints are too long, or you're going into too much detail on items, etc.

    5. Re:Agile. by Penguinisto · · Score: 5, Funny

      Funny you should mention this... I actually got a lot of actual work done in the two-hour monster retrospective I sat through this morning. I just listen for my name and glance at the Kanban board occasionally to see if I come up next. :)

      Thank Heaven for wifi and laptops, is all I can say, else I'd never get anything done.

      --
      Quo usque tandem abutere, Nimbus, patientia nostra?
    6. Re:Agile. by gstoddart · · Score: 5, Interesting

      But you know, development isn't about making developers 100% happy. It's about product.

      I spent around 15 years as a developer, and now I'm closer to a PM.

      Development has to have actual goals, clear targets, and measurable outputs -- because you're either writing something specific which has to work as designed, or you're releasing a version of a product which has to fix a set of things and add a set of features. Both of these will probably have deadlines.

      The problem is when we see it as "we must keep the developers happy" or "we must keep the middle management happy".

      You're all, in theory, on the same team. If the developers have no measurable yardstick to judge their progress, or middle management collects a bunch of meaningless metrics which don't help the development process ... you're doing it wrong.

      It has long been observed that managing developers is like herding cats.

      Fundamentally what is happening is you need to ensure all of the cats get to the same place at the same time. Some cats, once they understand the goal, will plan their own route and get there in plenty of time, and will assist in getting some of the other cats there ... others need to be dragged hissing and mewling to make sure they don't go off in random directions and not show up.

      In my experience, some teams will organically manage their stuff, and others need a good swift kick in the ass.

      I've met a few developers who need to have a little friction foisted on them, or they drift a little. And some of the best managers I've known are ex coders who understand this.

      The trick is to fool the cats into forming a self organizing collective, as well as implementing ways to keep tabs on all of the cats to ensure none have gone chasing butterflies.

      The specific methodology is as dependent on which cats you have as anything else.

      --
      Lost at C:>. Found at C.
    7. Re:Agile. by the+grace+of+R'hllor · · Score: 5, Informative

      The hell? My daily standup is 2-4 minutes. Restrospective takes 15-30 minutes, subsequent planning takes another 30-45. We do weekly sprints, so you're looking at an average worst-case of averaging 19 minutes a day. Boo-fucking-hoo.

      If your standups take 2 hours, then screw that. Tell them what you did, what you're going to do, and what's blocking you. If someone wants to have a long discussion, sit back down and go to work, because the standup is apparently over. If anyone complains, tell them to take a course in scrum.

    8. Re:Agile. by angel'o'sphere · · Score: 4, Insightful

      If your Scrum meeting takes more than 30 seconds per developer, you are not doing Scrum.

      --
      Cost free eBook I read (by iBook/Kobo/Amazon/ObookO/Gutenberg etc.): "The Green Odyssey" by Philip Jose Farmer.
    9. Re:Agile. by Anonymous Coward · · Score: 4, Interesting

      Thank Heaven for wifi and laptops

      Sigh. That's why my company banned laptops from sprint planning and sprint retrospective meetings. With forty devs, it takes about six hours to score enough stories to keep all of us busy for two weeks. The retrospective, aka bitch sessions that really hurt morale, take a couple of hours. That's an entire day wasted every two weeks with nothing done. Add-in the JIRA-induced overhead, preplanning meetings, creating user stories, etc., and I think I only get to write code about ten hours a week. Agile is just too heavy of a process.

    10. Re:Agile. by tshawkins · · Score: 4, Insightful

      Scrumm meetings should never be more than 15 mins, each team member gets 2 mins to describe what they did yesterday, what they will do today, and what inpediments they have. Scrumm meetings should be just the team standing around a whiteboard. They are fast, focusec, to the point and designed to get the team synced up and problems surfaced.

      If you are spending 2 hours on a scrumm meeting/standup then you have a seriously screwed process.

    11. Re:Agile. by brix · · Score: 5, Insightful

      Well no wonder - 40 devs is way too large for a single scrum team. And both of those meetings should take place at the team level, not for everyone working on the product. Why not split into 4-5 smaller scrum teams and let the SMs and POs coordinate any inter-dependencies?

    12. Re:Agile. by tshawkins · · Score: 3, Insightful

      Standups are all about keeping the team synced up and surfacing issues preventing completion of tasks. They are so the scrum master and the team lead can do thier jobs and smoke out and remove impediments. They are not about providing management status reports, I get that data by inspecting the project burn down charts, and the bug tracker ticket reports for the sprint. Nobody writes down any minutes for standups, so they are not about management or reporting, scrumm master and tech lead may make notes do they can investigate blockages.

    13. Re:Agile. by phantomfive · · Score: 3, Insightful

      IMO if you have to meet every day, you're already doing it wrong.

      If you need something from someone, or are having a problem, there is no reason to wait until the next day to bring it up.
      If your scrum is a 'status meeting' and you also have an issue tracker (like Jira), then they are redundant.
      If you are working with someone in the same section of code, and you need to go to a meeting to find out status, you are doing something wrong.
      If you are bringing up issues in a meeting that don't relate to 90% of the people there, you are doing it wrong.

      To look at it a different way, the Linux kernel coordinates hundreds of developers perfectly well without having a daily standup. You can do that too.

      --
      "First they came for the slanderers and i said nothing."
    14. Re:Agile. by phantomfive · · Score: 4, Interesting

      A lot of companies actually sit down during their stand ups, because they last too long to stand the whole time.

      I've tried to point out the stupidity of this situation to some of these people (at least change the name!), but the irony escapes them.

      --
      "First they came for the slanderers and i said nothing."
    15. Re:Agile. by lgw · · Score: 3, Informative

      Standups are the one time you're guaranteed to catch everyone on your team, so that you can't be blocked for more than a day on anyone internal - and the scrum master should be taking note of anything external your blocked on.

      When scrums say more than "I'm on track, next" or "I'm blocked by X" or "I'm late, sorry", the only real excuse is that you're not using any issue tracking system for tasks, and so the 15 minutes standing around at least saves you the time to keep fiddling with tasks in a DB. If it takes more than 15 minutes, you should just walk away from the standup (I've done this before - it sends a strong signal once multiple people have the courage to do so).

      --
      Socialism: a lie told by totalitarians and believed by fools.
  2. Good idea, hard to implement in the real world. by grimmjeeper · · Score: 4, Insightful

    Like so many other things, it's very difficult to take an ideal theory and put it into practice in the real world. If your team really understands the ideas behind Agile and you have a good process in place to make it happen, you can have a great deal of success.

    Unfortunately, like so many other things in life, most teams don't get it right and they end up failing to some degree or another.

  3. Right conclusion, wrong reasoning. by jythie · · Score: 4, Insightful

    It is hard to take someone seriously when the argument seems to be 'my idea is brilliant! but most people are not good enough to implement it!' rather than 'hrm, maybe my idea is not the universal solution and one needs to fit the methodology to the requirements and resources involved?'

    1. Re:Right conclusion, wrong reasoning. by grimmjeeper · · Score: 4, Insightful

      But is that really the case? I mean, I've seen some projects that are nothing more than "chuck whatever $#!t compiles over the wall every Friday" but claiming to be "Agile". There is no disguising the fact that they took the name and didn't even bother to try to learn what Agile is all about. Is that really a failure of the idea of Agile or just a crap company giving Agile a bad name?

    2. Re:Right conclusion, wrong reasoning. by HornWumpus · · Score: 4, Interesting

      From where I've sat Agile just looks like 'weekly iterative waterfall; skimp on testing'.

      --
      John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
    3. Re:Right conclusion, wrong reasoning. by rilister · · Score: 5, Interesting

      Funny thing is that the original 'AGILE Manifesto' wasn't 'theory' or even a methodology: it was really a set of observations on what did and didn't work for them.
      I think the 'universal solution' aspect of AGILE is let your smartest people work the way that they find most efficient - trust your (best) people. Many of the core concepts are not revolutionary: don't get bogged down in planning, work in small teams, prepare to adapt rapidly when your spec cannot be fixed.

      The AGILE guys were inspired by the obvious wastefulness and inefficiency of the big enterprise software projects they had been on, so to that extent their observations were dead accurate. But now people are acting as though the *specific methodology* that's grown up around it is precious, holy and applies to everything, everywhere.

      It's exactly like the scene in 'The Life of Brian; where Brian loses his shoe running from the crowd: one guy argues that they should all hold one shoe in the air, and the other guy wants to gather shoes together. The shoe is not the point (SCRUMS, Pair programming, backlogs), it is the idea of working intelligently.

      --
      'This writing business. Pencils and what-not. Over-rated if you ask me. Silly stuff. Nothing in it' - Eeyore
  4. Re:No. by serviscope_minor · · Score: 4, Interesting

    Yes.

    --
    SJW n. One who posts facts.
  5. Re:Is Agile Development a Failing Concept? by Anonymous Coward · · Score: 5, Insightful

    No, it's just no longer selling as many books and consulting hours as it once did--so it's time to invent a new scam.

  6. All development methods are flawed by Murdoch5 · · Score: 5, Insightful

    There is no way to optimize the development process for software. Inserting terms such as "Agile" or "Waterfall" really just create bloat and waste time. The best software development process is to have no process and work in the way that fits you best. For instance when I write large software projects, I just start coding, I pick a place to start at and go. I wait until I have large testable blocks completed and then debug and integrate them. I don't follow and form of standard development process and yet have never been held up via a deadline of meeting request.

    When developers try and add those stupid terms, they're basically saying that they can't self manage and instead of taking responsibility, they're going to throw silly management methods around in an attempt to streamline a task which is unique to each individual developer and situation.

    The only things you need to write good code are the right language, the right platform and proper requirements. Once you have those, you can just start and work to completion.

  7. My .$02 by geeper · · Score: 3, Insightful

    Our development and project management groups (~ 50 people) moved from waterfall to scrum/agile 2 years ago. Since then, we have seen a significant increase in quality and velocity. It is also more comfortable for the devs on the teams because they know exactly what the PM process will be and what is expected. I don't know that Scrum/Agile is the best practice out there but in our case, it has brought increased productivity, higher product quality, less worry and overall comfort with all our processes.

    --
    Error reading device 'Signature'. (A)bort, (R)etry, (F)ail?
    1. Re:My .$02 by cjjjer · · Score: 4, Insightful

      It only works when everyone is on board and willing to keep working on it. Right now I work on a large project that started Agile but the only thing Agile about is the velocity they want out of us while throwing away the rest.

  8. Yes by JohnFen · · Score: 4, Insightful

    Agile started failing pretty much as soon as it met the real world. I disagree with Andy Hunt's explanation of why, though. It's not because "thinking is hard", it's mostly because of two things: management not allowing agile to be done correctly, and (from the developer's point of view) it drains software engineering of the things that make it a satisfying and enjoyable activity, turning it into the software equivalent of grunt factory work.

  9. It's only been 14 years... by under_score · · Score: 5, Insightful

    That's not even close to enough time for a major cultural change to take place. The Agile Manifesto describes a culture of work that is so fundamentally different from how work was (and still is) performed, that I expect it will take another 15 to 30 years for organizations to really "get it". This is the same thing that happened with Lean manufacturing. Toyota developed it, other manufacturers adopted it as a fad over the course of about 15 years, and then it declined in popularity... but it never died out because it was "correct" and "good". Now, 40 years later, most manufacturers are still learning to be lean, but lean has fundamentally changed the culture of manufacturing. I have clients that will probably be working to adopt Agile methods over a 10 to 20 year period. Agile hasn't failed... Andy Hunt's patience has failed.

  10. Re: Is Agile Development a Failing Concept? by IMightB · · Score: 4, Insightful

    I'll dub thee DevOps

  11. Re:No. by Anonymous Coward · · Score: 5, Funny

    No.

    But it'll be yes again by the time of the next scrum.

  12. Re:No. by ShanghaiBill · · Score: 4, Insightful

    Agile is not failing because there is nothing to replace it. Are we going to go back to Waterfall? Software development is inherently hard. No methodology is going to make it easy. But Agile works better than any other methodology that I have used, even when implemented piecemeal, by mediocre programmers, rather than in its "ideal form".

    Ideas should be judged against their real world alternatives, not some perfect ideal. For Agile, there are no better alternatives. GROWS (whatever that is) may be an alternative, but it is untested, and looks like just an incoherent pile of buzz words.

  13. Re:No. by JohnFen · · Score: 4, Interesting

    Are we going to go back to Waterfall?

    In my experience, that would be greatly preferable to Agile.

    But Agile works better than any other methodology that I have used, even when implemented piecemeal, by mediocre programmers, rather than in its "ideal form".

    My experience is just the opposite: agile is very nearly the worst of the methodologies I've used. The one great thing about it is something that can be done in any methodology: increased communications. We can throw out the bathwater and keep that baby.

  14. Re:No. by BradMajors · · Score: 4, Informative

    There are more choices than just Agile and Waterfall.

  15. Re:No. by CreatureComfort · · Score: 5, Interesting

    I've got to agree with JohnFen. As a Program Manager, while Waterfall techniques could frequently end up with late or over budget, or both, projects, at the end of every project (I oversaw 5 multimillion dollar projects using Waterfall methods) we at least had a working application that met the original specifications.

    Now, after two similarly sized Agile projects, all I can say is it seems to be an excuse for developers to skip QA/QC procedures "because we're already into the next scrum" and end up with a mess that doesn't come close to matching the original specification at the end blaming changing requirements and "developmental issues" during the scrum process. I just turned down a contract that explicitly required Agile coding because I don't have any confidence that the end user will be satisfied with the results.

    --
    "Unheard of means only it's undreamed of yet,
    Impossible means not yet done." ~~ Julia Ecklar
  16. love/hate view on agile by prgrmr · · Score: 3, Insightful

    As a system admin, I admire agile for the rapid proto-typing. Because as we all know, business users seldom know what they really want, but they all know what they don't like. However, I hate agile for being the universal excuse for turning project management into an exercise for "let's make it up as we go along", because then everyone expects me to work like that too. They don't want to acknowledge, let alone understand, that being a good system admin is about being organized and informed and having a more than 5 minute attention span.

  17. Certainly Not by careysub · · Score: 3, Insightful

    Iterative, incremental development - the core of agile - has been around at least since Barry Boehm described the "spiral model" of development in 1986, and has been successfully used for nigh upon 30 years since under various monickers (and I'll bet there were practitioners before Boehm's paper).

    "Agile" has matured and developed a lot of inter-related supporting practices and tools that have made it increasingly powerful and easy to implement. Continuous integration, test-driven development, use of "stories" as a tool for requirements definition, you cannot tell me these techniques and tools are not successful.

    I have personally seen the development practices of a company dramatically transformed for the better by having an agile trainer brought in and training the entire staff, including managers, and instituting formal agile practices. It is great when a junior developer can tell the VP of marketing to take a hike because his request has not been submitted through the grooming and priority assignment process.

    This one experience gives me complete confidence that people mocking agile simply do not know what they are talking about.

    One problem agile does have is with zealots who don't understand that this is, and has to be, a collection of related practices that must be tailored to the needs of the environment, not a one-size-fits-all, all-or-nothing thing. Another problem is thinking that "form" is what is important, not "what is happening".

    For example: holding stand-ups is not agile. It is a common, useful tool to use in an agile environment. If your team is coordinating with informal sessions as needed, Skype, chat tools, and an updated Wiki in real time, and the managers are keeping in the loop using these tools, then maybe a stand-up is a waste of time for you. I think most teams benefit, but design and planning is not part of a stand-up, other meetings are needed for these.

    There can be long-term planning that does not follow the agile model, and can be described as water-fall, and this has its place too. But I think the only really successful development practices are variants of an "agile" type process.

    --
    Starships were meant to fly, Hands up and touch the sky - Nicky Minaj
  18. Re:No. by Kazoo+the+Clown · · Score: 5, Interesting

    I also have to agree but for different reasons. What I've experienced is Agile as excuse for micromanagement. Projects take much longer than they used to because we now agonize in meeting after meeting over details that used to be left to the developer to decide. Agile is a recipe for managing programmers fresh out of college perhaps, but most I work with aren't those, and they work better when you trust them with more of the detais and have management worry about the bigger pictures instead...

  19. Re:No. by thedavidcathey · · Score: 5, Insightful

    Skip QA/QC procedures? Then you're not Done. That means you've completed 0 stories and get to finish them on your next Sprint.

  20. Re:No. by tshawkins · · Score: 3, Informative

    Waterfall just cannot work.

    1. All the descions are taken at the time you know the least about the outcome, ie at the begining.

    2. By the time you get to the end your requirements are out of date, you get the product you wanted at the start of the project not the one you need now. If you try to support requirement change all you end up doing is replanning and pushing back delivery.,

    3. It was a failed methodology from the start, the original paper that started waterfall was an example of how not to write software

    https://pragtob.wordpress.com/...

  21. The problem is not methodology... by erp_consultant · · Score: 5, Insightful

    it's management. When you get a good project manager its like a breath of fresh air. The best PM I ever worked for was a guy that used to be a developer and just didn't understand object based programming, after an honest assessment, so he decided to go into project management. He shielded us from all the corporate BS and just let us code.

    Most of the other PM's I have worked for have no background in programming. Some of them claimed to and didn't, which is much worse than someone that just tells you they don't. They would insist on idiotic exchanges like the following:

    PM: How long will it take to code this?
    Me: I'm not sure until I get all of the requirements
    PM: Can you give it a guess?
    Me: Sure but what's the point? It won't be a very good guess.
    PM: That's OK I just need something to put on the project plan
    Me: *Bullshit radar is now on full alert* So you just want me to pull something out of my ass so that you can finish up your project plan? Is that it?
    PM: Umm, well, no...it's not like that
    Me: OK, fine. I'll give you numbers but they are going to be grossly inflated to account for the unknowns. It covers my ass. Kind of like what you are doing, no?
    PM: *Grunts and walks away*

    Most of these people look at project management as if we were building widgets on an assembly line. As if we know exactly how long each task is going to take. Well, software development is not not like that. Not in the least. The ones that understand that - the ones that are truly "Agile" as it were - are the successful ones. The successful ones understand that any number of things can go wrong and plan accordingly.

  22. Agile is like ITIL by ErichTheRed · · Score: 3, Insightful

    I do systems engineering work for a professional services/software company. Development is fully Agile with a capital A, whether or not it makes sense for a particular project. On the systems side of the house, we have another particular religion called ITIL which lots of companies have jumped into with both feet. The problem with both of these concepts is that they are adhered to, almost to a comical level, even if it's painfully obvious that parts of it don't fit.

    Adhering to all of ITIL, for example, is a really good way to ensure your production systems almost never change. The number of people and sheer volume of paperwork, tickets and meetings to get anything even scheduled for a change in a "true ITIL" system is beyond insane. The same goes for incident management -- we have so many single-task focused "resolver groups" that I have no idea how anyone knows how any of our systems operate end-to-end. ITIL is great for mainframe systems, safety sensitive stuff, and networks which never change.

    "True Agile" and "True Waterfall" are opposite ends of the spectrum. Agile gets you very fast development, at the expense of pinning down any sort of architecture in the beginning. Waterfall often results in software you have to throw away because the requirements change out from under you. However, there are some things that require at least some discipline, both in systems and development. No systems guy would ever advocate just logging in and making random changes on a production system to see what happens. No smart developer/architect charged with writing something that underpins tons and tons of other things would advocate swapping out the core components without at least some backward compatibility thrown in. The prpblem is that "gurus" make their money selling management on these methods. In the case of both Agile and ITIL, it's a manager's dream -- everyone becomes a replaceable unit and business requests can get promoted to production in one Sprint.

  23. Re:No. by Phoenix+Rising · · Score: 4, Interesting

    DING!

    If by saying QA/QC isn't completed you mean that unit and functional testing is missing, then the developer is not done. If you have problems with the developer not writing these tests, then be sure that "Definition of Done" includes some acceptable target level of unit/functional testing.

    If on the other hand you get to the end of a story and accept it only to find out that it doesn't meet your QA standards, then you as a product manager haven't done your job in properly validating the story prior to acceptance; add to your own procedures the time required to properly validate the story for acceptance. Maybe you need a testing resource to do this if you are overworked as a product manager - an assistant product manager, even.

    Agile is as good as you make it.

    --
    Let us live so that when we come to die, even the undertaker will be sorry -- Mark Twain
  24. Agile was always a scam. by engineerErrant · · Score: 3, Insightful

    Why would anyone take something seriously that was created and peddled by consulting outfits at $700-per-hour bill rates? I had the misfortune of being incarcerated at Pivotal Labs for a month by a misguided boss who thought their bizarre religion was the answer to all of life's ills. Boy, was that eye-opening.

    As many people rightly point out, that doesn't mean we can't pick up some new ideas from it - my company now does short daily meetings and have a chart with everyone's daily tasking on it, and those have proven very effective. But the other 99% of what the Snowbird 17 vomited forth upon our industry is empty zealotry and jingoism. It was like Scientology right in our codebases, and worked about as well. And no, for god's sake, it wasn't because we just weren't doing it well enough.

    We do have shockingly dramatic quality issues in the software industry, but they will never be addressed by the next dumb-ass management fad. We need to sit down and re-think the ways that we learn to code, get serious about "Software Engineering" degrees in our colleges, and let go of fetishized code patterns as the primary unit of engineering ability. In my own experience, we know plenty enough design patterns, but almost no one understands how to exercise coding judgment in the context of a team or long-term project.

  25. Re:No. by JohnFen · · Score: 4, Interesting

    None of those are failings of waterfall at all. There is nothing about waterfall that requires you to make ironclad decisions at the very start, and there is nothing that prevents you from adapting the course of development as the project proceeds.

    In other words, you aren't describing waterfall in your comment. Yes, I'm invoking the "No True Scotsman" fallacy, since that is usually what is invoked when Agile is criticized.

    The real truth is that all methodologies can be done well or poorly, including waterfall and agile. The difference that I've seen in practice is that it's incredibly hard to implement Agile correctly (such that I've never seen it done), but implementing waterfall correctly is not a huge chore.

  26. It can't fail by swamp+boy · · Score: 3, Insightful

    It can't fail cause all of the critics are doing it wrong.

  27. You can thank "process improvement" consultancies. by javabandit · · Score: 4, Interesting

    At its inception, the Agile manifesto was simple. Four priority/value statements and then a list of simple principles. The goal? Merely to say that delivering value to the customer, collaborating with customers, frequent delivery and feedback, and team empowerment are the way to deliver software. Focus on delivering value. Don't focus on delivering things that aren't valuable. Very simple.

    Once Agile values started to become embraced and a couple of new development processes came along (SCRUM, etc), you all of a sudden had a bunch of consulting companies and community meetups appear that all but destroyed the perception of Agile. For these companies and community groups, it's all about the process. They will teach you how to "do agile". They will provide you with bodies/contractors who can "do agile". They will sell you certifications which show you "do agile". They will sell you seminars and training on how to "do agile". They will sell you software which "does agile". Agile has went from a basic set of values to becoming a fundamentalist religion.

    So my statement to "Agile Process Improvement" firms is this: You are all just scammers and profiteers. You are software development Pharisees. It is amazing that you focus on profiting from creating processes, enforcing processes, teaching processes, and writing process software... for a methodology where the first value statement is "Individuals and interactions over processes and tools". Why don't you guys teach REAL agile? Why don't you teach companies how to better define value and deliver it to customers instead of selling new processes, fundamentalism, and bodies?

    For the rest of you, if you want to be "Agile". Read the Agile manifesto. Create your own process that suits your team and your business. Work continuously with your customers to understand what is valuable to them. Deliver good value to them often and get their feedback. Allow your team to learn and grow and understand the needs of the customer. THAT is Agile. THAT is all you need to do.

  28. Agile Oxymoron by Loconut1389 · · Score: 3, Informative

    I always find it funny for something named Agile and aimed at being responsive to needs that people are so "by the book" about it. I find it oxymoronic that there's "one true way" to do something called Agile.

    Some employers are so by the book that they have to have a physical whiteboard with postits even though they also have to have jira and keep both those in sync. The purist agile says no remoting- face to face only, which I think is incorrect- I think "some kind of verbal or visual chat" is sufficient, but the key is communication beyond say hipchat and jira and email.

    Some employers claim to be really purist about it and yet depart in significant ways. I think a lot of employers also use Agile as a way to squeeze long hours out of devs at the end of every sprint even though "purist" agile says 40 hour work week.

    I generally like agile and it took a while for me to understand that MVP doesn't mean do the bare minimum for the sake of doing the bare minimum but with the idea you get it to the customer for feedback sooner and you iterate.

  29. Re:No. by shmlco · · Score: 4, Insightful

    Agreed. Too many companies use the Agile "be flexible" rule as a carte blanche, get-out-of-jail free card.

    They pick and choose what parts they're going to do, which parts they're going to ignore, and which parts to which they're just going to pay lip service, and call the end result "agile". They don't understand how each part reinforces the other, and as such pick and choose among practices and ceremonies, and tell one another that they're being "flexible".

    Failure is usually with implementation, not with Agile.

    --
    Any sect, cult, or religion will legislate its creed into law if it acquires the political power to do so.
  30. Re:Yes by Cederic · · Score: 3, Insightful

    it drains software engineering of the things that make it a satisfying and enjoyable activity, turning it into the software equivalent of grunt factory work

    I'm confused. The satisfaction and joy of software engineering is turning a problem into a working solution.

    The agile methods I followed let me realise that joy multiple times a day - checking in working code, and see it pass the automated test bed on the build server.

    What is it that you perceive to be satisfying and enjoyable, and how are you losing that?

  31. Re:No. by Darinbob · · Score: 4, Insightful

    Agile is failing in some areas, surviving in others. One snag is that Agile is a cult, pure and simple. If you vehemently disagree, then perhaps consider that you may be a cultist.

    And the Agile cultists also believe there are only two world views: Agile versus Waterfall. Which is ridiculous, because the vast majority of developers use neither and instead have a hybrid approach from many different modesl including some ad-hoc methods. I know people who work as contractors who've said every single company they've been at use a different method, even those who claim to use Agile all use it in extremely different ways. When you are told essentially "do you really want to go back to Waterfall" then you know you're talking to a cultist.

    Agile is pushed by its promoters as ideal for all types of projects. It does work well in some sorts of projects, where everything can be divided into tiny one or two week chunks, but it fails horribly where you need months of work for some features and lots of upfront design with large teams that need to coordinate. For example, taking an existing web design and maintaining it is easy with Agile, but designing an entire product from scratch, including hardware, software, and services will find Agile to be a frustration. What I have seen happen a lot is that there's a lot of old style design behind the scenes by the designers but then Agile is used up-front by the coders; each sprint picks out portions of the grand plan to work on, features are split into tiny two week slivers and so forth.

    Don't forget the Agile industry here too. People whose high paying jobs are to teach Agile, to facilitate Agile, to be paid scrumm masters rather than developers, and so forth. I've seen no other development style that involves so many paid outsiders, most of whom are evangelists.

    Of course there are good things with Agile but failing to acknowledge the bad things is not being objective.

    Right now I'm on sprint number 10 for my feature. I get pressure to finish up the feature, but then at the same time there is pressure to stop working on it and instead deal with the unexpected emergencies. At the start I thought it was simpler than it really was and my design (which took longer than a sprint to think up) turned out to have flaws. It's embedded so the whole continual testing thing is extremely difficult, you can't put in unit tests when you don't even have enough memory to fit in the basics. And ideally, that two week sprint really should be 3 days of implementation only so that you have time for all the documentation, testing, handoff, training, integration, figuring out the obscure parts that come with no documentation, etc.

    The ultimate thing that Agile is doing for me is making me work longer hours than I ever have in my life. That's the goal I think, it's why managers love it. Ie, I have to give a two week estimate of what I can get done. Now I feel personally responsible to get things done. The deadline is no longer an external deadline by people unfamiliar with what needs to be done but instead it is a self-imposed deadline. And self-imposed means I want to get it done so that I don't look foolish. Other people are waiting for it to be done so that they can do their part. If I do ask for more time I get glared at. And what happens now is that there is a deadline EVERY TWO WEEKS. It is ALWAYS crunch time! And there is still behind the scenes the high level deadline from the executives that can not slip.

  32. Re:No. by skelly33 · · Score: 3, Interesting

    My organization accounts for QA/QC with the definition of "done"; QA is not a second class citizen of the organization, but rather a crucial part of the development team/process - and the story is not DONE until QA says it is. Therefore it rolls over across iteration boundaries as needed, and is only demo'ed when it is done.

    The problem we have had with Agile thus far seems to be our inability to produce accurate estimates without doing Big Design Up Front which ultimately means spiking every story before we can get started. Nearly every time we try to shoot from the hip on story estimation for anything moderately complex (or worse), we have missed by several multiples the actual amount of work needed.

    This is mainly due to the product being very complex (think enterprise scale SaaS, tens of millions of users, terabytes of data, complex data modeling, and numerous technologies being adapted with a variety of API/interfacing solutions) with many interconnected systems across multiple data centers and cloud services... you just can't stare at a story in the backlog and come up with a meaningful estimate off the top of your head no matter how well defined the acceptance criteria are because no one person knows what the potential impact is to all those systems.

    But we're committed to working on improving our processes, cross-training, and reduction of overall system complexity to eventually be able to do just that and are sticking with Agile because it has forced us to take smaller bites which has really been a challenge for our sales/marketing and product owner teams because they want the world and they want it yesterday... and Agile empowers the scrum team to give them a reality check and say no.

    I apologize for the run-on sentences... too lazy to edit at the moment.

  33. Re:No. by Gr8Apes · · Score: 5, Insightful

    Waterfall just cannot work.

    You might want to talk to NASA and tell them all their missions have failed.

    1. All the descions are taken at the time you know the least about the outcome, ie at the begining.

    You know what that's a sign of? Failure to specify your requirements. (Something Agile people know so little of these days it's unsurprising they should be banned from programming)

    2. By the time you get to the end your requirements are out of date, you get the product you wanted at the start of the project not the one you need now.

    I need what I specified. If I need something else now, I should have added on more requirements. In fact, at the start of the project I should have added in an allowance that just maybe I will need to change something, or a dependency in the project may shift in time or not meet its capabilities. BTW, for you Agile people, this is where the Project Manager usually does his work. If they're managing which requirement you're coding and how, he's not doing his job.

    If you try to support requirement change all you end up doing is replanning and pushing back delivery.,

    If I was originally scheduled to make a simple sort in an adequate time period and then need to add in a complex multi-layered sort, um, yeah? What makes you think changed requirements wind up being deliverable in the same time frame? What vacuum do you live in? Are there pink ponies there too?

    3. It was a failed methodology from the start, the original paper that started waterfall was an example of how not to write software

    https://pragtob.wordpress.com/...

    Again, I guess you better let all gov agencies know that all their projects involving software prior to 2005 or so failed. Guess that moon landing really was on a stage somewhere.

    Having been exposed to a number of Agile projects that all ran over budget, schedule and/or failed, I can truthfully say Agile itself was the cause. I've detailed some of those elsewhere, and the response from the believers is always "Oh, you're doing it wrong" which is hilarious, because in multiple cases they were following exactly what little is laid out by the Agile camp. The real truth is that there are developers of different skills, and there are some that excel in specific areas while the rest plod along, and they are not interchangeable like Agile states they are unless you're going LCD. In fact, if you estimate your "velocity" by your worst performing programmer on an Agile team, you may, just may, have a realistic estimate of when you'll supposedly get to the finish line as long as no one throws any new requirements your way. As soon as they do, everything you think you know just went away. Sorry, my next SCRUM is pulling me out of this one...

    --
    The cesspool just got a check and balance.
  34. Re:You can thank "process improvement" consultanci by phantomfive · · Score: 3, Informative

    Once Agile values started to become embraced and a couple of new development processes came along (SCRUM, etc)

    That's a nice thought, but SCRUM actually predates Agile by half a decade. SCRUM was introduced ~1995, and Agile ~2001.

    Though the actual Agile techniques are much, much older. Reading the Mythical Man Month can convince you of that.

    --
    "First they came for the slanderers and i said nothing."
  35. Re:No. by Darinbob · · Score: 3, Insightful

    Why "waterfall"? Why is every Agile evangelist so uptight about "waterfall", do they honestly think that there are only two possible methodologies in the world?

  36. Re:No. by Dastardly · · Score: 4, Insightful

    That is exactly what happens. And, some of the leaders in the field have realized that a lot of what is called Agile (Poppendiek, Larman, Vodde, Leffingwell) are essentially implementations of Lean Product Development from Toyota to Software Development. What often happens is that, like Lean in manufacturing, organizations take up some of the forms of Lean/Agile while completely missing the fundamentals and the culture. That is key. If you don't realize that Agile or Lean are an organizational culture change not a set of practices that are a silver bullet what you end up doing is slapping Lean or Agile onto a dysfunctional culture. And, one of the things that many Agile practices will expose very quickly is all of the dysfunctions and waste built into an organization.

    Consider the poster who complained about QA/QC being ignored. What was happening in waterfall was the exact same thing, but the long QA/QC cycle was hiding the fact that the developers were producing crap. Actually, calling it QA/QC was a misnomer, it was actually finish all the stuff we half-assed during the development phase. Oh and what management thought they would get from Agile was that they could knock out QA/QC and get the same work done in the same time that would have been allocated for the development phase in waterfall. So, the same schedule pressures that forced developers to take short cuts in waterfall never went away, and the result is that the same shortcuts happened without the QA/QC phase to fix them. And, was there a retrospective or root cause analysis or empowerment of individuals to pull the stop cord on the train to correct these issues that were exposed. Of course not because if you stop you will miss the schedule and that cannot happen, etc.. etc... Slapping Agile practices onto a dysfunctional organization does not fix the dysfunction. Culture changes take years, especially in larger organizations when there is not the top to bottom commitment to changing the entire organization.

    There is also the problem of "flexible" translating to "without discipline". My experience is that Agile and Lean requires a level of discipline far beyond typical waterfall. The waterfall processes often require the facade of discipline, but rarely actual discipline especially at the individual level. And, when discipline is attempted on individuals it usually has more to do with imposing additional process and reporting that does not contribute to actually delivering results. Which is exactly the same thing another poster complains about where Agile gets used to micro-manage daily tasks. Which is another example of missing the point, daily tasks and a daily meeting is to free PMs and Managers from micro-managing holding each person accountable for accomplishing something each day. I call it peer pressure accountability because other than sociopaths most people don't want to be the guy who tells their team mates that they did not do what they said they would do yesterday, or did some ridiculously trivial task while some one else did something significant.

    In some cases Agile shouldn't be used, but those are generally caused by external forces like being in an inflexible contract situation. In that case, I advise the philosophy of "Don't lie to yourself." Instead understand your constraints and realize a lot of the practices used by Agile and Lean organizations are almost universally beneficial. Automated testing and continuous integration are a good idea regardless. Splitting work into small chunks and working on a cadence (takt time) can be beneficial locally even though globally you are still producing tons of WIP. And, so on and so forth...

  37. Re:No. by AqD · · Score: 3, Insightful

    Ridiculous. Maybe in stupid-ass punch-the-monkey dev shops writing web-based crap no one will care about in 6 months. There are plenty of industries where this is nonsense.

    In international finance, some country decides on a new law (usually a new regulation). The software therefore must change.

    Is the law going to change again this year? No.
    Is the development cycle less than a year? Yes.
    Is the development cycle longer than a fucking sprint? Yes.

    Waterfall will work just FINE.

    I had a small project which despite meet the deadline has took more than double of expected work hours.

    Did I know I have to evaluate and change underlying platform 3 times so it could work with other dependencies flawlessly? No.
    Did I know I have to write part of DB driver because some thing that has been in DB for years isn't supported in its official driver? No.
    Did I know I have to dig into source code of dependent libraries and fix their bugs and even change part of their architecture to meet performance requirement? No.

    See? None of these involves requirement changing. How you can do waterfall in large projects worth millions is beyond my imagination...