Slashdot Mirror


Agile Software Development with Scrum

bADlOGIN writes "Anyone and everyone on Slashdot probably knows that business-driven software development efforts all too often end up as a mess. After a number of years of observation, research, and fine tuning, Ken Schwaber and Mike Beedle have released a book that makes a subtle but vital revelation about the nature of software projects and how to better run them. Learning what Scrum is and how to practice it is not all that profound. However, sitting back and realizing why Scrum works and how it addresses the fundamental flaws of the last 20 years of software engineering is. This book could be viewed as the "why" component to all of Extreme Programming's "how." Agile Software Development with Scrum author Ken Schwaber and Mike Beedle pages 158 publisher Prentice Hall rating 9/10 reviewer bADlOGIN ISBN 0130676349 summary This book could be viewed as the Why component to all of Extreme Programming's Hows. It explains managing software development as an empirical process.

What it's all about:

Books that claim to hold the keys to developing software the right way are most often: a) a dime a dozen, b) self-serving vendor drivel, or c) all of the above. While this book is fairly new on the shelf (Copyright October 2001), it has a level of research, professionalism, and effort towards being tool- and language-agnostic that may place it in a fourth category of being: d) none of the above. Agile Software Development with Scrum is a complete picture of the Scrum process from theory to practice in real life examples. The name Scrum was chosen because the process is similar in nature to rugby play where success is built upon being quick, adaptive, and self-organizing. The target audience for the book is "executives, software managers, project leaders, and programmers." While the authors make no assumptions directly, being familiar with Extreme Programming, "classic" waterfall methodology, and having hands-on experience with the chaos of software development is indeed helpful.

The primary theme of the book is simple, but the impact is profound: software development is an empirical rather than a defined process. That's a nice big sweeping claim to make: fortunately, the authors spends a lot of time making sure that you as the reader understand what they mean by the statement and that they're serious about it. Comparisons to other empirical processes are illustrated with examples of changing, complex problems. The authors seek out and provide unique insights from process dynamics experts on the nature of empirical versus defined processes, and cite profound supporting work regarding the limitations of algorithms in complex systems with external inputs (e.g. Wegner's Lemma).

Along with a good dose of theory, there is a generous helping of practice and how-to. Agile Software Development with Scrum covers the basic practices and concepts needed to manage software development in an empirical fashion. The authors do a good job of addressing the classic "but what about..." questions on the spot in a conversational manner and include anecdotes throughout to make specific points and include full process examples towards the end.

What's good about the book?

Scrum is the missing "why" to Extreme Programming's "how." By it's nature, Extreme Programming incorporates all of Scrum's spirit, and vice versa. This book has a foundation of ideas and an explanation of what it takes to seriously improve the state of the practice of software engineering. The order is reasonable, and the depth of information should give any determined individual the ammo they need to make a change in how software is developed in their current job or their next.

What could have been better? There are only three things worth mentioning for improvement, all of which could be easily done. First, there were occasional typographical and formatting errors -- places where indentation, capitalization, or bullets were missing broke the flow. Second, the graphics in more than one section were blocky, low resolution circa 1987. And last, the $30.95 list price was a bit steep for 158 pages. It should be noted that the typographical and graphics issues were the only thing that prevented me from rating this 10 out of 10.

Summary In my opinion, this book has been needed for a long time. The issues and failures of defined processes such as the "classic" waterfall methodology can't be set aside until there is an approach that can justify itself both in theory and in practice to replace it. Extreme Programming has gained much attention, but tends to depend too much on the fact that "it works because it works." Scrum gives you a way to fix your development efforts without as much culture shock or risk. It's worth considering implementing before your competition does.

You can purchase Agile Software Development with Scrum from bn.com. Slashdot welcomes readers' book reviews -- to see your own review here, read the book review guidelines, then visit the submission page.

22 of 168 comments (clear)

  1. What is Scrum? by Anonymous Coward · · Score: 5, Informative
  2. sounds interesting... by f00zbll · · Score: 3, Insightful

    might be worth a purchase, but still not completely sold. self-organizing is nice when engineers on the team understand the reality that organizing with other team members is good thing. It still doesn't help when one member of a team doesn't listen to anyone and ends up rewriting their code 5-6 times.

    1. Re:sounds interesting... by PincheGab · · Score: 4, Insightful
      It still doesn't help when one member of a team doesn't listen to anyone

      In that case, no development methodology will work. The best methodology to follow is to send the team (non)member home.

  3. For the life of me by Bob+Abooey · · Score: 4, Insightful

    I can't help but think all this is just one giant mind fuck. The IT industry is such a volatile industry that seems to love to be lead around by the nose and is greatly influenced by the flavour of the month.

    Why not try to take a look at some of the long time methods used by engineering industries to see how they go about designing bridges and cars and stuff like? Do you think that GM people stand around and talk about Extreme Engineering for their engineers who design high tech engines?

    --

    All the best,
    --Bob

    1. Re:For the life of me by Linux+Ate+My+Dog! · · Score: 5, Insightful

      Why not try to take a look at some of the long time methods used by engineering industries to see how they go about designing bridges and cars and stuff like?

      I live in Boston, home of the Big Dig. Right now is not the best time to impress me with construction as a model for controllable effective on-time on-budget engineering of large-scale projects.

      In fact, we get to hear this a lot as software engineers "Look at construction! They got it right!" Well, of all big construction projects I remember (Betuwe tunnels in the Netherlands, Stopera in Amsterdam, Big Dig in Boston) went into time and costs overruns, often by 100 to 400% on either variable.

      And then there is my bathroom which I had remodelled a year ago, and the stories of my hoemwoner friends who did the same. On time? On budget? Don't make me laugh. Go do the rounds among people who have had remodelling done: horror story after horror story. Construction people were like software engineers in the dot-com boom: flooded with offers, so they would overbook and the customer who complained loudest would get his project done. Many sub-teams (projects, tilers) did and do not communicate, project leads are at the mercy of the scheduling of the sub-contractors, the quality os not standardised at all but incredibly variable so you have to get "lucky" with who has a slot free to do the work on your project, many of the people are overworked or "self-medicated" to deal with their stress and the conditions of labor.

      I bought the whole "Look at construction!" mantra, and then I actually looked at how construction was done. These guys wing it as much as we do for the small projects, and when they can't wing it for the big ones, major shit happens like on our projects. And the old COBOL software is still running after 40 years and will keep running as long as the environment doesn't change, just like bridges stay up for decades as long as the environment doesn't radically change.

      Do you think that GM people stand around and talk about Extreme Engineering for their engineers who design high tech engines?

      Actually, yes, these people are constantly re-evaluating their process because their time-to-market requirements are constantly getting tighter and tighter. Just read Business Week for six months and follow the changes in the auto industry through their articles: they are all about faster, faster, and listen-to-the-customer constant process-reengineering, with CEO ans design heads being hired and fired depending on how well they can make theri human- and machine-assembly-lines line up and fire.

    2. Re:For the life of me by Furry+Ice · · Score: 5, Insightful
      Do you think that this has never been thought of? This is how software development started. It was abandoned because it does not work. Much of the research in software engineering has simply tried to identify the things which make software engineering so much different from conventional types of engineering.

      In the Mythical Man Month, Fred Brooks identifies the "essential difficulties" of software development as complexity, conformity, changeability, and invisibility. I'll explain each of these terms.

      • Complexity: Software does not benefit from repetition. Many other forms of engineering benefit from being able to repeat small elements or scale them into larger elements to scale the project. In software, reptition is eliminated as much as possible through functions and procedures. Scaling-up a software project necessarily involves increasing the number of distinct components. As the number of components increases, the number of possible states and interactions between those components increases non-linearly. It's also important to note that this complexity is the essence of the software. Creating a simplified model of the software is generally useless, unlike in physics.
      • Conformity: The complexity of a software system often stems from the need to conform to arbitrary constraints (the beloved "Requirements" document). Software needs to interface with external systems, software, formats, and rules, all of which are specified without rhyme or reason. This complexity cannot be removed through any design decision.
      • Changeability: Software is under constant pressure to change because it is easier to change than physical, manufactured products. People have an inherent understanding that they cannot ask for a complete redesign of a bridge. Their lack of understanding of software development does not keep them from asking for software changes which may require a complete redesign, however.
      • Invisibility: This one is a little hard to explain, but is closely related to complexity. Software systems are so complex that a useful, comprehensive graph or diagram of them cannot be created. UML diagrams are cute, but you need several different types of them to be able to see the whole picture, and any diagram for a reasonably large system with one type of view of all it's interactions would be ridiculously huge. Couple this with the fact that you need many such diagrams, some of which are not even planar (difficult or impossible to represent in 2 dimensions), and you start to see the problem. The human mind has very powerful visual processing; the engineer gains much by being able to visualize her system. While other types of engineers are able to visualize their systems, unfortunately, software developers cannot.
    3. Re:For the life of me by pmz · · Score: 3, Informative

      Actually, yes, these people are constantly re-evaluating their process because their time-to-market requirements are constantly getting tighter and tighter. Just read Business Week for six months and follow the changes in the auto industry through their articles: they are all about faster, faster, and listen-to-the-customer constant process-reengineering, with CEO ans design heads being hired and fired depending on how well they can make theri human- and machine-assembly-lines line up and fire.

      The difference is that the auto industry takes this stuff very seriously and there is often committment from the top executives on down. They incorporate their engineering practices as a core part of their business. They understand the value of engineering and good processes.

      The same is far from true in most software firms. Many software engineering managers are just transplants from other parts of the company. They often have little experience or training. They often think in terms of buzzwords rather than fundamental concepts. They often screw up.

  4. Re:lack of promotion, or lack of substance? by PincheGab · · Score: 5, Insightful
    Since when is a year and a half "fairly new"?

    When you are learning principles, a year is nothing. Lemme see, your gcc book might be old in a year or two, but your algorithms book from ten years ago is still very useful.

    Same thing here, books about development methodologies never age (refer to The Mythical Man-Month, rightfully, still required CS reading).

    If you think a year is too old for principles, then you follow fads too much.

  5. Re:Scrum? by tobes · · Score: 5, Interesting

    Not to be rude, but perhaps if you feel that way you should spend more time setting expectations. Developers always complain about management (I know I've dealt with some crappy managers), but I think that it's the fault of the industry as a whole for not setting expectations right.

    Half the time the problem is the vendors telling management that their product will slash costs by 200% and be implemented in a week for a 10th the price of the competition.

    If you're a consultant I'm sure you've seen the ever popular salesman screw job where your sales person doesn't have to guts to tell your client what their development is really going to cost them, so it ends up being done by the you (the developer). That always leads to some fun discussions.

  6. Master the Tao, all else will follow by arvindn · · Score: 5, Insightful
    After a number of years of observation, research, and fine tuning, Ken Schwaber and Mike Beedle have released a book that makes a subtle but vital revelation about the nature of software projects and how to better run them.

    They have discovered that the Tao is the heart of all programming.

    Hark, the master speaks:

    A novice asked the Master: ``Here is a programmer that never designs, documents or tests his programs. Yet all who know him consider him one of the best programmers in the world. Why is this?''

    The Master replies: ``That programmer has mastered the Tao. He has gone beyond the need for design; he does not become angry when the system crashes, but accepts the universe without concern. He has gone beyond the need for documentation; he no longer cares if anyone else sees his code. He has gone beyond the need for testing; each of his programs are perfect within themselves, serene and elegant, their purpose self-evident. Truly, he has entered the mystery of Tao.''


    A novice asked the master: ``I have a program that sometime runs and sometimes aborts. I have followed the rules of programming, yet I am totally baffled. What is the reason for this?''

    The master replied: ``You are confused because you do not understand Tao. Only a fool expects rational behavior from his fellow humans. Why do you expect it from a machine that humans have constructed? Computers simulate determinism; only Tao is perfect.

    ``The rules of programming are transitory; only Tao is eternal. Therefore you must contemplate Tao before you receive enlightenment.''

    ``But how will I know when I have received enlightenment?'' asked the novice.

    ``Your program will then run correctly,'' replied the master.

    Learning what Scrum is and how to practice it is not all that profound. However, sitting back and realizing why Scrum works and how it addresses the fundamental flaws of the last 20 years of software engineering is.

    Once you obtain that realization, you will have truly mastered the Tao.

    1. Re:Master the Tao, all else will follow by TerryAtWork · · Score: 4, Insightful

      See, here's the problem.

      Programming is still an ART, not a science.

      When you hire a coder it's like hiring a poet. You never know what you'll get and everyone wants the other guy to have paid for the coder's learning experiences.

      This is hunting and gathering. We haven't hit agriculture in the geek business yet.

      --
      It's Christmas everyday with BitTorrent.
  7. Totally Useless by Peter_Pork · · Score: 5, Informative

    I glanced at this book before, and I found it totally useless. The few ideas presented are already well-known facts about software engineering, heavily adorned with buzzwords like extreme programming and agile software. I did not see a single idea that was not present in Fred Brooks' "The Mythical Man-Month", that was written back in the 70s. Do not waste your time with this: I'd much rather read a classic, timeless work on project management and its challenges that this scum. If you want to look at contemporary, more applied works, I recommend Steve McConnell's "Rapid Development" and "Code Complete".

    1. Re:Totally Useless by pong · · Score: 3, Insightful

      That the ideas presented in this book are not new, doesn't make them useless. I'd almost say on the contrary. The "soft" part of my book shelf contains

      The Pragmatic Programmer
      XP Explained
      GoF Design Patterns
      Object Oriented Software Construction (Meyer)
      Software Craftmanship
      Code Complete

      Getting familiar with different takes on and approaches to software development has definitely made me a better developer. XP (and SCRUM and other agile methods) has a lot to offer, and a few short comings too. It is not the end all be all of software processes, but it was *the* new thing that made everyone aware of the benefits of unit testing and refactoring, even if these disciplines were not new at all. XP's two major short comings in my opinion is that it puts too much responsibility on the customer and the "simplest thing that could possibly work" does not strictly allow experienced developers to leverage their experience to solve the problem as fast as they are able. I'd like to get my hands on this book and see just how SCRUM differs from XP - I bet it will make me a better developer.

  8. "How" eXtrEmE pRogrAMming destroyed my project by Anonymous Coward · · Score: 5, Informative

    I've worked with XP on 2 projects and more normal "MSF"-like approaches for about 7 projects. (The remaining ones were kind of unmanaged to begin with, which is the pits)

    Anyways, XP doesn't work. Proponents like to say that XP is high throughput, but I just don't see it. At my last job (where XP was employed) programmers had to put in long hours, despite this being against XP tenet. This resulted from abbreviated design cycles and hit-and-run feature development.

    We like to talk about agility and mentally substitute quick hack jobs as a way of limiting cost overrun when features change midcourse (which they often do). What XP people don't tell you is that XP encourages these features to be hacked in (simplest thing possible, remember?) without regard for how it might be later removed with little effort.

    In other projects where features were designed and implemented with a good degree of modularity, that feature was canned or changed, yet we were able to extricate it with little effort - simply by #defining it out or by not shipping the modular DLL it resides in. In comparable XP-driven projects, I've been told "No, modularizing it is not a requirement. Do the simplest thing - add whatever you need to the existing classes and just do it."

    In XP, implementation is cheap up to a certain point where suddenly refactoring becomes imperative. Refactoring is then a very painful process given a very short iteration cycle. You won't find an XP shop that will encourage modularity over implementation time. But, like anything, the biggest gains come from pacing and managing, not from writing as much code as possible in a short amount of time.

    Ok, so now you say that pair programming compensates for the short design cycles. Get real - no one really does this because this, too, does not work. Most programmers are like any other people - they can be tempermental, stubborn, selfish, and proud. The worst part is, the younger and more inexperienced the engineer, the less willing he is to accept other points of view. Try working with that. You can't.

    Where XP excells is late stage bug fixing, where hit-and-run is definitely the right strategy.

    1. Re:"How" eXtrEmE pRogrAMming destroyed my project by tcopeland · · Score: 5, Interesting

      > Do the simplest thing - add whatever you need
      > to the existing classes and just do it."

      Hm, that doesn't sound XPish. XP says to refactor as you go. So when you add some code and things are getting complicated, refactor to make it simple.

      > You won't find an XP shop that will
      > encourage modularity over implementation time.

      "Modularity" can be taken to extremes, too:

      int x = IntegerFactory.createInteger("5").toInt();

      > Most programmers are like any other
      > people - they can be tempermental,
      > stubborn, selfish, and proud.

      Yup, just like anybody else. But how will these people ever improve their interpersonal skills if they don't work with other people?

      > Where XP excells is late stage bug
      > fixing, where hit-and-run is definitely
      > the right strategy.

      If you do XP all the way through, the pair programming, short iterations, and especially the unit tests will minimize the "late stage bug fixing". You did have unit tests, right?

      Yours,

      Tom

    2. Re:"How" eXtrEmE pRogrAMming destroyed my project by Sharkeys-Day · · Score: 3, Insightful

      programmers had to put in long hours

      That's not XP. XP forbids long hours for more than a week, because you can't write good code when you are tired, overworked, and have low morale.

      Do the simplest thing - add whatever you need to the existing classes and just do it.

      That's not XP either. XP says do the simplest thing, but specifically does NOT define "simplest" as "least time to implement". The simplest thing in XP is a compromise between least time and least code, with the specific condition that code is not allowed to be duplicated. The least time solution is often "copy this function and modify it for my needs". The XP solution is "refactor this function so I can use it too". This means you are doing small refactorings throughout your project, and modularity appears wherever it is needed.

      Refactoring is then a very painful process

      Refactoring is painful if you are not confident that the changes will work. If you are not confident, it is because you do not have a full automated testing suite. Let me guess... you aren't doing that either?

      pair programming ... no one really does this because this

      You tell us about all the parts of XP that you don't do, and then you complain that it does not work. Building a brick wall without mortar won't work either, but it's not the brick's fault.

  9. People way more significant that methodology by Boss,+Pointy+Haired · · Score: 5, Insightful

    In my 10 years software development experience, I've come to the conclusion that people are by far the most significant factor in the success or otherwise of a project.

    In fact, I believe that people are so significant that they make the use or otherwise of any particular "methodology" an irrelevant ingredient in determining the outcome of a project.

    Good coders will produce good results with or without methodology.

    Average / below average coders will produce average or below average results with or without methodology.

    Trouble is, it is impossible to test this theory experimentally; you just have to believe it :)

    I think.

    1. Re:People way more significant that methodology by pcraven · · Score: 4, Insightful

      Good coders have their own methodology. The key is that they do not follow a methodology just for the sake of the methodology, but they understand what works.

      Programmers who recently are introduced to patterns are amusing to watch. They see the patterns, and try to apply them to the problem. But the correct solution to a problem will naturally imply some sort of pattern. Pattern books are useful only in adding to a programmers experience. Here is a problem. Here is a good solution. But don't try to apply our solution to your problem, as your problem will always be a bit different.

      Another way to state: People who are good at brain-teasers are usually good at figuring out problems in real life. But rarely do the brain teasers mirror real life.

      The other key to success is some good management. Good programmers can get by with mediocre management. But even a team of crack developers will fail with bad management. When you go into a job, always make sure the management is strong. Otherwise you may just be wasting a few months or years of your life.

  10. Obligatory 'real engineer' comment by kahei · · Score: 4, Funny

    Hi,

    Why can't software be more like [real engineering field]? Nobody messes around with [extreme programming|OOP|empiricism] in [real engineering field]! I mean, how would it be if [bridges|planes|hospital equipment] were designed like software is? Books like this just make me realize that [software engineering is not real engineering|my branch of engineering is harder and therefore better|OOP is all a myth and everything should be in FORTRAN].

    Yours truly,

    [crusty old engineer|enthusiastic young engineering student|idiot]

    optional: P.S. the term software 'engineering' is a misnomer

    --
    Whence? Hence. Whither? Thither.
  11. Less heavy going by tarquin_fim_bim · · Score: 4, Informative

    Is a piece by Mountain Goat Software, they explain things with pictures, much better for us simpletons.

  12. Judge them by their work... by NigelJohnstone · · Score: 4, Informative

    A quick search on google reveals their past work:

    "Ken Schwaber is a Senior Consultant with Cutter Consortium's Agile Project Management Practice and is an experienced software developer, product manager, and industry consultant. He has been in the industry for more than 30 years, starting as a programmer and, by 1984, managing IT for one of Wang's divisions. In 1985, Mr. Schwaber founded Advanced Development Methods (ADM), a company dedicated to improving the software development practice. He initiated the process management product revolution of the early 1990s, when methodologies were automated and put to practical use on ADM's Mate process manager...."

    So basically a software development manager for failed Wang that went on to make a company that tells other people how to run projects.

    and Mike Beedle:
    http://www.mikebeedle.org/
    Runs two businesses, started out as a Lasers expert in 93, then in 94 switched to writing books on programming, judging by his papers.

    Guys, if you post PR puff like this on Slashdot don't you think people will check if you know what you're talking about?

  13. There is no holy grail for development by master_p · · Score: 4, Insightful

    After 3 years in full development, all I can say is that the most important part is defining good requirements; which means that the real needs have been understood well. So, the more time is spent in planning and discovering requirements, the better course the project has.