Slashdot Mirror


No More QA: Yahoo's Tech Leaders Say Engineers Are Better Off Coding With No Net (ieee.org)

Tekla Perry writes: A year ago Yahoo eliminated its test and quality assurance team, as part of project Warp Drive, its move to continuous delivery of code. The shift wasn't easy, Yahoo tech execs say, and required some "tough parenting." But the result has been fewer errors because "when you have humans everywhere, checking this, checking that, they add so much human error into the chain that, when you take them out, even if you fail sometimes, overall you are doing better." And the pain wasn't as great as expected. Yahoo's chief architect and SVP of science and technology discuss the transition.

216 comments

  1. Sounds like an MBA plan! by Dunbal · · Score: 5, Insightful

    We were tired of being constantly bogged down by all these mistakes and bugs, so we got rid of the people who kept telling us about all the mistakes and bugs. Now our code is 100% mistake and bug free! Next step, get rid of our expensive experienced coders and replace them with cheaper outsourced coders with "equivalent" experience. We'll save so much money what could possibly go wrong? And the third and final phase of our plan is that in order to motivate our coders we will be paying a bonus that scales with the amount of code written. The more code you write, the better the bonus!

    Don't you just love management?

    --
    Seven puppies were harmed during the making of this post.
    1. Re: Sounds like an MBA plan! by bill_mcgonigle · · Score: 2, Interesting

      Did you get through TFS? The claim is that overall errors have been reduced but not eliminated.

      He could be lying, but if that's the counterclaim, then show some evidence for it.

      --
      My God, it's Full of Source!
      OUTSIDE_IP=$(dig +short my.ip @outsideip.net)
    2. Re: Sounds like an MBA plan! by Dunbal · · Score: 1

      Trying to figure out facts in a joke. Lighten up, fella.

      --
      Seven puppies were harmed during the making of this post.
    3. Re:Sounds like an MBA plan! by naasking · · Score: 1

      We were tired of being constantly bogged down by all these mistakes and bugs, so we got rid of the people who kept telling us about all the mistakes and bugs.

      His argument is sound though. Testers don't always follow proper testing procedure, so you'll still get plenty of bugs passing through it, and it takes way too much time for this to feed back into the develop-test cycle. Better to spend all that QA time writing more automated tests of various types, which the devs can run themselves during their much shorter develop-test feedback cycle. This obviously increases robustness towards matching the spec, and you're just left with acceptance testing to ensure your spec matches client expectations.

    4. Re: Sounds like an MBA plan! by Junta · · Score: 5, Interesting

      While 100% was hyperbole, I think the point stands: if you remove QA then the number of *known* issues is going to go down. Whether your number of *actual* issues go down it's another matter.

      I view this as the nightmare scenario, management hears words like automated testing as part of CI and then assumes automation has taken care of everything and they don't need the QA people. When the QA people's input into the issue tracker goes away, the numbers of issues in the graphs go down. Management gives themselves a pat on the back as a problematic metric has improved, without too much thought as to why.

      --
      XML is like violence. If it doesn't solve the problem, use more.
    5. Re:Sounds like an MBA plan! by Earthquake+Retrofit · · Score: 2

      A handful of ordinary dumb users and a smart sixteen-year-old with authority issues should be able to find enough bugs to keep the QA department busy for quite a while.

      --
      Fifty years of Yippie! 1968-2018
    6. Re:Sounds like an MBA plan! by Lennie · · Score: 2

      The summary sucks, read the article:

      They got rid of the QA team and made the programmers create more unit-tests (this is key).

      Because the computers made less mistakes than the QA team.

      --
      New things are always on the horizon
    7. Re:Sounds like an MBA plan! by Junta · · Score: 4, Insightful

      The argument is actually pretty bad. By all means add more automated testing and hopefully make the QA process smoother, but skipping it entirely (they fired the QA team) is a recipe for disaster, and the only thing they have to measure the effectiveness of this is the number of issues in their issue tracker, which was *fed* by the QA team. It's like a company firing all their warranty people and bragging about how their warranty claims have gone to zero. The filed issues may be lower, but that does not speak to the final product.

      Testers don't always follow proper testing procedure

      This is a double edged sword in my experience. The testers are using the software much like a human would, and they do unexpected human things like the end user would be doing. This particularly helps identify usability issues, which isn't really an automation sort of thing. It's also a lot of fuzzy stuff that is usually not specifically laid out in the spec.

      robustness towards matching the spec

      Sometimes single minded march toward matching the spec is a bad idea, because the spec is bad and needs to be revisited. Sometimes this plays out in development, and sometimes this plays out in QA when humans clearly have a harder time with the interfaces than expected. Also generally speaking for me a spec is pretty high level, open to interpretation, and refined throughout the process as the details of the implementation get fleshed out.

      --
      XML is like violence. If it doesn't solve the problem, use more.
    8. Re: Sounds like an MBA plan! by Anonymous Coward · · Score: 2, Interesting

      He could be lying, but if that's the counterclaim, then show some evidence for it.

      I hold in my hand a bag containing a small, living, pink unicorn.
      What do you say? I'm lying? Well, if that's the counterclaim, then show some evidence for it.
      What do you say? You can't look in the bag? Well, my point exactly.

    9. Re:Sounds like an MBA plan! by kenai_alpenglow · · Score: 1

      My experience in a recent project is that the main source of real bugs (those that take a good bit of looking-for) was in the integration phase. Of course I had issues with the overall design of the thing. Seemed like race conditions were always popping up--mainly when you got it out of the development shop and further down the pipelines. (Note: I was doing a QA function at the time, so maybe my bias is showing.)

    10. Re:Sounds like an MBA plan! by naasking · · Score: 2

      By all means add more automated testing and hopefully make the QA process smoother, but skipping it entirely (they fired the QA team) is a recipe for disaster, and the only thing they have to measure the effectiveness of this is the number of issues in their issue tracker, which was *fed* by the QA tea.

      Which can be replaced by an easy issue submission process embedded in the program itself. Combined with a program trace of the user's actions, which Yahoo already uses as part of its distributed architecture, the developer would be able to reproduce precisely any behaviour seen.

      The testers are using the software much like a human would, and they do unexpected human things like the end user would be doing. This particularly helps identify usability issues, which isn't really an automation sort of thing.

      But you can automate entry of unexpected data too, without having to generate the data/tests yourself. See QuickCheck and other testing tools inspired by it, which invokes functions with a large set of permutations over the full domain of its parameters, starting with upper and lower bounds, ie. if your function accepts an int, it will invoke it thousands of times int.MaxValue, int.MinValue, and a number of randomly selected values between.

      Sometimes single minded march toward matching the spec is a bad idea, because the spec is bad and needs to be revisited.

      Sure, but you can't fix spec problems in the testing phase with a QA team that aren't domain experts. Only end users can validate something like this, which is where shorter feedback cycles with end users are key delivering a good result.

      Re: humans having a hard time using an interface, this is generally obvious to the developers too while they're writing and testing their own code. They generally just don't have a process available via which they can question the viability of the spec and be taken seriously.

    11. Re: Sounds like an MBA plan! by I'm+New+Around+Here · · Score: 1

      I can't believe it! You found my missing unicorn!

      By the way, his name is Schrödinger.

      --
      If you think I voted for Trump because of this post, you're wrong. I voted for Dr. Jill Stein of the Green Party. Again.
    12. Re:Sounds like an MBA plan! by evilviper · · Score: 2

      They got rid of the QA team and made the programmers create more unit-tests (this is key).

      Of course that's not really true, either...

      From the QA team: "Some started working on automation [for testing], and they thought that was great—that they didn't have to do the same thing over and over."

      So really all they did was move their good QA folks to different departments, where they are now writing QA tests, but just don't get called QA engineers anymore, so Yahoo can get PR with nonsense stories like this one claiming there's "no more QA".

      Yes, they automated QA testing as part of this, though it sounds like they did so in the most backwards and painful way possible, which means they necessarily reduced the size of the QA team in the process. But none of that would be news if they didn't lie about it, would it? I'm sure many other companies (like Amazon) had this model of fully-automated QA tests working for many YEARS before Yahoo thought-up the idea.

      --
      Slashdot gets worse every day... Pipedot: News for nerds, without the corporate slant
    13. Re: Sounds like an MBA plan! by Anonymous Coward · · Score: 0

      You must be new around here.

    14. Re: Sounds like an MBA plan! by Anonymous Coward · · Score: 0

      Not less but fewer.

      Mistakes is a countable noun not a mass noun.

    15. Re:Sounds like an MBA plan! by QuietLagoon · · Score: 1

      They got rid of the QA team and made the programmers create more unit-tests (this is key).

      The programmers should have been writing unit tests all along.

      .
      How is that a justification to eliminate QA?

    16. Re:Sounds like an MBA plan! by Big+Hairy+Ian · · Score: 1

      So I take it Yahoo have also eliminated employee sickness by abolishing sickpay! What a bunch of *****!

      --

      Build a Man a Fire, and He'll Be Warm for a Day. Set a Man on Fire, and He'll Be Warm for the Rest of His Life.

    17. Re: Sounds like an MBA plan! by Anonymous Coward · · Score: 0

      He could be lying, but if that's the counterclaim, then show some evidence for it.

      I hold in my hand a bag containing a small, living, pink unicorn.
      What do you say? I'm lying? Well, if that's the counterclaim, then show some evidence for it.
      What do you say? You can't look in the bag? Well, my point exactly.

      Actually, that bag contains a green unicorn. And nobody can look in the bag (not even you).

    18. Re:Sounds like an MBA plan! by lucm · · Score: 2

      You forget the team lead: an older woman who doesn't understand the difference between click and double-click and has to do all her testing with one of those laptops that has a virtual scroll bar on the trackpad.

      --
      lucm, indeed.
    19. Re: Sounds like an MBA plan! by Anonymous Coward · · Score: 0

      Actually, the unicorn's color is unknowable, and anybody can look in the bag, but then they will be forsaken by the unknowable unicorn and become host to the lying unicorn.

    20. Re:Sounds like an MBA plan! by Anonymous Coward · · Score: 1

      Ugh.

      Reminds me of the whole "DevOps" movement. The idea is good: tighter integration between your development and operations teams, for quick deploys, etc. The execution is typically: "Let's just get rid of the ops team altogether! The developers can run the production systems as well as write the code. It's all just computer tech anyways, right?"

      Next thing you know, the devs have started installing compilation tools on the production boxes and have invented amazing "new" methods of deploying software, like giving each production server read/write access to the central git repo. Deployments now involve running parallel software builds across every production server, rather than building on a central server & pushing it out.

      Fucking DevOps.

    21. Re: Sounds like an MBA plan! by phantomfive · · Score: 1, Redundant

      I can give a counter-idea: in my first job, I didn't have QA. It was up to me to make sure my own code was quality enough before releasing it, and that aspect terrified me enough that I did learn to write quality code (which basically means you are testing your own code thoroughly, doing your own QA).

      Now, at the time I was working with programmers who were much more skilled than I was, and I learned from them. Yahoo is a much larger company, with a programmers of a more varied skill-set. It is not rational to just assume what happened at my first company would happen at Yahoo, but it did work for me.

      --
      "First they came for the slanderers and i said nothing."
    22. Re:Sounds like an MBA plan! by retchdog · · Score: 1

      Well, this is a special case where the plan is reasonable.

      I mean, what good is QA when you don't have any end-users?

      --
      "They were pure niggers." – Noam Chomsky
    23. Re: Sounds like an MBA plan! by Anonymous Coward · · Score: 1

      Management takes customer-reported problems very seriously.

    24. Re:Sounds like an MBA plan! by __aaclcg7560 · · Score: 1

      Black box testing is where the tester has no idea what the code inside the application does and test the application like a regular user. White box testing is where the tester knows what the code inside application does and test the application like a programmer. In an ideal development environment, programmers write unit tests to white box test their own code and testers black box test the application as a whole.

    25. Re: Sounds like an MBA plan! by rgmoore · · Score: 4, Insightful

      It was up to me to make sure my own code was quality enough before releasing it, and that aspect terrified me enough that I did learn to write quality code (which basically means you are testing your own code thoroughly, doing your own QA).

      The problem with testing your own code is that you're likely to miss entire classes of bugs. You can be very effective at catching the kinds of bugs you can think of, but those are always the easiest bugs to catch in the first place. The tests you write for yourself will never do a good job of catching errors in your assumptions about what the code should do, what kinds of inputs it needs to handle, etc. Catching those kinds of conceptual bugs really requires adversarial testing from somebody who isn't starting from the same set of assumptions.

      --

      There's no point in questioning authority if you aren't going to listen to the answers.

    26. Re: Sounds like an MBA plan! by Anonymous Coward · · Score: 2, Informative

      The poster was close, when referring to the actual word "Mistakes" as opposed to its meaning, then the correct word was indeed "is".

      So to make it perfectly clear, quotes should have been used as such:

      "Mistakes" is a countable noun not a mass noun.

      ---
      Not APK

    27. Re: Sounds like an MBA plan! by KGIII · · Score: 1

      Hmm... I think the AC is *mostly* correct but should have used quotes. "Mistakes" is a...

      I see the less and fewer thing so many times that I'm damned near certain that few people actually know the difference. My grammar isn't really good enough to go throwing stones, so I just skip it.

      --
      "So long and thanks for all the fish."
    28. Re: Sounds like an MBA plan! by sunderland56 · · Score: 3, Interesting

      The claim is that overall errors have been reduced but not eliminated.

      But with zero testing, how would they know?

    29. Re: Sounds like an MBA plan! by phantomfive · · Score: 4, Insightful

      Yeap. That's where pushing to live production is going to be your brutal tutor.....if you have cognitive biases that are hiding bugs from your psyche, then the system will show you to them (most likely in the most inconvenient time), and you will learn. It's harsh.

      You can get the same experience (but with less harshness) by giving yourself the goal to never let a bug get past you to QA. Then QA will be a kinder tutor that helps you learn.

      --
      "First they came for the slanderers and i said nothing."
    30. Re: Sounds like an MBA plan! by Anonymous Coward · · Score: 0

      With that attitude you'll loose every time.

    31. Re: Sounds like an MBA plan! by NormalVisual · · Score: 3, Insightful

      I can give a counter-idea: in my first job, I didn't have QA. It was up to me to make sure my own code was quality enough before releasing it, and that aspect terrified me enough that I did learn to write quality code (which basically means you are testing your own code thoroughly, doing your own QA).

      I think it's always necessary to test your own code via unit tests and whatnot prior to letting someone else have at it, but I think it's also important to have that second set of eyes on it from a behavioral standpoint. Often we're too close to the code to really beat it up properly and subject it to really weird edge cases, and good QA people are quite adept at doing that. What I've found works pretty well is having the code go through QA, but still being held to some kind of personal accountability for it as well. Even if it's nothing more than your co-workers laughing at your QA bug reports and saying your code sucks, it's some more motivation to get it right the first time, and if it passes QA you have at least some degree of confidence that it works properly.

      Another thing I've learned is that the stereotypical animosity between dev and QA is counterproductive. It's much better to think of them as two parts of a team working toward the same goal, and it's beneficial to foster an environment where the devs actively encourage QA to break stuff instead of trying to blow them off all the time.

      --
      Please stand clear of the doors, por favor mantenganse alejado de las puertas
    32. Re: Sounds like an MBA plan! by phantomfive · · Score: 4, Insightful

      Another thing I've learned is that the stereotypical animosity between dev and QA is counterproductive.

      Yes. QA is absolutely on your side!! Every time they find a bug for me, I thank them profusely, because better them than a customer.

      --
      "First they came for the slanderers and i said nothing."
    33. Re:Sounds like an MBA plan! by Anonymous Coward · · Score: 0

      They generally just don't have a process available

      They have for all the companies that I have worked for. But then I write safety critical code that kills people when we screw up.

    34. Re: Sounds like an MBA plan! by KGIII · · Score: 1

      That's a good one. Trolling is a art, after all.

      --
      "So long and thanks for all the fish."
    35. Re:Sounds like an MBA plan! by Junta · · Score: 1

      I wasn't so much about unexpected data input, but a user not knowing what the hell to do to get what they want. Functionality they don't figure out.

      Which can be replaced by an easy issue submission process embedded in the program itself.

      Yes, just make your users your testers, great idea. Maybe for a community free effort, but for a commercial deliverable, that's *not* where you want things to be.

      humans having a hard time using an interface, this is generally obvious to the developers too

      Developers are frequently not very much in tune with their target end user perspective. Hence why I see my fellow developers get frustrated with testers and even clients, wondering why the users can't do things the way the developer thinks they should do.

      --
      XML is like violence. If it doesn't solve the problem, use more.
    36. Re: Sounds like an MBA plan! by Anonymous Coward · · Score: 0

      I can give a counter-idea: in my first job, I didn't have QA. It was up to me to make sure my own code was quality enough before releasing it, and that aspect terrified me enough that I did learn to write quality code (which basically means you are testing your own code thoroughly, doing your own QA).

      That only works if your company doesn't have as much at stake as Yahoo, Google, etc. If your mistake would cost the company $10,000 per hour in revenue or major bad press, your first mistake will be your last mistake.

    37. Re: Sounds like an MBA plan! by Anonymous Coward · · Score: 2, Insightful

      Call volume is unusually high. You are number [37] in line. Please be patient and listen to the pleasant music for approximately [109] minutes. [buzz buzz brrrrff buzz ggggzhxx buzz buzz ...]

    38. Re: Sounds like an MBA plan! by loufoque · · Score: 1

      They replaced manual by automatic testing, you dofus.

    39. Re: Sounds like an MBA plan! by Anonymous Coward · · Score: 0

      There is always testing. The goal of a quality-focused organization is to ensure that the lion's share of that testing is done in-house rather than by customers.

    40. Re: Sounds like an MBA plan! by Anonymous Coward · · Score: 0

      Actually the color of the unicorn is both green and pink, and doesn't get to it's final state until somebody looks in the bag.

    41. Re: Sounds like an MBA plan! by Anonymous Coward · · Score: 1

      Yeap. That's where pushing to live production is going to be your brutal tutor.....if you have cognitive biases that are hiding bugs from your psyche, then the system will show you to them (most likely in the most inconvenient time), and you will learn. It's harsh.

      You can get the same experience (but with less harshness) by giving yourself the goal to never let a bug get past you to QA. Then QA will be a kinder tutor that helps you learn.

      All programmers create bugs. This is unavoidable. Bug creation and bug fixes are natural and ineluctable phases of software development. Testing live in production might be OK if you're working on a rarely-used social media site or a neglected image repo, but it is NOT OK if you have sensitive data or ecommerce at the core of your application.

      Do you think that users' data security is the proper object of harsh lessons for coders? Some kind of software developmental trial by fire?

      I would NEVER want to be part of a project where someone like you would have managerial responsibilities for the code.

      I would NEVER want to be the user of such an outfit either.

    42. Re: Sounds like an MBA plan! by phantomfive · · Score: 5, Insightful

      Do you think that users' data security is the proper object of harsh lessons for coders?

      If you are depending on QA to make sure user data is secure, you're going to fail. That's not what QA does, and hacking is rarely in their skillset.

      When companies start caring about security, they usually start a separate team "Red Team" or something whose entire job is to try to hack and find security holes in the project. (I would argue this is not sufficient, because companies who have done this still fail. If you want secure software, it has to start from the beginning. You need to teach your programmers how to write good code, and security has to be a priority on every line of code that is written. Security can't be tacked on as an afterthought).

      --
      "First they came for the slanderers and i said nothing."
    43. Re: Sounds like an MBA plan! by gweihir · · Score: 2

      "Number of errors" is a meaningless metric. You need to take severity, cost of fixing, cost of finding, and damage done into account. But MBA bean-counters cannot do that, as they do not understand anything they are "managing".

      --
      Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
    44. Re: Sounds like an MBA plan! by Anonymous Coward · · Score: 1

      Yeah, every time I push code, I've tested it and I feel I've found all the bugs. I wouldn't push it if I felt like it wasn't done yet unless something was dependent on it, and they needed it to get going with the understanding of finish testing. Though with years of experience, if somebody asks me if my code has bugs, though I feel I've found all of them, I undoubtedly say "none that I know of, but I'm sure there's plenty". QA always finds bugs in my code no matter how good I thought I did testing it.

    45. Re: Sounds like an MBA plan! by lucm · · Score: 0

      The poster was closed, when referring too the actual word "Mistakes" as opposed to it's meaning, than the correct word was indeed "is".

      So too make it perfectly clear, quotes should has been used as such:

      "Mistakes" is a cuntable noun not a mass noun.

      I guess I made a "mistakes".

      --
      lucm, indeed.
    46. Re: Sounds like an MBA plan! by cfalcon · · Score: 1

      > But with zero testing, how would they know?

      Don't even think about believing it. If removing test was a good idea, it would have been done years ago across the industry. You seriously think an entire profession is entirely needless? Like, even for a second?

      This is just some dumb scam to reduce corporate overhead to pump dem stox. You'd have more success firing the managers (another bad idea that has been tried).

    47. Re: Sounds like an MBA plan! by cfalcon · · Score: 1

      They understand if you remove people from the payroll and claim it helps, that it makes the stock go up. Say "my production code doesn't need to be tested, I found all the bugs" in a mirror. What does that person look like saying that?

    48. Re:Sounds like an MBA plan! by cfalcon · · Score: 1

      Unit tests are not functional tests. You NEED functional tests, you SHOULD HAVE unit tests.

      Also, why do you think TEST can't follow test procedures, but somehow SOFTWARE will?

      This is just a stock pump and dump thing.

    49. Re: Sounds like an MBA plan! by chaboud · · Score: 2

      Keep in mind that the number of reported bugs in a given piece of software is proportional to the probability of a bug occurring, the likelihood of a user being sufficiently competent to recognize it as a bug, and the amount of usage of the given piece of software.

      The last two figures in that trio have been dropping off precipitously for Yahoo for quite some time.

      The problem with dropping QA (as if there is only one) is that you lose the adversarial position of quality. The tension of a QA org, refusing to sign off on shit software, helps that software be better, just as the tension of TPM's, riding the org to hit a schedule, helps the software value scheduling constraints. Giving people causes to champion is an extremely useful way to keep an organization from developing blind spots. A bunch of devs, together, can easily become dogmatic and over index on one aspect of their work.

      Domain expert QA also allows developers to solve problems that would have been incomprehensibly out of reach by providing conversational user perspective.

      I'm a developer, so a visit from QA might mean something landing on my desk with a thud. Still, skipping QA altogether is going to lead to more developer hours spent on work that would have been covered by (sadly, much less costly) QAE's and more blinds spots, in code and organizational operation.

      Love your QA. They are your safety net, fresh eyes, user advocate, exhaustive pounder, field-bug triage, and fire marshal.

      Besides, anyone taking advice from Yahoo's tech leadership at this point is woefully out of touch.

    50. Re:Sounds like an MBA plan! by samkass · · Score: 1

      This back and forth is ignoring a critical point: that not all bugs are created equal, and not all systems fail in the same ways or have the same risk profile and scale. What if your REST service returns 500 for a user because of something you just released? Ok, that's bad if you just rolled it out to all your servers and it happens to all users. But what if the client always does 3 re-tries (as REST clients should do), and you only rolled it out to 5% of your servers? Now most clients are unlikely to see anything wrong at all, and it's obvious you should immediately pull back the release. In fact, the pull-back should be automatic as soon as it's observed that the failure profile is worse.

      And regarding risk and scale, what if you have a banking application that is only used thousands of times a day, and compare that to a social network used thousands of times a minute? The risk of getting something wrong and tripping regulator ire is great in one case, while the risk of seeing some entries missing on your wall ranges from a little annoyance to unnoticeable. And the likelihood you'll actually see the problem quickly is huge on the social network, while it may not be so on the less-used app. The social network is obviously a good candidate for devops-style continuous-release systems, while the banking app would need more evaluation to see where the line is drawn.

      --
      E pluribus unum
    51. Re: Sounds like an MBA plan! by Anonymous Coward · · Score: 0

      Man you get really bitter when you are wrong about shit.

    52. Re:Sounds like an MBA plan! by naasking · · Score: 1

      Please point out where I said "unit tests" anywhere in my comment. I specifically said automated tests, which encompasses any testing procedure that can be conceivably run on a computer (which is conceivably just about anything a human can do).

      And automated tests follow a fixed procedure by definition, as they're computer programs. People following tedious, repetitive tasks, like testing programs, make frequent mistakes. This is a well known fact from the manufacturing industry.

    53. Re: Sounds like an MBA plan! by Grishnakh · · Score: 1

      I worked in an environment with QA once, and it was a good experience. Really good QA people are rather weird, but that's what makes them good at QA: they have a very different mindset which is needed for that work. And, as with anything, it's always good to have someone else cross-checking your work for errors. Thinking you can find all your own errors is just arrogant and stupid.

    54. Re:Sounds like an MBA plan! by naasking · · Score: 2

      Yes, just make your users your testers, great idea.

      User acceptance testing is the only meaningful testing of this sort. There's no way around it really. Black box testers don't have the domain knowledge that end users have, nearly any usability feedback is practically meaningless. How could a blackbox tester possibly really know whether a particular screen layout, or information organization, would make sense to an end user?

      Developers are frequently not very much in tune with their target end user perspective. Hence why I see my fellow developers get frustrated with testers and even clients, wondering why the users can't do things the way the developer thinks they should do.

      If users are confused, it's an impedance mismatch between what a developer thinks the user knows, and what the user actually knows. Which is a spec failure. The developer can't divine what a hypothetical user would know at any given moment by magic. How could a QA team know this information? And if they somehow know, why not just communicate this to the dev in the spec in the first place?

    55. Re: Sounds like an MBA plan! by fyngyrz · · Score: 1

      Then why is the CEO still there? Clearly, mistakes that cost karge amounts of money do not cause dismissal at Yahoo. They do, of course, often cause weaker performance, as we have seen in Yahoo's recent scramble to unload the various enterprises they have royally screwed up.

      --
      I've fallen off your lawn, and I can't get up.
    56. Re: Sounds like an MBA plan! by Anonymous Coward · · Score: 1

      If you are depending on QA to make sure user data is secure, you're going to fail. That's not what QA does, and hacking is rarely in their skillset.

      Not the guy you were replying to but whether that's true really depends on what sort of QA you have. SDETs can do unit and white box testing, security testing, performance testing, etc. but they cost as much as a developer, since that's what they really are.

    57. Re: Sounds like an MBA plan! by phantomfive · · Score: 2

      SDETs can do unit and white box testing, security testing, performance testing, etc. but they cost as much as a developer, since that's what they really are.

      An SDET who is good at hacking will cost more than a developer.

      --
      "First they came for the slanderers and i said nothing."
    58. Re: Sounds like an MBA plan! by gweihir · · Score: 1

      I try not to say utterly stupid things to mirrors. The results tend to annoy me.

      --
      Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
    59. Re: Sounds like an MBA plan! by Anonymous Coward · · Score: 0

      "I would NEVER want to be the user of such an outfit either."

      Exactly my reaction. This is a recipe for pushing unwanted features on an increasingly dissatisfied set of users. Testing seems to go beyond the mere function, with the more important aspect being whether the developed function matches the original requirement or the 'user story.'

    60. Re:Sounds like an MBA plan! by Anonymous Coward · · Score: 0

      You forget the team lead: an older woman who doesn't understand the difference between click and double-click and has to do all her testing with one of those laptops that has a virtual scroll bar on the trackpad.

      But enough about Marissa Mayer! (It woud explain the multiple years of negative feedback they've ignored regarding the UX revamps that started when she got on board...)

    61. Re:Sounds like an MBA plan! by Lennie · · Score: 1

      Yes, maybe they didn't get rid of them.

      Maybe they added/embedded them into the team to write the tests.

      --
      New things are always on the horizon
    62. Re: Sounds like an MBA plan! by jrumney · · Score: 1

      The measure of success should be the improvement to the company's finances after this measure was introduced. Oh wait, it is Yahoo we are talking about here.

    63. Re: Sounds like an MBA plan! by stephanruby · · Score: 2

      He could be lying, but if that's the counterclaim, then show some evidence for it.

      You're missing the OP's original point. It's difficult to prove anything if you've stopped measuring things.

      May be it's just me because I'm not a great developer, but I work that much harder to find bugs within my programs because I know that QA will always try harder than me to find any bugs that I let through.

      Furthermore, even if the number of bugs stays constant even without QA (which I very much doubt), without QA those bugs are going to be found many days if not weeks later than usual. And as a developer, I am so much quicker at fixing a bug I introduced 30 minutes ago or a couple of hours ago, than many days ago. After all, I am only human, and it takes time for me to re-immerse myself into a particular piece of code if it's not already fresh in my mind.

      Also, Yahoo makes it sound as if they took the harder approach and now it's paying off for them. Not at all, laying off QA is the easier approach. It's just like stopping regression-testing. It's infinitely easier to do that, at least initially. QA people are not easy to deal with. Failing tests are not easy to deal with either. When confronted with either QA people or failing tests, there is also a sense of urgency about having to drop whatever you're doing and dealing with the problem at hand. Removing those QA people and removing those failing tests may give you a sense of reprieve, but it is certainly not going to help fix any of the underlying problems. If anything, it's just like an ostrich burying its head in the sand when it sees a predator coming.

    64. Re: Sounds like an MBA plan! by Anonymous Coward · · Score: 0

      You can be very effective at catching the kinds of bugs you can think of, but those are always the easiest bugs to catch in the first place.

      Some people have a natural intuition to see potential bugs. I have solo-written code that is tens of thousands of lines of code that has never had a reported bug after years in production with hundreds of thousands of users. My code has even detected numerous bugs in other systems that feed into it because I don't assume outside data is trusted.

      My golden rule is no undefined states, all states are tested, and test failure cases that attempt to put the system into invalid states. I have a reputation to "break systems". Architects and devs like to ask me to review their designs because I have a instinctive ability to nearly instantly think of ways to put systems into undefined states.

      I think what makes me different is I visualize everything. I can tell if two parts of a system will mesh correctly by visualizing those parts. If something is wrong with the meshing, instead of clearly fitting together, they are blurry at their edges. This visualizing seems to scale very well. I can visualize quite complex system this way.

    65. Re: Sounds like an MBA plan! by Anonymous Coward · · Score: 0

      I kinda agree. There is increased likelihood of abuse and scapegoating with QA. Engineers tend to write crap just to meet a deadline, knowing that QA will test it they don't give enough care to the packages being built as much as they could. In the back of the developers mind: "it's ok to write crap, QA will find bugs and maybe even debug for me, I'll fix it then". Also, if a bug goes out, they blame it on QA for not catching it, even though they are the source of the crappy code. I think it's more effective for devs to be responsible for this stuff as much as possible. A scenario where devs don't know that there is QA,Mobutu QA does actually happen is probably ideal. If you don't have a safetynet when you walk a tightrope, you sure as hell going to be infinitely more careful with how you do it.

    66. Re: Sounds like an MBA plan! by lucm · · Score: 1

      Nah, I just strongly dislike grammar phonies.

      --
      lucm, indeed.
    67. Re: Sounds like an MBA plan! by LrdDimwit · · Score: 1

      The obvious conflict of interest, and my own experience with QA and the nature of the defects I have observed in my coding career, are all the evidence I need to believe that this is nonsense.

    68. Re: Sounds like an MBA plan! by tlhIngan · · Score: 1

      Yeap. That's where pushing to live production is going to be your brutal tutor.....if you have cognitive biases that are hiding bugs from your psyche, then the system will show you to them (most likely in the most inconvenient time), and you will learn. It's harsh.

      And while "not working with a net" will hopefully prevent those massive push to production failures because you tested your code, it won't prevent smaller bugs from getting through.

      I mean, for Yahoo, let's say you fixed some bug in the email service. Without QA, you probably test to make sure the webmail still works fine and push it. Yay, service is still up. But a bug in your code hides say, the BCC field. Well, sure, you wrote better quality code - it didn't crash production - but it still had bugs in it, just you didn't notice. Even worse, users probably didn't see it, and those that use it probably assume it was removed on purpose. Because it seems the trendy thing to do all around - little used features start to disappear.

      And this can continue on - bugs hiding features people use and users assuming that they were removed on purpose until someone puts their foot down and starts a conversation saying how bad your service is months later with all the features missing. Everyone assumes it was deliberate, even if it was accidental and a small quick fix would bring it back.

      That's the thing QA is for - to make sure the system still matches the requirements - features don't go missing unless there was a deliberate change to remove the feature.

      SO yeah, perhaps "bugs" went down, maybe even system-crashing criticla bugs. But it's the smaller bugs that may escape detection and that your users simply assume it was removed. And you'll never find out until months or years later when users post something publicly. In the meantime, you can be bleeding users who used a feature and assume it was deliberately gone and have no clue why.

    69. Re: Sounds like an MBA plan! by Anonymous Coward · · Score: 0

      They got rid of the team that finds bugs. Wouldn't you expect the bug rate (that you know about) to go down?

    70. Re:Sounds like an MBA plan! by Junta · · Score: 1

      In my work, we draw QA team members from the target industry. They do have the domain knowledge of the target market. I have also been at a place that offered a deal to one or two clients for steep discounts or free in exchange for volunteering some of their people for occasional meetings on in development code.

      The problem with just waiting for the end users is that most of the clients I see would just buy a competitor software rather than contribute any work to make the one I work on better. That's the rub when your user input is roughly out of the knidness of their hearts/loyalty. What bug input you do get is low quality (except for things that are pretty black and white crashes with a stack trace, the stuff that gets gathered in an automatic way), and users are likely to just move on.

      For example, if Yahoo and Google offered the same rough service, and yahoo was confusing or didn't do what I expect, I wouldn't click a 'file issue here', I'd just go to google.

      --
      XML is like violence. If it doesn't solve the problem, use more.
    71. Re:Sounds like an MBA plan! by Junta · · Score: 1

      For me the human testing is largely in scenarios where a human is involved. Sure they will sometimes hit a case that the test cases managed to miss in coverage, but most of the bugs are usability, documentation, etc.

      It varies based on what you are trying to deliver. My experience is that without the QA team, the product that releases even if it doesn't do things like crash or hard failures, that users are likely to not be happy with it. I work on software for target users that have skills most software developers do not possess, and conversely most of those target users can't write software well. Same for my previous job. It's one thing when you are writing something pretty universal, it's another when you are trying to target a highly skilled industry that is not software development. A captive audience to bridge the gap and provide context is just needed for good product.

      --
      XML is like violence. If it doesn't solve the problem, use more.
    72. Re: Sounds like an MBA plan! by phantomfive · · Score: 1

      Yeah, you're right, you need to have some sort of feedback loop with your customers or it won't work....

      --
      "First they came for the slanderers and i said nothing."
    73. Re: Sounds like an MBA plan! by MoarSauce123 · · Score: 1

      Security is a subset of quality. Neither one is of interest to most companies these days because it costs money and customers do not pay for either. Customers want features even if the user experience is bad and the app crashes and breaches are inevitable. Look at TJX, BCBS, Vtech,etc ... did any of the breaches harm their business long term? Would anyone pay extra for better quality? Hacking is not a typical QA skill set, but security is definitely on deck for anyone doing proper QA. Things like injection attacks are easily tested and there are many tools and such tests often also uncover numerous other flaws. Aside from that, QA should also always have a strong user focus and advocate for the users. How well that worked for Yahoo is obvious, they want to spin off their business and turn into a holding company. And of course everything is hunky dory with little complaints because nobody is using Yahoo services anymore.

    74. Re:Sounds like an MBA plan! by jmcvetta · · Score: 1

      Don't give them ideas...

    75. Re: Sounds like an MBA plan! by Anonymous Coward · · Score: 0

      Lol. ðY

  2. You can't make this stuff up by rudy_wayne · · Score: 1, Insightful

    A year ago Yahoo eliminated its test and quality assurance team

    The perfect behavior for a company that is worth less than zero. (Subtract their shares of Alibaba from their market cap and you get a negative number).

    1. Re:You can't make this stuff up by Anonymous Coward · · Score: 0

      They have negligible debts, and many assets spread all over the planet in a diverse portfolio. Just because some aren't worth as much as the purchase price, your account method makes you look like a retard, and demonstrates an utter lack of understanding how this means fuck all to mega-corps.

    2. Re:You can't make this stuff up by Anonymous Coward · · Score: 0

      1.22 B total debt , 5.88 B total cash, -2.38B operating cash flow

      http://finance.yahoo.com/q/ks?s=YHOO+Key+Statistics

    3. Re:You can't make this stuff up by Anonymous Coward · · Score: 0

      I'm pretty sure the GP is 100% right. You seem upset, do you own Yahoo stock or something?

      http://www.cnbc.com/2015/10/21...
      http://m.economictimes.com/new...

    4. Re:You can't make this stuff up by lucm · · Score: 1

      This is no longer true because of the tax thing

      --
      lucm, indeed.
    5. Re:You can't make this stuff up by sunderland56 · · Score: 3, Funny

      A year ago Yahoo eliminated its test and quality assurance team

      Several years ago Yahoo eliminated it's customer base. That had a larger impact on their net worth than QA.

    6. Re:You can't make this stuff up by Anonymous Coward · · Score: 0

      Come on. You know you don't interrupt a good rant, especially if there's no basis for it.

    7. Re:You can't make this stuff up by jrumney · · Score: 1

      Several years ago Yahoo eliminated it's customer base. That had a larger impact on their net worth than QA.

      It also had a major impact on the number of reported bugs in their software. I think we've found the magic formula folks!

  3. Do they know what QA is? by Razed+By+TV · · Score: 5, Insightful

    If your QA people are adding to the problems, you are probably doing it wrong.

    1. Re:Do they know what QA is? by Teancum · · Score: 2

      I couldn't agree more. It sounds like they were more interested in the QA process than actually having people as a part of the overall software development team that try to break code and find flaws.

      There are multiple ways to accomplish the goal of finding bugs, where the worst place to have them reported is by customers. Is that what Yahoo is hoping for now?

    2. Re:Do they know what QA is? by QuietLagoon · · Score: 1
      If your QA people are adding to the problems, you are probably doing it wrong.

      .
      This.

    3. Re:Do they know what QA is? by Anonymous Coward · · Score: 0

      There are multiple ways to accomplish the goal of finding bugs, where the worst place to have them reported is by customers. Is that what Yahoo is hoping for now?

      They didn't claim so.

  4. Oh, they re-invented Test Driven Development. by mikelieman · · Score: 3, Insightful

    >It has also, he said, forced engineers to develop tools to automate the kinds of checks previously handled by teams of humans. An engineer might go through an arduous process of checking code once—but then would start building tools to automate that process.

    I suspect they're too dumb to realize this and just tell everyone, "We're saving money and delivering better code using TDD"

    --
    Technology -- No Place For Wimps! Grateful Dead and Jerry Garcia Chatroom -- http://www.wemissjerry.org
    1. Re: Oh, they re-invented Test Driven Development. by JoeMerchant · · Score: 5, Interesting

      Where are my mod points? TDD is not the elimination of test and quality assurance, it's the procedualization / automation of it - along with driving it further forward in the product development cycle.

      To do TDD, you need less (or no) QA people at the end, and more QA work in early development. If you choose to do this by firing the QA department, you probably are getting your product to market slower. If, instead, you transition the frustrated programmers who have been stuck in QA since graduating into design, implementation, and maintenance of automated tests for the project, you're probably winning big.

    2. Re: Oh, they re-invented Test Driven Development. by TWX · · Score: 4, Interesting

      I very much doubt that they were smart enough to begin the transition to TDD before they eliminated their QA department.

      I worked quality assurance at a very-much test level without really delving into code. Programmers can be effin' stupid at times. I was testing daemons for communications protocols. I took four approaches. Verify that it does what it's supposed to do per RFC. Investigate the behavior when confronted with stale RFCs. Investigate the behavior when it's confronted with non-RFC input that is commonly available in end-user applications (ie, non-malicious incorrect use), and investigate the behavior when malicious intent is used. I can tell you that programmers working on these protocols wrote them to current-RFC only and that they were quite upset when testing obsolete commands from previous versions of RFC broke things, or when the third-party applications sent stuff to the daemons and broke them. I would have been understanding if the software had failed gracefully, with a warning or a 500 code or the like, but when sending obsolete POP3 commands to a POP3 daemon causes it to crash hard, or when encoding an attachment with Mac BinHex instead of MIME makes it crash, both of which were user-selectable options in then-popular Eudora (the client that the company itself used) then there's a big problem. I didn't even have to get to the level of malicious testing things were so bad.

      The point of a good quality assurance tester is to concoct out-of-the-box but plausible tests to try to break it. It has a lot in common with Security; it requires a degree of white-hat maliciousness and a need to use other kinds of experiences from other disciplines to devise the scenarios to use. It also requires the tester to have good communications skills as they may have to work to convince the development team that what they've found actually is a problem and being too antisocial or too introverted might not get problems corrected even if they are important and are discovered.

      Yahoo is doing a hell of a job in convincing me that they're really not worth paying attention to anymore. They are taking a position that is risky and is arguably excessively risky relative to the size and position of the company.

      --
      Do not look into laser with remaining eye.
    3. Re: Oh, they re-invented Test Driven Development. by Junta · · Score: 1

      you transition the frustrated programmers who have been stuck in QA

      Most traditional QA people I deal with are not programmers, they represent roughly the level of skill of what real end users would be.

      you need less (or no) QA people at the end

      If you have *no* QA people at the end, you are putting way too much faith in your automated testing. It's true that in practice the 'end' QA goes smoother when you have automated testing in CI, but the tests are not perfect and the real world will involve real humans and you need real human perspective that isn't up to their eyeballs in the implementation. When you build the software, you lose a lot of perspective of how your end user would use it. You more and more strongly assume your end user has all your experience and understands the underpinnings and make quirky design decisions as a result. Having an outside perspective to bring you back to earth is important.

      --
      XML is like violence. If it doesn't solve the problem, use more.
    4. Re: Oh, they re-invented Test Driven Development. by Anonymous Coward · · Score: 0

      The point of a good quality assurance tester is to concoct out-of-the-box but plausible tests to try to break it.

      This is one function of QA that makes them worth their weight in gold. As a developer, I cannot think up all of the edge cases, especially if the user interface gets changed and I'm not directly involved. I do my best to test all aspects but there will always be things that I either didn't think of or are not in my control. QA have saved me from allowing some really nasty mistakes through to production and for that I buy them all a beer.

      Any company who thinks QA can be replaced though automated tests is a company doomed to fail

    5. Re: Oh, they re-invented Test Driven Development. by lucm · · Score: 2

      To do TDD, you need less (or no) QA people at the end, and more QA work in early development.

      Wrong. You need less QA people at the end and more *BA* work in early development. Those are two totally different things.

      --
      lucm, indeed.
    6. Re: Oh, they re-invented Test Driven Development. by NormalVisual · · Score: 1

      It also requires the tester to have good communications skills as they may have to work to convince the development team that what they've found actually is a problem and being too antisocial or too introverted might not get problems corrected even if they are important and are discovered.

      This is important. I generally take the attitude that the QA people aren't idiots, and I assume from the start that whatever they bring me is in fact a problem until I discover otherwise. If there's a disagreement on whether something is a bug or not, at least one of us isn't understanding the desired behavior and it's important to work through that until we find where the problem is, whether it's bad code, a bad test plan, or unclear requirements.

      --
      Please stand clear of the doors, por favor mantenganse alejado de las puertas
    7. Re: Oh, they re-invented Test Driven Development. by Anonymous Coward · · Score: 0

      Where are my mod points? TDD is not the elimination of test and quality assurance, it's the procedualization / automation of it - along with driving it further forward in the product development cycle.

      Ha ha ha, nope. TDD only makes sure that your code does what *YOU* think it should do[1], QA makes sure your code does what a *USER* thinks it should do and doesn't do what a malicious user or attacker would like it to do[2].

      [1] Unless QA is writing your tests, a la ATDD
      [2] If they're any good, at least. Most "QA" is just non-technical people mashing buttons so not particularly surprising that they're mostly worthless. The problem, of course, is that hiring SDETs capable of doing both broad and deep testing costs as much as hiring a developer.

    8. Re: Oh, they re-invented Test Driven Development. by phantomfive · · Score: 1

      I worked quality assurance at a very-much test level without really delving into code. Programmers can be effin' stupid at times. I was testing daemons for communications protocols. I took four approaches. Verify that it does what it's supposed to do per RFC. Investigate the behavior when confronted with stale RFCs. Investigate the behavior when it's confronted with non-RFC input that is commonly available in end-user applications (ie, non-malicious incorrect use), and investigate the behavior when malicious intent is used

      Wow. You are awesome at QA.

      --
      "First they came for the slanderers and i said nothing."
    9. Re: Oh, they re-invented Test Driven Development. by JoeMerchant · · Score: 1

      As a developer, I cannot think up all of the edge cases,

      As a singular human being, you have a singular perspective on the problem - that's what's nice about having a "separate" QA department - people who see things differently - looking at the problem too. Sure, you can "pair off" with the guy in the next cube and do a little better than just looking at it yourself, but if the testers answer to a different management chain and see the product at intervals rather than minute to minute during development, they're going to inherently have a more diverse perspective. Ideally, they'd have the customer's perspective, but that's hoping for a bit much.

    10. Re: Oh, they re-invented Test Driven Development. by JoeMerchant · · Score: 1

      Crash hard based on input is just inexcusable, period. But, yeah, I've met the "by the book" solvers - frustrating to work with, but if you get ultra pedantic with them, you can eventually get them to implement a little common sense.

    11. Re: Oh, they re-invented Test Driven Development. by tgv · · Score: 1

      That's not TDD. It's a description of plain unit testing, possibly integration testing, and it only speaks of the hope it will be adapted.

    12. Re: Oh, they re-invented Test Driven Development. by TWX · · Score: 1

      It also helps that the QA engineer has no personal connection to the code. He treats the software as livestock, not as a pet. He isn't bound by personal feelings keep it alive, he can euthanize if it needs it.

      --
      Do not look into laser with remaining eye.
  5. Money Quotes by coop247 · · Score: 5, Funny

    Hilariously full of idiot speak:

    "We forced excellence into the process"
    "caused a paradigm shift in how engineers thought about problems"
    "even if you fail sometimes, overall you are doing better"

    --
    //TODO: Insert catchy phrase
    1. Re:Money Quotes by Opportunist · · Score: 1

      A Bullshit Bingo gold mine.

      --
      We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
    2. Re:Money Quotes by JustAnotherOldGuy · · Score: 1

      Hilariously full of idiot speak:

      "We forced excellence into the process"
      "caused a paradigm shift in how engineers thought about problems"
      "even if you fail sometimes, overall you are doing better"

      Lol, no shit...I'm going to print this out and frame it. And if anyone in my office ever utters any of those phrases, I'm going to hit them over the head with the framed print.

      --
      Just cruising through this digital world at 33 1/3 rpm...
    3. Re: Money Quotes by Anonymous Coward · · Score: 0

      They're going broke, so they need to reduce costs by getting rid of QA. Then they spin the action as they're being innovative, acting on insights that everyone else has missed and are too stupid and/or Impatient to implement.

      Reducing quality is the first rotation around the death spiral.

    4. Re:Money Quotes by Anonymous Coward · · Score: 0

      On another hand, if you are a large bureaucratic organisation, chances are you have to force excellence into processes, make people responsible for what they do by removing other layers of people that could be designated as responsible for errors made in first place because they failed to check them, etc. Since you are doomed to failed anyway, try to fail less overall.

      I am working into a large bureaucratic organisation and there is many and too often days you cannot make something work because no one seems responsible anywhere. This is not as idiotic as it may appear.

    5. Re:Money Quotes by Anonymous Coward · · Score: 0

      Remind me to avoid the products your company makes, and especially to avoid applying to work there.

      "We forced inspirational quotes over the heads of our process engineers"
      "caused a shift towards the crapper in how engineers thought about positive thinking"
      "even if you fail sometimes, it's too much to work here. you're fired, bozo"

    6. Re:Money Quotes by Anonymous Coward · · Score: 0

      the other day they were a PHP programmer who worked out of a home office and took vacations in Tahiti

    7. Re:Money Quotes by Anonymous Coward · · Score: 0

      But did they leverage their synergies and core competencies to create a strong value proposition?

  6. Awesome Idea! by PvtVoid · · Score: 1

    Can't wait until Boeing and Airbus do this!

    1. Re:Awesome Idea! by JoeMerchant · · Score: 1

      ISO 9000 has been driving "quality" into the design phase of the project for 20 years. If you've stopped "testing quality into the product at the end of development" then, you've adopted QA tech that was mandated in many industries in the mid 1990s.

    2. Re:Awesome Idea! by JoeMerchant · · Score: 1

      Put another way, Boeing and Airbus have been doing this for a very long time - when is the last time a passenger jet design was constructed and flown by a "test pilot" to shake out the bugs and check for nasty handling behavior?

    3. Re:Awesome Idea! by mikael · · Score: 1

      With the fly-by-wire systems, all the testing can be done with mock-up flight decks and flat-screen displays. The funny thing is that glass cockpit displays only were introduced because it was cheaper to simulate expensive instruments using computer graphics, but the pilots preferred the flat screens to the actual instrumentation.

      --
      Vintage computer adverts: http://www.vintageadbrowser.com/computers-and-software-ads
    4. Re:Awesome Idea! by TWX · · Score: 3, Insightful

      They still do a lot of end-stage testing though. Pressure testing, structural testing, failure-mode testing, load testing, load-shift testing, strike testing, and probably all other manner of tests. They do perform a lot of tests as they develop but that's no replacement for the final-stage testing that confirms predicted behavior or verifies that systems integrate as expected.

      To pretend that there's no end-stage testing is simply ridiculous.

      --
      Do not look into laser with remaining eye.
    5. Re:Awesome Idea! by Teancum · · Score: 1

      when is the last time a passenger jet design was constructed and flown by a "test pilot" to shake out the bugs and check for nasty handling behavior?

      You are aware that there still are test pilots who fly prototype commercial jet prototypes and often even push the limits of what those vehicles can do. They test sub-systems for potential failure modes and do other things to "shake out the bugs and check for nasty handling behavior" under extreme conditions that likely would never actually happen on a routine flight.

      Admittedly the engineers of these vehicles have a long history to draw from and they are doing mostly minor incremental changes with each new model that is being made, so those test pilots are usually not risking life and property during those test flights.

      Such test flights are still a part of any aviation certification program and are required by the FAA before certification is granted for that model.

    6. Re:Awesome Idea! by twisted_pare · · Score: 1

      Sure, Boeing knows the plane will actually fly before it's first test flight, but there is a reason that first test flight (i.e. Dreamliner) only has the minimum possible crew, they're all wearing bright orange rescue suits, and they don't dare retract the gear. There are a ton of parts, and they all need testing. For example, the brand new 747-800 had to get software fixes for wing flutter http://www.seattletimes.com/bu.... This is something designers and software testing had missed. So yes, A & B still do flight testing, with test pilots for a reason.

      --
      HTFU
    7. Re:Awesome Idea! by matfud · · Score: 1

      Every aircraft made by both companies is first flown by a production test pilot before delivery.

    8. Re:Awesome Idea! by JustAnotherOldGuy · · Score: 1

      As an ex-Boeing guy, one of the driving forces behind the whole glass cockpit thing was the versatility of the system- the fact that a given area on the dashboard (where space is always at a premium) could be used to display anything, ie. whatever was most needed or most useful to the pilot at that moment. Infinite flexibility coupled with easy customization was a huge step forward.

      Don't need the engine temp readouts at the moment? Use the same space to display the oil-pressure readings or the intake temps or whatever you want.

      The problem that glass cockpits produced was potential information overload, which often leads to "analysis paralysis" where they spend all their time wading through data and forget to fly the plane.

      --
      Just cruising through this digital world at 33 1/3 rpm...
    9. Re:Awesome Idea! by Anonymous Coward · · Score: 0

      I used to write code for Boeing and have over 400 hours on a real simulator (no motion or window, only mcdus and efis) testing out my software. I used to tell people that I was a test pilot. Really ;)

      Most of the software was written mechanically translating the sdd into code. They write the right stuff is a very good description of the process. See also DO-178B

    10. Re:Awesome Idea! by PPH · · Score: 1

      Boeing takes every new airplane up on a 'shakedown flight'. I know. live right under their flight path (and I used to work there). I have an ADS-B receiver and I can see when they take off and turn right around to land again. Every once in a while, one flies over my house low and slow with the gear stuck down.

      Boeing's problem is that they don't do as much 'unit testing' as they used to. Slap it together, shove the pilot into the cockpit and go. If it comes back, deliver it. They are pretty good at making sure normal systems operations are OK through tight process controls. But passive faults have a tendency to slip through. You can't test the engine fire detection system (for example) by having an in-flight fire on every new airplane.

      --
      Have gnu, will travel.
    11. Re:Awesome Idea! by zippthorne · · Score: 1

      When was the last time a passenger jet design was constructed, sold, and delivered to customers without ever having been flown by a test pilot?

      --
      Can you be Even More Awesome?!
    12. Re:Awesome Idea! by Hognoxious · · Score: 1

      I worked at an instrument maker and they told me it was to simplify the spares situation; you don't need to keep [at least] one of every specific instrument to hand, just a few generic boxes that you flash the right software onto.

      --
      Confucius say, "Find worm in apple - bad. Find half a worm - worse."
    13. Re:Awesome Idea! by JoeMerchant · · Score: 1

      As a person with aging, used to be 20/10, vision, I would imagine that the glass cockpits also allow for larger, more legible readouts than a panel of fixed analog needles, gauges, etc.

    14. Re:Awesome Idea! by JoeMerchant · · Score: 1

      There's a difference between testing the assembly correctness and testing the design.

      Software is a design-only product, very few problems in reproduction of the binaries.

    15. Re:Awesome Idea! by matfud · · Score: 1

      So yes they do have testing through out the production and they still have some bod who straps in and takes it for a ride.

  7. How???? by wisnoskij · · Score: 1

    How is checking for bugs supposed to add bugs? If you are not modifying the source code, it should be impossible to add bugs to it. Are they implying that these QA people were mistakenly listing features as bugs, and then the programmers were going in an removing features and replacing them with bugs?

    --
    Troll is not a replacement for I disagree.
    1. Re:How???? by WinstonWolfIT · · Score: 1

      I expected this reaction. You just don't get it. Testing hasn't been eliminated, simply the silo. I've worked on a few tester-free teams and it's been an unbeatable experience.

    2. Re:How???? by Opportunist · · Score: 1

      By finding a bug that happens once in a blue moon when the stars are aligned, getting development to remove that bug and introduce two new ones that happen more often but can't be fixed now anymore 'cause, you know, release date.

      --
      We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
    3. Re: How???? by John+Allsup · · Score: 1

      If software engineers know they have a safety net to pick up their mistakes, they can get complacent and become less careful about making errors, so as to get their work 'finished' quicker. The best way to avoid bugs is not to write them in the first place, but learning the degree of care and atention required is hard, and people will often (maybe instinctively) try to avoid this difficulty if they can. The root is psychology and complacency/laziness.

      --
      John_Chalisque
    4. Re:How???? by Anonymous Coward · · Score: 0

      Just because nobody's finding the bugs in your code doesn't mean they're gone. I've worked on tester free teams as well and the quality of the software was horrible. I find developers who dislike QA are usually just bad developers who don't like it being pointed out.

      I think perhaps you're the one who just doesn't get it.

    5. Re: How???? by Anonymous Coward · · Score: 0

      My bugs are usually caused by me misunderstanding business logic. It helps a lot to have another person to make sure both understand it the same way.

    6. Re: How???? by NormalVisual · · Score: 1

      The best way to avoid bugs is not to write them in the first place, but learning the degree of care and atention required is hard, and people will often (maybe instinctively) try to avoid this difficulty if they can. The root is psychology and complacency/laziness.

      Sometimes it's not laziness on the coder's part, but rather pressure from above. Even when using the most efficient development methodologies, care and attention to detail still take time. Some coders just don't have the cojones needed to tell management, "it's not been sufficiently tested yet, so you'll have to wait" and let themselves be pressured into releasing code that they know isn't ready.

      --
      Please stand clear of the doors, por favor mantenganse alejado de las puertas
    7. Re:How???? by Sigma+7 · · Score: 1

      How is checking for bugs supposed to add bugs?

      It doesn't. Rather, it's the improper QA that either introduces bugs or causes them to remain undetected.

      Proper QA prevent stories like those found on The Daily WTF.

    8. Re:How???? by gweihir · · Score: 1

      That would make sense.

      --
      Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
  8. Yahoo messenger by Anonymous Coward · · Score: 0

    Yeah we saw the result on Yahoo messenger for android...
    A COMPLETE and UTTER Disaster.... They took a working app and turned it into CLUSTERF$%*K of a cartoonish joke.

    NOW at least we know WHY they messed it _THAT_ much !

  9. I have a better idea... by QuietLagoon · · Score: 1
    ... How 'bout Yahoo eliminates the management structure, i.e., the "Yahoo tech execs", that came up with this idea.

    .
    I certainly haven't seen an increase in the quality of Yahoo recently, indeed, the mail service's quality has taken a nose dive.

    The supposed "success" of this experiment is probably due more to the Yahoo tech execs wanting themselves and Yahoo to look good for the sale of the company than anything else.

    1. Re:I have a better idea... by JoeMerchant · · Score: 1

      Do you use Warp Drive? Do you even know what Warp Drive is? I don't.

  10. "Tough Parenting", translation: by Anonymous Coward · · Score: 0

    "We see our employees as children"

    1. Re:"Tough Parenting", translation: by geoskd · · Score: 1

      "We see our employees as children"

      At least its better than "We see our employees as cattle"

      --
      I wish I had a good sig, but all the good ones are copyrighted
    2. Re:"Tough Parenting", translation: by Ian+A.+Shill · · Score: 1
      "We see our employees as chattel"

      "We see our employees as children"

      At least its better than "We see our employees as cattle"

      --
      For hire.
  11. Re:Well of course by mikael · · Score: 1

    To me, software development is more plumbing than anything else. Take data from one end of a pipe, do something with it, store it somewhere, send it off somewhere else. That's where the engineering bit comes in. Problem is, every engineer has their own standard of building stuff.

    --
    Vintage computer adverts: http://www.vintageadbrowser.com/computers-and-software-ads
  12. I call Bullshit by rsilvergun · · Score: 1

    they're just making the programmers do their own testing. I'm sure the "tough parenting" consisted of "Ok Jimmy, now if we find bugs we'll fire and replace you".

    --
    Hi! I make Firefox Plug-ins. Check 'em out @ https://addons.mozilla.org/en-US/firefox/addon/youtube-mp3-podcaster/
  13. "And the pain wasn't as great as expected" by PolygamousRanchKid+ · · Score: 1

    Pain for Yahoo? Or pain for their customers?

    I don't care about the total number of errors. What counts, is the severity of those errors. I deal with a misspelled message. I can't deal with a system crash.

    I believe that it is very important to have a non-coder to test software. As a friend put it:

    If I print out a message saying, "Press the space bar to continue", the user will press every key except the space bar, in combination with ctrl and alt."

    A coder won't do that. Coders are simply to smart to test.

    --
    Schroedinger's Brexit: The UK is both in and out of the EU at the same time!
    1. Re:"And the pain wasn't as great as expected" by sunderland56 · · Score: 1

      Pain for Yahoo? Or pain for their customers?

      Yahoo has the luxury of not being critical software. If there's a bug, people either work around it or use something else; when your product is given away for free, expectations are low.

      I wouldn't expect the same plan to work for things like banking software, or medical imaging software, where the consequences of a bug are much more serious.

  14. That explains a lot by Leuf · · Score: 1

    Such as why the weather module is incapable of keeping track of what day of the week it is or what city it it supposed to show. It definitely shows some weather happening somewhere though. When the whole site doesn't just give up and give error messages everywhere, that is.

  15. The Emperor's New Bugs by Anonymous Coward · · Score: 0

    A group of programmers were presenting a report to the Emperor. "What was the greatest achievement of the year?" the Emperor asked. The programmers spoke among themselves and then replied, "We fixed 50% more bugs this year than we fixed last year." The Emperor looked on them in confusion. It was clear that he did not know what a "bug" was. After conferring in low undertones with his chief minister, he turned to the programmers, his face red with anger. "You are guilty of poor quality control. Next year there will be no 'bugs'!" he demanded. And sure enough, when the programmers presented their report to the Emperor the next year, there was no mention of bugs.

  16. Show some respect! by Anonymous Coward · · Score: 0, Troll

    Holy fuck, do you know who you're talking to?!

    That's Bill McGonigle! Not just any Bill, and not just any McGonigle, but the Bill McGonigle!

    Now I don't know who he is or what he's accomplished, but with a name like Bill McGonigle, I just feel the need to show him a lot of respect. And so should you!

  17. Perfect Sense by LostMonk · · Score: 1

    Makes perfect sense to me.
    My doctor is always nagging me about heart care -- less carbs, less sugar, less fatty food, exercise more... nag, nag, nag.
    A few months ago I stopped visiting my doctor. I'm much more relaxed now. So far, so good.

  18. Just use Rust! by Anonymous Coward · · Score: 0

    I don't see why QA is needed at all. All you need to do is use the Rust programming language. On its home page it says "Rust is a systems programming language that runs blazingly fast, prevents segfaults, and guarantees thread safety." It sounds to me like Rust means that all programmers will write perfect software because Rust won't let them write buggy code.

    1. Re: Just use Rust! by Anonymous Coward · · Score: 0

      Not sure if serious.

    2. Re: Just use Rust! by __aaclcg7560 · · Score: 1

      You're a bit rusty if you can't tell the difference.

  19. Real engineers MUST do Q&A by Gim+Tom · · Score: 1

    In the real world of physical objects I can't think of any engineering discipline that does not have some type of Quality review and Assurance built into the engineering process. WOULD you like to fly on an aircraft that was never flown by a test pilot first? Would you like to work or live in a building that did not have the design and calculations for its strength and stability checked independently? I am an engineer who began his career working with the Big Iron mainframes of the late 1960's and early 1970's and ended up doing local area network design and security in the early to mid 2000's. For my first 15 plus years I was doing Q&A for very large mainframe systems application programs that were under constant revision. Over that time I was the first person other than one of the programers who touched hundred of programs and not one of them was without major errors when I first saw it.

    Once, in the mid 1990's, a new project manager who implemented new methodology and standards for the programmers cut my requested Q&A time from 6 weeks for a major system upgrade to one. He assured me that in the programs created with his new methods I wouldn't find any major problems. During only one hour of testing the very first program I produced over three detailed pages of major problems where the program either did not do things like it was supposed to or did other things that it was not, or sometimes just crashed. When I turned in my results the project manager didn't want to believe it, but I had documented everything and it took the programming team over a week to correct just those problems. Since there were a number of programs in this project and since my experience was the same with each, we did not release the new system to production for about eight weeks.

    Accountants and managers hate to pay for testing and quality control, but when they stop doing it it always comes back to bite them in the butt.

  20. Re:Well of course by Teancum · · Score: 1

    Software isn't real engineering, it's just patterns on a screen. How much quality assurance do you need to make a pretty picture appear on a screen?

    An obvious troll here, but I'll bite.

    There is a real discipline of software engineering. I'll also note that engineers from other engineering disciplines can't just pick up a programming textbook and learn on their own the skills which are needed for proper software engineering either, but it takes a whole bunch of skills and discipline that often isn't even learned in a typical Computer Science curriculum.

    Besides, if you think all software development is about making pretty pictures, you are also clueless about what computers actually do in the 21st Century. Most video game developers are not software engineers, although some do exist even there. Try telling the software engineers working at SpaceX or NASA's JPL that they are not doing real engineering some time... and you'll get an earful from people doing rocket science where a misplaced semicolon out of billions of characters in a code base can make an unfortunate bad day. The trick where JPL engineers were updating firmware on a vehicle sitting on Mars is something that took some real engineering.

  21. Re:Well of course by Anonymous Coward · · Score: 0

    That probably shows that you work on shite copy-everything spring bollocks and think is software. Do you work in a financial company?

  22. No its the same eyes by Anonymous Coward · · Score: 0

    No, he has the programmers improvising QA automated test to fix up his own mistake. But those tests are written with the same eyes, if they made false assumptions, then the test contain those false assumption because its the same team and same assumptions.

    Plus since when has automated testing been able to spot even a tiny fraction of bugs?
    If it did a mis-draw, would they use machine vision with aesthetic taste to spot it? Of course not.

    Jay Rossiter is clearly an idiot with zero experience in developing software.

    I was one of the top programmers in my company a few years back, I never ever wrote perfect code, or even code that was perfect after the nightly automated tests. To have written a test to spot the bugs, they would have to have had some crystal ball! If I didn't spot it, what hope is there that any QA automated test I write would spot it?

    Dumb, the guys a idiot.

    1. Re:No its the same eyes by Anonymous Coward · · Score: 0

      If it did a mis-draw, would they use machine vision with aesthetic taste to spot it? Of course not.

      Yeah, it's actually possible to have the automated tests compare the screen with a bitmap of what it's supposed to look like, and tag the places where it doesn't match. It's done all the time.

  23. The problem is a lot of QA isn't very good by NotSoHeavyD3 · · Score: 1

    Which if you're a decent developer you find out reasonably quickly which people in QA have a clue and which don't. With bad QA I've found I'm way more likely to find actual bugs than the QA person will.(Which means I need to find bugs anyway.) Here's an example. I was working on a legacy product and QA filed a few bugs that the text of a few labels on a dialog were wrong. Easy fix, just go into the resource editor and change them. However after double checking I had to point out something that the QA person missed. The dialog didn't actually work. (I mean it was useless since you couldn't use it to search for anything.) Unfortunately in the end they just had me fix the labels (that was the product managers call) instead of actually fixing the dialog.

    --
    Did you know 80 to 90% of the moderators on slashdot wouldn't recognize a troll even if one dragged them under a bridge.
  24. Just to be clear on this by NotSoHeavyD3 · · Score: 1

    My opinion on QA is that if you weren't capable enough to be a software developer then you weren't capable of being in QA either. Unfortunately it seems quite a few companies think that QA should be staffed with people who weren't up to being developers and pay accordingly. (This doesn't work and just annoys us developers.)

    --
    Did you know 80 to 90% of the moderators on slashdot wouldn't recognize a troll even if one dragged them under a bridge.
    1. Re:Just to be clear on this by __aaclcg7560 · · Score: 1

      My opinion on QA is that if you weren't capable enough to be a software developer then you weren't capable of being in QA either.

      That applies only to white box testers who need to know how the code works to write code-specific tests. Black box testers don't to need to know how the code works to test the entire application as a user would. The best black box testers are non-programmers, as they tend not to be linear thinkers and can crash the application in odd ways.

    2. Re:Just to be clear on this by NotSoHeavyD3 · · Score: 1

      Actually I find it's true of black box testers too. I mean I've had issues where QA would black box test my code by just banging away at it but literally have no idea what the code was supposed to do. (and then write bugs because they didn't know the result actually matched the expected behavior.) This is things like code written to interface with a piece of hardware. The hardware returned an error which the software displayed and they didn't bother to trouble shoot the result from the hardware to find out the software was reporting an error because that's what the hardware was telling them. (And yes, you could see the raw message from the hardware so they should have taken that message apart before writing the bug that the software showed an error.) Actually here's a good one where they didn't trouble shoot. They were complaining that the time stored in a database was messed up and didn't match the current time. So I did the easiest check I could and what did I see? The time on the database server was off and that's why the values being stored were wrong. (An easy thing to check for but you'd think they'd do a little troubleshooting before writing a bug.)

      --
      Did you know 80 to 90% of the moderators on slashdot wouldn't recognize a troll even if one dragged them under a bridge.
    3. Re:Just to be clear on this by __aaclcg7560 · · Score: 1

      Black box testing has a learning curve. Once you're familiar with the black box, you can refine your testing methodology. This happened to me as a lead video game tester. Nintendo is notorious for keeping all information about their hardware — including the dev kits — as proprietary. I found out a through a third-party development website that holding down two buttons on the dev console would dump debug info to the screen. Once I informed the rest of the department, we had an easier time getting Nintendo to accept our titles on the first pass.

    4. Re:Just to be clear on this by NotSoHeavyD3 · · Score: 1

      That's true however the company I work(not video games FWIW) for makes their own hardware and firmware internally and that stuff is all spec'd out and the guys that worked on it are a short 20 second walk. I've had to bring over QA people that have worked for us longer than I have over to the firmware/hardware department and show them that they do need to ask firmware/hardware if this is expected functionality and if they agree that software did what it should have. (More than once btw.)

      --
      Did you know 80 to 90% of the moderators on slashdot wouldn't recognize a troll even if one dragged them under a bridge.
    5. Re:Just to be clear on this by Anonymous Coward · · Score: 0

      My opinion on QA is that if you weren't capable enough to be a software developer then you weren't capable of being in QA either. Unfortunately it seems quite a few companies think that QA should be staffed with people who weren't up to being developers and pay accordingly.

      I disagree, but only slightly. UI and UX testing isn't really amenable to automation so you do need a small quantity of UI / UX testers that do need to have a very solid technical background to understand the product thoroughly but don't need to be as capable as a developer.

    6. Re:Just to be clear on this by Veretax · · Score: 1

      Programming is and isn't necessary to be a successful tester, but what is needed is a way to really get your mind around how the system works. For some, programming helps with that, for others, models, state transition diagrams, or a simple developer explanation of the architecture is sufficient. Let us also be clear, in saying, that knowing how to understand code, to read it, if you will, is a far cry from being able to code it, and to do so well.

      I've met some top notch testers who would never be confused with a programmer, but they could get to know the system and all its quirks and business rules better than some of the devs on the project. I've always respected people like that.

      So when an earlier comment says, we just fired all the bad testers and we had improvement, this actually doesn't surprise me. This is knowledge work, and that requires sapience and critical thinking a skill that both devs and testers need in good measure.

    7. Re:Just to be clear on this by Anonymous Coward · · Score: 0

      While I've certainly seen testers like that (many of them from our "partners" in India), I've also seen developers who don't have a clue how anything on our product works except their one little feature (and have to have someone else install the product itself so they can test their code).

      Our company also did the "we don't need testers" thing (they're not Agile, you know). It has certainly reduced our "time to release" and lowered the "bug count," but from what I've seen, it has greatly reduced our quality.

  25. Awfully quick by Anonymous Coward · · Score: 0

    They claim they did this in 2 years. I have my doubts that any large corporate software organization would go from a traditional methodology to TDD in that short a time. It would take at least 6 months to get all the developers the proper tools and training (even if some of them know how, not everyone does, and making sure everyone knows how to use the tools that get pulled in takes time). Then you have the process changes and glitches - how do the tests get run, how does the notification get sent when there are issues, how does a dev get more resources when s/he needs them?

    And then you have for cultural issues, like the obvious one - if I screw up, will I get fired? Will my manager/team leader get fired? If I raise an issue and someone overrules it, what happens when that issue turns out to be real? If something is taking longer due to unforseen problems, do the deadlines get extended, or does it turn into a death march?

    And all this assumes that the management chain is all on board - all it takes is a few stubborn VPs to delay it for a year.

  26. Smart AND dumb and the same time by davidwr · · Score: 1

    Too much double-checking just gets in the way. Not enough is a recipe for disaster. "None" is the extreme of "not enough."

    The questions are:

    * Will the limited quality-assurance work that developers are already doing by themselves be "enough"? Very doubtful.

    * Will the developers and development teams have the desire and time/resources to "step up to the plate" and do the necessary QA work that needs to be done? My guess is "Probably" and "Who knows?"

    --
    Knowledge is how to play a game, intelligence is how to win, wisdom is knowing what game to play.
  27. Yahoo has/had lousy QA anyway by Anonymous Coward · · Score: 0

    My main experience with Yahoo is Yahoo Groups. Worst web app I've used on a regular basis. Pretty much nothing works as you might expect, and it certainly doesn't do it every time. I honestly don't know why they think it works.

    If this is what the QA team could provide, they should have been jettisoned long ago. As should the development team. It's a miracle they are still in business.

    On the minus side, this will be a signal to idiot managers everywhere that it's okay to nuke your QA team. 'The big boys are doing it, so it must be good'. Not unlike an 'open' office layout.... Gack.

    1. Re:Yahoo has/had lousy QA anyway by careysub · · Score: 1

      My main experience with Yahoo is Yahoo Groups. Worst web app I've used on a regular basis. Pretty much nothing works as you might expect, and it certainly doesn't do it every time.

      I second this. And it has been getting worse. Major function breakdowns in 2009, a new site design in 2010 that worse than the old one, then the curse of the "neo" roll-out in 2012, worse still than the one before. It is said to be the largest collection of discussion groups on the Web, but it is almost unusable. There were decent designs for discussion groups for decades to borrow from, this is not rocket science.

      At this point, going to to Yahoo Groups has been so painful for so long, that I am reluctant to give it another shot to see if I can use it again.

      --
      Starships were meant to fly, Hands up and touch the sky - Nicky Minaj
  28. Translation: Yahoo will be toast very shortly by rcase5 · · Score: 1

    Having been in the industry for over 20 years, and also having been in QA for 8 of those years, my experience says that when a company decides to eliminate their QA department, the company is circling the drain. When a company is looking to cut costs and there is very little to no fat to trim, the first target is often QA.

    One company I worked for, a company of 35 people, cut 5 of those positions. Two of them were QA headcount, including the Director of QA. The QA department then reported to a then recently-hired Vice President of Engineering, which is a spectacularly bad idea! The company was acquired a little over a year after that layoff, and the new company eventually let go of all of those people a few months after the acquisition.

    Another company I worked for laid off 70% of their workforce, which included the entire QA department. There were obvious bugs and mistakes on their web sites and web-delivered services for over a year after that layoff. They were eventually bought by another company about 2 years later.

    So, it is my considered opinion that Yahoo is in serious trouble. I predict they will either be acquired or go bust within the next year.

  29. The end of Yahoo.... by Anonymous Coward · · Score: 0

    And so went Yahoo silently into the night. Bell tolls for Yahoo.

  30. Different types of QA by davidwr · · Score: 1

    TL;DNR version:

    QA can be divided into different skill-sets, and some of these skill-sets come cheaply. You do get what you pay for though.

    Long version:

    Finding the wrong labels ("search here" mis-spelled) is a good task for someone who has a good eye for what looks good visually. You don't have to have a customer's or developer's eye for that. While this is something that people tend to either have or not have, it's a common-enough skill that you can use relatively low-paid, low-trained, or community-college-intern-level people who aren't on a track to become programmers do to it. Such talent command more than a McJob, but far less than a full-fledged QA person. You could pay a recent high school graduate with demonstrated experience doing this work $MID-TEENS/hour (higher in expensive-to-live cities) in most of the US and get good results and have a happy employee.

    Finding logic bugs (search function doesn't work) takes a bit more brains. $MID_TEENS isn't going to cut it unless there are special circumstances (a family business, a startup where the "real pay" is an equity stake, a charity where the employee is willing to work for peanuts, etc.).

    Finding user-interface design issues (where to put a search box, how many clicks does it take to do a search, etc.) takes someone who can see things through a customer's eyes. This isn't going to be cheap either. The bulk of the UI work should be done before initial coding (exception: If you are using any kind of rolling-prototype-that-becomes-the-product-over-many-iterations development technique, you will be tweaking or even re-designing the UI throughout, so plan accordingly). Having a UI person on board at this early stage is very useful, especially for a product that will see wide release. Having a UI person look over the product as it goes through development and testing to find bugs (where the implementation doesn't match the design, or where the design turns out to be flawed or infeasible) is also useful, but ideally by this time they won't have much to say other than "it's working as designed."

    To some degree seeing things through your customer's eyes is an innate talent in the sense that it "come easy" to some people and it's "hard to teach" to others. Some programmers have it. Some don't. Some non-programmer have it, some done (non-programmers should at least be aware enough about programming and the tools the programmers are using to know what is and isn't feasible to do on a given project, or they might "demand" a seemingly-simple change that just isn't feasible).

    --

    The above is for a project that's getting large-scale release or where failure in any one area will be very expensive. In-house software projects, projects that are small enough that it's okay for the business if the project is a marketplace flop, etc. don't necessarily need this level of testing.

    --
    Knowledge is how to play a game, intelligence is how to win, wisdom is knowing what game to play.
    1. Re:Different types of QA by Anonymous Coward · · Score: 0

      I found the bug in your post, you swapped $MID-TEENS for $MID_TEENS halfway through.

      Granted, the compiler would have caught this, but without seeing the rest of the code it is hard to know, perhaps the two forms are used internally to denote variable values pre and post some important operation.

      Do I get a job now?

  31. A Yahoo recipe for disaster... by __aaclcg7560 · · Score: 1

    When I worked at as a lead video game tester, a developer figured out the password to the bug database, zeroed out all the outstanding issues (including some serious show stoppers) for their game, and pushed for a code release meeting. This was done to stay on schedule for the milestone and bonus payments. Fortunately, management backed up the QA department and took a hard line stance against the developer.. Since the bug database got compromised, we spent six weeks re-testing all 3,000+ bugs. The developer had to fixed all the outstanding bugs for free, as management refused to payout their final milestone and bonus payments.

    1. Re:A Yahoo recipe for disaster... by Anonymous Coward · · Score: 0

      that developer should have been fired and prosecuted for vandalism and theft

    2. Re:A Yahoo recipe for disaster... by __aaclcg7560 · · Score: 1

      Actually, the developer wanted the lead tester fired for having a weak password on the bug database. That developer got fired after the product shipped.

    3. Re:A Yahoo recipe for disaster... by NormalVisual · · Score: 1

      The developer had to fixed all the outstanding bugs for free, as management refused to payout their final milestone and bonus payments.

      I'm surprised that's all that happened. I would have thought there would have been some legal consequences.

      --
      Please stand clear of the doors, por favor mantenganse alejado de las puertas
    4. Re:A Yahoo recipe for disaster... by __aaclcg7560 · · Score: 1

      The video game was a flagship product. Both management and the developer needed to get it out the door to protect their respective companies. A public legal spat would have ruined everything for everyone.

    5. Re:A Yahoo recipe for disaster... by careysub · · Score: 1

      that developer should have been fired and prosecuted for vandalism and theft

      It would seem that they made a strategic decision that getting him to deliver his code to keep the project close to schedule was more important.

      --
      Starships were meant to fly, Hands up and touch the sky - Nicky Minaj
    6. Re:A Yahoo recipe for disaster... by cfalcon · · Score: 1

      > Actually, the developer wanted the lead tester fired for having a weak password on the bug database

      Hahaha what a perfect monster.

    7. Re:A Yahoo recipe for disaster... by Gazzonyx · · Score: 1
      Did that developer honestly believe that everyone would just say "oh, it seems like all the bugs are gone even though they weren't closed and they were here Friday, but it's all good because it just so happens one of the devs wants to discuss pushing the now bug free code!"?

      I've been lucky, my end users are our technicians and 9 out of 10 times they can point out _exactly_ where a bug is, can reproduce it and only need me to verify some stuff from the back end. The other night I got a phone call that started with "Hey, you busy? $largeClient is giving us funny results and it looks like a false positive..." In about 20 minutes in WebEx (when it gets to the Linux CLI the technicians know enough to get around, but usually just pass off the screen to me because I know it better and where files are off the top of my head for each version of our appliance, which works well since they are very familiar with getting connected to various companies VPNs and I'm very familiar with the CLI - it really speeds up the process when people are familiar with one aspect and can get to point B to pass off to someone that can accelerate to point C, etc), I was able to get them to walk me through what they were seeing and then verify some of my assumptions. It's a pleasure when you can talk to someone and say "okay, wait, I thought that the output should be this if XYZ, but I have no idea where that came from." and they give you an answer I'd otherwise have to research for hours to find out with a simple, "Oh, yeah. Cisco changed that in UCOS 10.5 because they changed the platform to VMWare 6.0. You can check the platform version this way." Of course, I'm lucky enough to work at a place where even the people that don't code, write code (usually, but not always, crappy code, but they're smart enough to know that and thus aren't dangerous). Good end users/testers/bug reporters are a joy to work with.

      --

      If I mod you up, it doesn't necessarily mean I agree with what you've said, sorry.

  32. Why I don't code anymore.. by xtal · · Score: 1

    Yeah, f--k that noise.

    I work with money now and code for fun. Suggest those with options consider similar alternatives. Life is a lot better.

    --
    ..don't panic
  33. Do they mean QC or Engineering Test? by Anonymous Coward · · Score: 1

    We have a pretty good engineering test group. We do telecom products, so the test equipment is expensive. The engineering test group has most of the test equipment, and understand the application domain probably better than the developers. Plus (although we don't say this out loud) they're cheaper per hour than developers. They do white-box (make sure that if you configure x and y z happens) and black-box (poke the buttons and make sure it doesn't crash) testing.

    It works out pretty well. We (developers) can bang stuff out, doing our best, but knowing it doesn't have to be perfect because the test guy is going to check it. And he costs less than a developer (and we can't give each developer a complete system with all the necessary test equipment). 90% of the time the fix or feature is good, 10% it isn't, engineering test finds it and kicks it back.

  34. Could somebody mod this guy up? by NotSoHeavyD3 · · Score: 1

    You stated this better than I could.

    --
    Did you know 80 to 90% of the moderators on slashdot wouldn't recognize a troll even if one dragged them under a bridge.
  35. Great! The minions will follow by btroy · · Score: 1

    What I'm worried about now is how other corporate minions will look at this and go. Great IDEA! While automated tests are good and should have been there before, they aren't the magic bullet in systems that recognize you tried that even before and change the result purposefully. In many cases, a flubbed web page or search results probably won't cost Yahoo! millions or even kill someone. In other industries it can be absolutely a disaster. Let's hope the minions think this time around. They're already chasing the Yahoo! CEO's act to reduce/kill work from home.

  36. Re: customer-reported problems by FlaSheridn · · Score: 2

    Management takes customer-reported problems very seriously.

    And how seriously do they take ex-customers not reporting problems because they gave up in disgust instead?

  37. That Works To A Point by Greyfox · · Score: 1
    That can work to a point, if you make the developers who wrote the code support it, too. That's getting in to devops territory. As long as you have a few developers who hate getting called in on the weekend to fix their broken shit and a manager who's willing to allocate some time to push for quality, it can work reasonably well. Your deploy process also has to support very easy rollbacks.

    I do a lot of maintenance programming and come in years after the original code was written -- my last project had C files with comments going back to the early '90's and K&R function declarations in some of the older headers. I don't recall ever encountering unit tests on any of the projects I've come in on, and the code is usually too tightly coupled to start adding them. Though if I do any significant new development, it's usually in the form of unit tested libraries that I can then integrate into the software.

    I'm usually the one pushing for quality enhancements, because I hate getting called in on the weekend. I also hate deploying blindly to production. Often, the companies systems are also extremely tightly coupled, so setting up a test environment and a basic regression suite is also very difficult. A lot of the problems I see I attribute to very little actual accountability on the parts of the developers and designers. I think if they're the ones who end up having to support the code, there'd be a lot more consideration of quality in the design and implementation phases. That's probably what Yahoo's tapping into.

    There are some drawbacks to that method of development, though. Poor quality deploys can definitely piss off your customer base. You also only find the bugs the customers find and report to you. A few projects ago, I was looking at a web front end a company put together for user management. For testing these, the software I was using at the time would act as a proxy to the server and completely bypass the javascript UI once you started playing back your tests. Unfortunately, all the data validation was happening on the client side. Naturally one of the tests I wrote was to try to enter a user with full administrative access on the system from an account that didn't have permission to create users. They system happily accepted it. I got some push-back from the developer when I reported it, because I was "making direct calls to the back end! No one's ever going to do that!" It's difficult not to be... hostile... in the face of that sort of ignorance.

    Luckily for that guy, and for Yahoo, the sort if software I was using at the time is not readily available. You'd actually have to open up a web browser and go to a site on the internet to find something like that! No one's ever going to think to do that! And the sort of people who know how to do that sort of thing would never misuse that knowledge to steal billions from your company or embarrass them like that time with Sony. Or that other time with Sony. Or... hey, you guys remember that time with Sony? Yeah... that was a good one! Or that other time with all those people cheating on their spouses. I'm sure those were just flukes! So I'm sure this policy will in no way backfire on Yahoo!

    --

    I'm trying to teach myself to set people on fire with my mind... Is it hot in here?

    1. Re:That Works To A Point by Gazzonyx · · Score: 1

      [...] There are some drawbacks to that method of development, though. Poor quality deploys can definitely piss off your customer base. You also only find the bugs the customers find and report to you. A few projects ago, I was looking at a web front end a company put together for user management. For testing these, the software I was using at the time would act as a proxy to the server and completely bypass the javascript UI once you started playing back your tests. Unfortunately, all the data validation was happening on the client side. Naturally one of the tests I wrote was to try to enter a user with full administrative access on the system from an account that didn't have permission to create users. They system happily accepted it. I got some push-back from the developer when I reported it, because I was "making direct calls to the back end! No one's ever going to do that!" It's difficult not to be... hostile... in the face of that sort of ignorance. [...]

      I have so little tolerance for stuff like that. I think I might be known for my saying "anyone with a bit of skill, the time and motivation will absolutely own you for that design." But honestly, I think the reason it gets under my skin so much is that as a developer, you should be assuming that anything outside of your current scope is ever changing and completely out of your control and most of the time 90% of those issues can be solved by good instinct in your model and flow and a few extra lines of cheap code. I recently got on my boss' nerves a bit for a design decision that he later mostly agreed with; we're passing commands to the localhost via a web service. I took extra time to do one way encryption on the credentials and make the bus extensible even though it was only sending to the local host.

      My reasoning was that at some point someone was going to realize that we could do this and say, "that's great! Can we send commands from back at the core to a remote appliance? I've got a use case for this!" Chances are that's going to be me for an implementation I need later in the project. At that point it's too late to update all the calling methods and double check the JSON (I made a class that created this for the callers so their workflow is always the same if the back end changes, they always just need to give their same input and the class takes care of the details), etc. And since it was done at design time, I had everything fresh in my mind.

      Even if it never gets used that way, I sleep better at night not worry about it. As icing on the cake, I usually find giving myself some power and flexibility nearly always makes my life easier down the road and usually opens up interesting possibilities that a poor or not well thought out design and implementation would. Still, it's hard to sell the idea sometimes until you've been able to say "oh, I already have a thing for that" in enough situations.

      --

      If I mod you up, it doesn't necessarily mean I agree with what you've said, sorry.

  38. Bullshit by Anonymous Coward · · Score: 0

    Sounds like Bullshit, it IS bullshit.

    Yahoo, soon to be sold off for parts? All that human pain, for what? So some shitlord can say "We're doing BRILLIANT"

  39. Re:Well of course by gweihir · · Score: 1

    Obvious troll is obvious.

    --
    Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
  40. Why not requirements driven development? by Anonymous Coward · · Score: 0

    Why is it called "test driven development"? Don't requirements drive tests? Then surely, by the transitive property, it should be called "requirements driven development".

    1. Re:Why not requirements driven development? by JoeMerchant · · Score: 1

      Nice thought, I can only assume that it is because well written requirements are even less common than well written tests.

  41. Bwahahahahaha by Anonymous Coward · · Score: 0

    A year ago Yahoo eliminated its test and quality assurance team, as part of project Warp Drive, its move to continuous delivery of code.

    LOL Yeah, how's that working out for your bottom line?

  42. Well, makes sense if you're shutting down by Rinikusu · · Score: 1

    All the places I've worked, when the end was nigh, QA was the first to go because they were going to start laying people off soon.

    --
    If you were me, you'd be good lookin'. - six string samurai
  43. No Internet For Engineers? How cruel! by Anonymous Coward · · Score: 0

    Oh wait...

    You meant "safety net", not "internet". Now the summary makes sense.

  44. Writing Code Writing Novels by wisnoskij · · Score: 1

    I can see their point. The most important bug finder in software development, the one that cannot ever be properly replaced, is the original programmer. No one else can understand the underlying code well enough to replace them. And they can get lazy, with a big enough safety net they can get complacent and start to think that finding problems with what they wrote is someone else's job. But to write really good code, you also pretty much need an outside editor as well. There are many things that you will simply be blind to, that an outsider will spot straight away. It does not matter what you are working on. A Novel or an Application. At one point you need an outside observer to look over your work, but they are far less important than the original author doing so.

    --
    Troll is not a replacement for I disagree.
  45. So, the Apple model? by Anonymous Coward · · Score: 0

    I've long since suspected that Apple functions this way. Strangely though, they do hire people to classify bugs as "will not fix" or "works as intended" even when things are clearly and seriously broken. Their developers continue to leave an ever expanding set of broken software in their wake, especially as concerns basic functionality and the OS itself, but also in senseless UI decisions. For example, the antiquated and still unreliable HFS filesystem, terrible NFS/SMB implementations, and the Finder which routinely loses files when performing basic operations.

  46. Give me a break by Anonymous Coward · · Score: 0

    So how is that working for ya Yahoo? They are circling the drain and about to sell off the Yahoo business. Yes siree, great management decisions at Yahoo. This would be funny if it were not for the fact that many people will lose their jobs from the management incompetency at Yahoo. Of course the higher level management will have their golden parachutes ...

  47. SGTM by danthemanvsqz · · Score: 1

    I worked for one of the major Tech companies in Silicone Valley. The motto was, 'Fail fast, Succeed faster!'. All engineers were required to test their own code and document the testing plan. We used unit testing heavily and measured our test coverage. We also had functional and integration tests, we also had behavioral tests on the UI. Every week one engineer on the team would be responsible for release and they would re test every change in our staging environment. Now prod did go down a few time but in every case it was because we got out of sync with a dependency and not because we let a bug slip through.

  48. odd case by nerdyalien · · Score: 1

    I worked as a developer, and I was one of the rare ones who took QA feedback positively.

    By and large, I got along well with QA. Simply because I acknowledged the fact that they helped me a lot in understanding better about developing quality software (at least UX wise). I was always driven to write code that pass QA, which I took as part of my work and pride.

    However, not every developer shares the same sentiment as me. They went on to complain and remove QA, and take all that responsibility to them. Great, that's as good as you are the judge for your own court case. Since then, my employer fired all QAs, and ever since, quality reaching new "lows" every quarter.

  49. Wait a minute... by Chris+Mattern · · Score: 1

    ...wasn't Yahoo getting out of the computer business anyways?

  50. We did this years ago! by Tony+Isaac · · Score: 2

    Back in the 80s, we wrote code and threw it over the fence to the users. If nobody complained, we assumed it was working fine! Ah, the good old days. What's old is new again!

  51. Makes no difference by Anonymous Coward · · Score: 0

    cuz no-one uses Yahoo code.

  52. What happened to programmers testing their code??? by javabandit · · Score: 1

    My first programming job was working in a food manufacturing company as a junior programmer. There was a team of programmer/analysts. We knew the business of food manufacturing. We understood our own business. We understood the day-to-day jobs of employees who had to use our software. We tested our own code. There was no formal "QA" for the software. Part of the job was testing the code. If you didn't test your code, repeatedly had failures, your ass was fired. It's as simple as that.

    Most pieces of software do not require a separate formal team to test it. All it requires are programmers who understand what they are doing, what business they are in, and how their software is going to be used. What the hell has happened to this business?

    Woodworkers have more capability, domain understanding, and work ethic than programmers these days. A good woodworker tests their angles for trueness. They design their cut sheets to maximize wood usage and eliminate scrap waste. They test their joints for racking. They will sand every edge of a piece to make sure no blood can ever be drawn. They will make sure that every plane is perfectly level.

    If you want to be a good programmer, get off your lazy ass and make an effort to understand your customer and the business you are developing software for. Test your own code and be intellectually honest with yourself while you do. If you need to automate, fine, but automate where it makes sense. Test things that make sense. If you do that, most of your code will be free of critical bugs.

    If this was Yahoo's goal, then good for them.

  53. NASA would like a word with you by istartedi · · Score: 1

    Too lazy to find the link, but I seem to recall that NASA not only QA'd code for manned missions, but had two teams. Each team was composed of developers of equal caliber, and one team had no other job but making the other team "look bad" in the friendliest of ways--because it was of vital importance and potentially heart-breaking to an entire nation and even the world if something went wrong.

    Now of course, Yahoo is not sending men to the Moon. It's understandable that you can dial it back a bit for a mere web site, but dialing it down to zero sounds pretty damned stupid.

    Oh, BTW, if I'm wrong about how NASA's red vs. blue development work, I'm sure somebody will correct me. You might even say that this post is QA'd. Yahoo management will take everything I say at face value though. BTW, Yahoo, you owe me $1,358,345.23 for that back-end I wrote. You can trust me on that because I'm a developer and my contract specified no QA for any aspect of the project, which totally exists because I say so.

    --
    For all intensive purposes, "whom" is no longer a word. That begs the question, "who cares"?
  54. Re:What happened to programmers testing their code by Shados · · Score: 1

    In most cases I agree with you. Though some issues I've hit on certain projects, including at my current job, is when the software starts becoming really complex with a lot of dependencies. When you start making tweaks and changes to the foundations, you have so many things to understand and test that its just more efficient to do the process with multiple people in parallel. Some people write the test scripts, the test plans, the impact analysis, etc, and others execute.

    Its simply about scaling people.

  55. QA at Yahoo had become codependents by nomentanus · · Score: 1

    Risk homeostasis - you make much better brakes, and people begin to drive faster, take more chances in traffic and have nearly as many accidents as before. Put in better QA, and developers slack off their own efforts until the number of bugs that slips through is about the same as before. If QA doesn't respond to that, then they've become codependents, only helping programmers to be more slovenly and still keep their apparent productivity up, and keep their jobs.

    But there are a bizillion better ways to deal with that problem than "Let's take out the brakes, or go back to really bad brakes." One of those ways is to, make risk severe but intermittent. In which case there's still QA - but it's NOT a safety net because at least 1/3 of the time (or 2/3 of the time) it isn't there to catch your particular errors, they are reviewing someone else's code quite intensely; and you aren't told when that is. (Even some of the time when they are reviewing your code, you aren't told, their reports to you are delayed, so that you can't figure out when they're watching for the moment and slack off.) Even the period they watch any particular coding team is randomly selected. QA still catches a lot of problems, saves a lot of money and embarrassment - but programmers can't relax or rely on QA to wipe their noses like a good codependent, so they remain vigilant.

    Another way is to make the penalty for disappointing QA as visible and embarrassing as crashing the whole ball of wax. But highly visible rewards for safe coding are another.

    It's very common in business environments for cooperation to happen at lower levels that frustrates the most important goals of top management. That apparently happened at Yahoo, and the response was to remove half of the cooperating parties permanently. The problem was real; but there are far smarter ways to deal with it.

  56. More work, same pay by Anonymous Coward · · Score: 0

    Sounds like they doubled the workload of the developers, increased their risk, and didn't increase pay to compensate. Typical corporate bullshit. Last company that tried to do that to me was IBM, walked out on them on the spot. F/That.

  57. Do all devs test? by Anonymous Coward · · Score: 0

    I've always assumed that when you're writing the software you do a lot of testing throughout the process, but only a couple of weeks ago I was asked in all seriousness how I could know if something would work or not.

  58. Yahoo is worthless by Anonymous Coward · · Score: 0

    If you take the value of Yahoo and subtract the value of their Alibaba stock... it turns out the company is worth $0.

    I would view eliminating QA skeptically if it were coming from a company that was making profits. Coming from Yahoo I'll take it as advice on what not to do.

  59. Re:Real engineers MUST do QA by Anonymous Coward · · Score: 0

    FYI:

    QA = Quality Assurance
    Q&A = Question and Answer

  60. Is this why their system has so many problems? by anti-disney · · Score: 1

    A few years back (2009?) Yahoo rebuilt their site from scratch including their email. Several users complained about the buggy code and some even had emails that suddenly came up missing. One of their designers even was quoted as saying that people need to be kicked in the groin to appreciate good design. Many complained about features that were eliminated in the new design and that it looked too much like google and was full of bugs. Like others I got tired of the Yahoo's buggy interfaces and left Yahoo a few of years ago. From what I've heard from the few Yahoo users who didn't leave yahoo there are still problems and now they cannot get hold of anyone at Yahoo to report a bug or even unlock their account. It sounds like Yahoo doesn't listen to their customers and I think it isn't wise to drop QA.