Slashdot Mirror


Why Does Beta Last So Long?

Carl Bialik writes "Noting that Google News has been labeled 'beta' for nearly three years, and Microsoft's antispyware program for nearly a year, the Wall Street Journal looks at why 'beta' lasts so long these days. The article mentions the usefulness of getting the masses to test the product, but also notices another possible reason: 'Betas also have become a marketing device in a fiercely competitive industry, allowing software and Internet firms to release new products or services sooner and cultivate early buzz. Betas, which once had been quietly distributed, are trumpeted in press releases and at news conferences. "I deplore it as a consumer; I admire it as a marketing professional," said Peter Sealey, a marketing professor at the University of California at Berkeley and former chief marketing officer at Coca-Cola Co. "I can't come up with anything else in the entire marketing world where marketers knowingly introduce a flawed or inadequate product [and] it helps grow your user base." '"

55 of 258 comments (clear)

  1. Nothing Deplorable about Betas by Knight+Thrasher · · Score: 5, Insightful

    The reason people like products released as Betas, is because it's the most honest software companies ever get about their products. It's pretty much as simple as that; Beta implies under-constant-improvement, and even I as a consumer don't mind imperfect software, as long as the company will at least advise me it's been released in Beta - under construction.

    1. Re:Nothing Deplorable about Betas by mmkkbb · · Score: 5, Insightful

      The acceptance of 'beta' as 'final' by many consumers is a programmer's dream. The need for a product is diminished, as consumers will forgive anything from lack of polish to lack of functionality and lack of coherence. All those things you're too lazy to fix can be swept away since it's still in beta!

      --
      -mkb
    2. Re:Nothing Deplorable about Betas by NewWorldDan · · Score: 2, Insightful

      I think it's more about instant gratification. Developing a high quality product takes time. Releasing a beta panders to the impatitent and provides a large testing base for low cost to the developer and often at no cost to the user. Everyone's as happy as they're going to get.

    3. Re:Nothing Deplorable about Betas by Incoherent07 · · Score: 2, Interesting

      Yeah, I was starting to get irritated at Firefox over that. That, and you can't uninstall the old ones because it'll break all of them.

      --
      This is my sig. There are many others like it, but this one is mine.
    4. Re:Nothing Deplorable about Betas by Threni · · Score: 5, Insightful

      > I hate having six different entries in "Add/Remove Programs" for a single
      > program.

      I had that with Firefox. I deleted the oldest version and it deleted all of them. Uh...thanks.

      Also, I had 2 dummy labels in Gmail which I can't delete - it just ignores me, as does Google support.

      Frankly, standards are so low these days (software and hardware) that it's hardly necessary to stick a beta warning - I don't expect stuff to work, and I expect to have to explain what's wrong to clueless idiots in shops when I take the stuff back. Fortunately, they're so used to it too that it's rarely hard to get your money back - they know you're going to have to just take your chances with another one anyway, so why worry about it?

    5. Re:Nothing Deplorable about Betas by at_slashdot · · Score: 3, Interesting

      On the other hand there are people that don't use some software because it's beta, so I guess there's a karma: you gain some customers that don't complain about the product and you lose some that will never try as long as the product is beta (depending on the product and customers there might be more won than lost, but in such a cases probably didn't matter from the beginning if the product was declared final or not).

      --
      "It is our choices, Harry, that show what we truly are, far more than our abilities." -- Prof. Dumbledore
    6. Re:Nothing Deplorable about Betas by flyingsquid · · Score: 2, Interesting
      Which gets rid of a lot of risk for the company. Apple released the Newton before the software had all the kinks out of it. My understanding of that story is that after some work, the Newton actually worked pretty well- a lot of people apparently swore by the thing. But by the time that happened, the Newton had the inescapable air of failure around it, the buzz was negative and they couldn't come back.

      You could imagine how, say, Google rolling out a product prematurely could be bad if it fails. It would break that air of invincibility they currently enjoy. With the current scheme, they roll the product out as a Beta, if it succeeds you do the final release, if not, it never gets out of Beta, and you have a perfect score of successes because you never officially release your failures. That's my theory anyhow.

    7. Re:Nothing Deplorable about Betas by Kjella · · Score: 2, Insightful

      The acceptance of 'beta' as 'final' by many consumers is a programmer's dream. The need for a product is diminished, as consumers will forgive anything from lack of polish to lack of functionality and lack of coherence. All those things you're too lazy to fix can be swept away since it's still in beta!

      Or will customers simply redefine 'beta' to mean 'final' and whine and complain until they get the same service and support anyway? 'beta' is after all just a concept, a nametag that we've placed on a product, and it is the same product customers use day out and day in, perhaps come to rely upon whether you call it beta or not. I know there's a lot of power in words, but I don't think you can "define away" delivering a final product.

      --
      Live today, because you never know what tomorrow brings
    8. Re:Nothing Deplorable about Betas by pizzaman100 · · Score: 4, Informative
    9. Re:Nothing Deplorable about Betas by Neoncow · · Score: 2, Insightful
      While your idea may be true for some** companies, I am not as cynical about betas coming from good companies.

      What is happening here is the public has gotten used to software development in the form of the waterfall model. They understand that it takes time to design, produce, and test software. They have become accustomed to updates during the maintainance phase of a product's lifecycle. <CarAnalogy premise="Software versions are like year models">

      The source of the misunderstanding is that the development industry has moved on to other models like the Iterative Model, while the general public is still expecting waterfall-style releases. Why has the software industry moved on without bringing public expectation with it? Because we can. You cannot expect the public to keep up with the difference between old methodologies and the new ones. This is true in any industry where there are people with specialized knowledge. <CarAnalogy premise="Car designers know a lot more about cars than you do">

      "Beta" is a transitionary device for the public to understand that the software industry has changed. The public will find out that just because a product is released, it doesn't mean that the programmers are done with working on it. Just that they have part of it working. Of course this is possible because of the declining cost of distribution (The Internet gives us this).

      Beta shields people who are used to the old model from the truths of iterative development. Software is never done until it's perfect, but we can't hold out and wait until it's perfect, or we will never get anywhere. <CarAnalogy type="Nobody has the perfect car">

      *All car analogies are left as an exercise for the reader.
      **I agree with parent when it comes to bad/copycat companies. They're doing it because it's hip/they're lazy.

    10. Re:Nothing Deplorable about Betas by rizzo420 · · Score: 2, Insightful

      google local doesn't say beta. that includes their maps. i'm kind of surprised since that's one of their newer products. the google toolbar is also not beta.

      i think it's more the lawsuit thing that they keep news in beta (makes people think they're constantly working on it). google groups is one of their longest running beta products...

      --
      please me, have no regrets.
  2. now if only the xbox 360 would do this... by altoz · · Score: 3, Funny

    seriously, why wouldn't you do this with dedicated gamers AND still charge them money for the xbox?

  3. Best of Both Worlds by Anonymous Coward · · Score: 2, Insightful

    It allows for the company to release the product and have it utilized by the public, but if something were to break, they still have the cruch of "well, it is in beta" to fall back on.

    1. Re:Best of Both Worlds by BoomerSooner · · Score: 4, Interesting

      That's the truth. My company QA's our software but in new routines (moderatly complex) we were having bugs that wouldn't be triggered for months. To eliminate the confusion of our customers on our new product features all new modules/reports/etc... come out as beta for at least the first month. It's the "take it with a grain of salt" model. I've found our customers like accessing new features (especially the ones they specifically request) earlier and have significantly less anger when a small glitch appears. Programers aren't perfect and end-user design docs are almost impossible to get 100% correct. Beta is a happy medium that should not be abused. That being said Google abuses the shit out of it. However, when you don't pay a dime for their services, can you really complain? (The answer is yes, with very little affect.)

  4. maybe... by JavaLord · · Score: 5, Insightful

    why 'beta' lasts so long these days

    Because companies are being more realistic with project life cycles?

  5. about that by sedyn · · Score: 2, Insightful

    "I can't come up with anything else in the entire marketing world where marketers knowingly introduce a flawed or inadequate product [and] it helps grow your user base." Doesn't this describe the computer industry in general?

    --
    Am I open minded towards open source, or closed minded towards closed source?
    1. Re:about that by timeOday · · Score: 2, Insightful
      "Flawed" and "inadequate" are relative terms. Take the most reliable, feature-laden car from 50 years ago and release it today. You'd be laughed off the street for its unreliability and lack of "basic" features. A Tune-up and new set of tires every 10K miles, and no seatbelts!? You must be joking!

      Sometimes a product falls well below the norm and deserves criticism. But when somebody slams an entire industry comprised of thousands of separate companies, it's a pretty good sign they're just a whiner with unrealistic expectations.

  6. Beta = safety by mbelly · · Score: 3, Insightful

    If a product is labelled as beta, and they have to completely overhaul it or a severe security flaw is found. Any 'damages' can be shrugged off as "This was only a beta, use at your own risk".

    ~Matt

    --
    ~Belly
    1. Re:Beta = safety by gstoddart · · Score: 3, Interesting
      If a product is labelled as beta, and they have to completely overhaul it or a severe security flaw is found. Any 'damages' can be shrugged off as "This was only a beta, use at your own risk".

      Yeah, because going out of Beta means that the license actually accepts liability, right?

      Oh, wait. Non beta software is still sold as "use at your own risk".
      --
      Lost at C:>. Found at C.
  7. Too fancy an answer by Concern · · Score: 2, Insightful

    We thought we would finish this sooner... but we didn't.

    Eventually we kind of gave up trying, but we're too nice to just take it off the website?

    Who would have thought?

    Or... my personal favorite:

    "Beta" as a kludge to workaround users who don't read disclaimers and get hopping mad when things don't work. I swear that accounts for a big percentage of the people who do this.

    --
    Tired of Political Trolls? Opt Out!
  8. Beta First Post by FearTheFrail · · Score: 2, Funny

    This is a public beta for First Post, and I'd appreciate it if you could report any placement-related or other bugs.

    --
    ___ In the words of Gen. Douglas McArthur: "I'll be right back."
    1. Re:Beta First Post by eMartin · · Score: 4, Funny

      "I'd appreciate it if you could report any placement-related or other bugs."

      Well, you seem to have placed it in the middle of the page instead of the top.

  9. Released products are flawed and inadequate by sterno · · Score: 4, Insightful

    The thing is, most software that we get is flawed and inadequate in some respect. Labeling the software as being beta reduces people's expectations. Thus when there is a serious flaw, the customer doesn't feel that irritated with it because it was beta. If it was a released official product, then they might have more room to criticize.

    --
    This sig has been temporarily disconnected or is no longer in service
  10. It's just the people who glom onto the Betas... by FatSean · · Score: 2, Interesting

    You know, those tools you might work or live with who think that kmowing about and running the 'latest' software is some kind of life goal. Gleefully runnig bug-laden betas crashing their systems and reducing productivity.

    I must be some kind of throw-back geek. I won't touch it until it ships. I don't do bug-testing for free...and no...none of these 'betas' are really that interesting anyway.

    --
    Blar.
  11. Betas are the best! by Anonymous Coward · · Score: 5, Funny

    Alphas have to work too hard, plus they have to think too hard all the time. They don't get to laugh and play. And Gammas and Deltas wear those ugly jumpsuits. I'm so glad I'm a Beta! Aren't you glad you're a Beta, too?

    1. Re:Betas are the best! by siwelwerd · · Score: 2, Funny

      I thought we'd all be Tri-Lams around here...

    2. Re:Betas are the best! by david.given · · Score: 2, Informative

      Isn't that a bit high-brow for Slashdot?
      </snobbery>

      Nice one. Must reread that sometime... it's a fun book (unlike 1984 which is miserable and harrowing and really unpleasant).

  12. Re:Nothing Deplorable about Betas ... except by jabelar · · Score: 5, Interesting

    Well, there is nothing wrong with Betas, except if their is no real intention of a production/stable release in a reasonable timeframe. Something in Beta for three years should raise questions. The implication is tha by tagging something as Beta, software/service suppliers can absolve themselves of responsibility for defects. This is sort of like an even further erosion of the standard EULA weaknesses regarding bugs and defects. Software that is in Beta indefinitely should be called "abandoned".

  13. I'm curious by Ohreally_factor · · Score: 4, Funny

    How's that Windows XP beta been going? The OS X beta I've been involved with has been pretty good. We're up to 10.4.3b, and I'm confident we'll see an RC before the 10.5 beta comes out. =)

    --
    It's not offtopic, dumbass. It's orthogonal.
  14. The software... by wpiman · · Score: 5, Insightful
    mentioned in the article is free- both MS anti-spyware and Google News. I think this is a little bit different if it is a product you pay for. Many people had problems recently with Civilization IV and the XBOX 360. Being paying customers- these people have been heard screaming in various message boards.

    Drug companies do beta test their drugs. Usually- they pay the recipient to take them.

    The point is- you get what you pay for.

    1. Re:The software... by spejsklark · · Score: 2, Insightful

      I find it strange that it wasn't emphasized more in the article, (nor in other /. comments.)
      This is the main reason. Free software (from for-profit companies) has not been around that long.

      Support costs money you're not getting from non-paying customers.

  15. Why? That's so easy ... by Chromodromic · · Score: 4, Funny

    Because most programmers are male, and most male programmers have a fear of commit.

    --
    Chr0m0Dr0m!C
  16. What about ICQ? by Anonymous Coward · · Score: 4, Insightful

    It's been in beta for nearly 10 years ;)

    Part of the reason is that they can reserve the option of making it non-beta in the future and charge for it.

  17. Google News by FuturePastNow · · Score: 3, Interesting

    I remember reading an article on Wired a long time ago about why Google News will forever be beta: it's all about money and copyrights. As long as it is beta, Google can claim it makes no profit from Google News. As soon as it gets "released," though, every newspaper with a lawyer will try to shut it down.

    --
    Give a man fire, and you warm him for the night. Set a man on fire, and you warm him for the rest of his life.
    1. Re:Google News by winkydink · · Score: 3, Insightful

      Any good forensic accountant can determine whether or not Google is generating a profit from Google News. The term "beta" provides no legal protection in that regard.

      --

      "I'd rather be a lightning rod than a seismometer." -Ken Kesey

    2. Re:Google News by damiam · · Score: 3, Insightful

      Google's obviously not turning a profit now because there're no ads. Google doesn't want to officially "release" Google News until they've figured out how to make it profitable without legal problems. That's the problem.

      --
      It's hard to be religious when certain people are never incinerated by bolts of lightning.
    3. Re:Google News by generic-man · · Score: 4, Interesting

      Your argument makes no sense whatsoever.

      Google Images: no ads. Not beta.

      Gmail: Ads. Beta.

      Google News: No ads. Beta.

      Flickr: Beta. Pro accounts cost money.

      Google News is in beta because it hasn't been improved in three years. "Beta" doesn't mean that a product is not distributed for profit; it just means that its creator doesn't want to hear griping from its user base.

      --
      For more information, click here.
  18. Allows customer feedback before final release by cmorriss · · Score: 2, Insightful

    Betas are indeed helpful to consumers. It allows them to get an early look at a product and guide its final look and feel and feature set. This allows the company to develop a better product and consumers get a product that more suits there needs.

    While it's true that using beta software is not for everyone, there are many users who do and make this symbiotic relationship worthwhile. As a software developer for enterprise customers, I see this play out with great success all the time.

    --
    10 minutes working on a sig. What a waste.
  19. I can by TheRealMindChild · · Score: 2, Interesting

    "I can't come up with anything else in the entire marketing world where marketers knowingly introduce a flawed or inadequate product [and] it helps grow your user base."

    Think Sega dreamcast! Sure, it isn't software, but the flaw that shipped with it that allowed you to boot CD-rs was what sold most of those systems

    --

    "When life gives you lemons, don't make lemonade. Make life take the lemons back!" -- Cave Johnson
  20. Re:hmmm by AndroidCat · · Score: 2, Funny

    What's in a name? that which we call Coke Beta
    By any other name would taste as sweet;

    --
    One line blog. I hear that they're called Twitters now.
  21. Do Google Betas Put Customers At Risk? by miller60 · · Score: 4, Insightful
    When Google Base was launched, it included cross-site scripting vulnerabilities that could have allowed an attacker to steal cookies and other information from users - which is no small matter now that Google has consolidated services such as AdWords and AdSense under a single login. The flaw was discovered by UK security researcher Jim Ley, who also found security holes in the Yahoo Maps beta and argues that betas are often unveiled without adequate security testing.

    As for Google News, one reason it remains in beta is that it has no business model. If Google tries to put ads on Google News, the newspapers and magazines whose stories are listed on Google News would probably file lawsuits, alleging that Google is trying to profit from their content. Google's emergence is a threat to the major media outlets that represent much of the content on Google News, and some folks in the news business believe it will remain in beta untilthis problem is settled.

  22. Re:What beta - and google's beta specifically - me by Chmarr · · Score: 2, Interesting
    Gmail has been making money from the beginning. Ever notice those ads on the side of your email?


    But, are they making ENOUGH money from that to cover the cost of creating and maintaining the service? Now, I know that neither you or I can answer that question authoritatively :)

    Perhaps a better way to make my point is that google aren't ready to put their full support team behind the product, so they market it is an "as is" product, and call it "beta" by way of covering their butts.
  23. To stay out of court. by CDPatten · · Score: 4, Informative

    Well sometimes it is so they don't get sued. Google News has been in beta for 4 years, and the consensus is that it will stay that way for years to come.

    From this article:
    "The reason: The minute Google News runs paid advertising of any sort it could face a torrent of cease-and-desist letters from the legal departments of newspapers, which would argue that "fair use" doesn't cover lifting headlines and lead paragraphs verbatim from their articles. Other publishers might simply block users originating from Google News, effectively snuffing it out. "

    1. Re:To stay out of court. by wsumark · · Score: 2, Insightful

      why would these online publications ever want google to quit freely advertising their products. their ad revenue would be related to that of google news'. google news is a value-adding party, not a competitor. any leagal action would be out of spite that google makes any money off of someone else's publication.

      i'm sure this will get shot down, but ever since the google portal came about, i'd think that slashdot has been getting a good amount more traffic than before. hell, anything from the google portal is a free click anyway.

  24. Why does Beta last? by 1zenerdiode · · Score: 5, Funny

    - Superior picture quality and signal-to-noise vs. VHS
    - Widespread adoption by studios and professionals (Beta SP)
    - Convenient smaller-sized cassette
    - Mfr'd and licensed by Sony, a company known for their progressive stance regarding consumer rights.

  25. Re:Err, not VHS? by yobbo · · Score: 2, Informative

    I still can't figure out how ICQ didn't get a mention in the /. article summary! That's been in beta as long as beta has been around.

  26. As long as programmers hear us... by Spy+der+Mann · · Score: 4, Insightful

    Being a programmer, I like participating in my favorite products' forums. Like, I report a bug, and a couple of days later, it's "fixed in CVS". I only have to recompile, and voila.

    Anyway, one thing that is very needed, is the frequent release of products (release early, release often), which is why I love looking at the latest beta's of a product.

    However, what I wouldn't like, is having to widthstand an awful beta full of bugs, specially if i can't contact the programmer.
    And it's even more frustrating if said "beta" is actually a finished product, like this one or this one.

    Haven't you guys been frustrated by the stupid MSN window re-scrolling whenever your buddy types something and you haven't finished reading what you missed? It's a nightmare!

    This is why I like beta. At least I expect bugs to be present, and I'm ASSURED that, since it's beta, those bugs will be fixed soon.

    And beta is also where the newest features are implemented, and I can say "wow! you rock!" I think Beta is the best part of a software development.

    So, it depends. Beta, for open source products, is a dream come true. For closed source products, it's a nightmare.

  27. Complexity and the first punch... by fitten · · Score: 2, Insightful

    Well... aside from marketing reasons and the like, Beta periods are longer these days because the software is typically more complex as well. You'd like a good beta audience to test your code breadth-wise and depth-wise, which may be difficult given some products (think about Microsoft Office and all the features and combinations of features you'd want tested).

    Plus, there's always getting your product out in Beta form to let some air out of competitors' offerings. If you can get your game out in a pretty good beta, for instance, you might curb some of the fever for some other competing game has. Just look at the EQ2 and WoW Beta and release times, they were fighting who would release first to get a lot of initial sales.

  28. Re:Nothing Deplorable about Betas ... except by Trevahaha · · Score: 2, Insightful

    Their "BETA" reminds me of the early 90's where you came across sites with the damn "Under Construction" animated GIFs everywhere. All these new web-app betas are nothing more than the new "under construction" signs.

  29. OSS essentially beta - not a troll by ServerIrv · · Score: 5, Insightful

    The premise behind a beta is to get the product into the customer's hands to increase the number of testers to improve the product. The OSS model of development uses this as a framework. Although versions are released as "final", it is understood that it can and will be changed quickly if any problems arise. I personally have gotten into several OSS while they where beta and still use them now.

    I do find it frustrating when paid-for services are in perpetual beta. If a OSS is broke, I haven't paid anyone any money, and I "could" fix it myself if I wanted.

  30. Re:Coke of all businesses should know better. by tm2b · · Score: 4, Insightful

    That's simply not true for technological products.

    The first to market is usually not the victor. From PDAs to OSes to MP3 players, it's easy to see that in the consumer technology market, the "first mover advantage" is mythical. It usually takes a second company to come along and learn from the mistakes of the first in order for a new technology segment to take off.

    --
    "It is our blasphemy which has made us great, and will sustain us, and which the gods secretly admire in us." - Zelazny
  31. libraries by bcrowell · · Score: 4, Informative
    From my perspective as a small-time OSS applications programmer, one of the big issues is the stability of libraries. I have one app, for instance, written in Perl, that I've been labeling as stable for years now, and yet within the last six months or so, I noticed that it had started crashing occasionally with a segfault inside one of the libraries it uses (Perl/Tk). Apparently the new version of the library that I've got installed now dereferences a null pointer now and then. The library is OSS, so sure, theoretically I could track down the problem and submit a patch. But realistically that's not going to happen (huge codebase, I haven't programmed in C or used a debugger in 10 years, ...). (Yes, I've tried to submit a usable bug report, but I've failed, due to my lack of C skills and the difficulty of reproducing the bug.)

    Whatever bad things you might say about proprietary software, one good thing in terms of reliability is that it's typically statically linked. That means someone who sells a proprietary app can test with a particular version of a library, and then just keep on shipping the app with that version linked in. If a later version of the library comes along that they do want to switch to, they can test it carefully, and then roll it out. But as an OSS programmer, you're at the mercy of your users -- they could install any version of a library, and if it doesn't work right, they consider it to be your fault.

  32. Windows has been beta-quality for years... by scgops · · Score: 2, Interesting

    ...so I wouldn't think the current trend of long-running beta releases has anything to do with whether or not they're ready for prime time. It sure looks like a lawsuit avoidance tactic to me.

  33. eBay = permanent Beta (pig latin for the letter B) by Chapter80 · · Score: 2, Interesting
    OK, so it's not Greek - but eBay is the pig latin equivalent of the English translation of the Greek letter Beta.

    is that off-topic or just [+0.5 mildly interesting] ?

  34. Shareware and betas ... by mildm8nnered · · Score: 2, Interesting

    I am a budding (Mac OS X) shareware author, currently running an open beta.

    I am intending to charge about $35 for my software, but am currently giving away limited duration (three month) licences for free.

    Before going public, I ran a closed beta for about three months, with 20 or so users that I recruited from various Mac OS X forums. This helped me eliminate the most egregious and common issues.

    My public beta has now been running for about a month - I've had a couple of thousand downloads, and nearly four hundred registered users - mainly finding me through version tracker and macupdate listings.

    The quality of the bug reports from my public beta users has generally been fantastic (it may help that I've promised bug reporters free permanent licences) - I have about 24 bugs in my bug tracker, of which 10 are open, and maybe half of these are serious. Generally my public beta users have been far, far more productive than my closed beta users - there are lots of issues that you simply aren't going to hit until you get out to a relatively large number of users, and these bug reports are like gold.

    Once I've closed the remaining serious issues, and added one remaining feature, probably early in the new year, then I'll end the public beta, start doing publicity and send the product out for review, and start charging for licenses.

    This seems like a very good deal for both sides to me - poossibly even a virtuous circle. Beta users get free early access to the software, but are aware that there may be unresolved issues. They also get a chance to influence the final form of the product - one could look at that in a very cynical way (they're doing the developers work for them), but the impression that I get is that people really appreciate this,

    From the developers point of view, the larger public beta base enables a much higher quality final product, which clearly beneficial to both sides ...