Slashdot Mirror


Does Open Source Need Quality Standards?

underpar writes "This Techworld.com article reports that a UK group called the Open Source Consortium is being officially launched today. The article further states that the goal of the group is to respond to claims that switching to open source is more expensive than using Microsoft products and to help smaller companies compete with Sun and IBM for open source contracts. They say they will not compete with other open source groups and they intend to eventually come to the US. The hype-filled about us section of their site says their Quality Standard Certification provides a "simple framework for self-assessment and performance improvement." The question of whether this is useful or even wanted in the US still remains to be answered."

25 of 223 comments (clear)

  1. Dumb overgeneralization by Anonymous Coward · · Score: 5, Informative
    Does Open Source Need Quality Standards?

    Some open source projects do (carrier grade linux; linux in medical devices).

    Others don't (screen savers, C# clones(to match MSFT's Quality Standards), etc)

    1. Re:Dumb overgeneralization by Anonymous Coward · · Score: 5, Insightful
      Another dumb overgenralization is that this organization think that their " Quality Standard Certification" is appropriate for a wide range of products.

      Linux in medical devices should have follow FDA standards

      Linux in automotive systems shouldd follow DOT standards.

      Linux in voting machines should follow Diebold/MS-Access quality standards..

      (sorry for the US-centric examples - for your own country pick your favorite certification organizations)

    2. Re:Dumb overgeneralization by Kick+the+Donkey · · Score: 4, Interesting
      Linux in voting machines should follow Diebold/MS-Access quality standards..

      And those standards, would be... non-existant?

      --
      /. is a bunch of nerds at a million typewriters. It's not a political conspiracy determined to undermine your beliefs.
  2. open source != linux by Anonymous Coward · · Score: 5, Interesting

    Just because Linux is under the GPL which is an OSI aproved license does not mean that anything that has to do with open source has to be about linux.

  3. About Us page by miltimj · · Score: 5, Funny

    I like the dedication to quality evidenced in their About Us page:

    We are a not-for-profit organisation which guarantees the the quality of open source deployments in the public sector (emphasis mine)

    --
    "Truth is not decided by majority vote" consensus gentium -- Norman Geisler
    1. Re:About Us page by SirTwitchALot · · Score: 3, Funny

      perhaps they just meant the quality of the word "the" in open source software?

      --
      Go away, or I will replace you with a very small shell script.
    2. Re:About Us page by tomhudson · · Score: 4, Interesting
      Since they're so hyped on standards, maybe they should fix their web pages.

      validator.w3.org http://validator.w3.org/check?uri=http%3A%2F%2Fwww .opensourceconsortium.org gives this response:

      This page is not Valid XHTML 1.0 Transitional!

      ... and it ain't even slashcode ...

  4. McHammer: Too Open To Standardize by fembots · · Score: 5, Interesting

    Short answer is YES, almost everything needs a certain level of quality standards for widespread use. Even MS has its own quality standards :)

    However, who is to set these standards and who is to govern them is another question.

    I have a subtle feeling that Open Source = Freedom, that's probably why we see so many forks and distros because "I would have done this that way, and I could".

    So what is to stop a "US Open Source Consortium" being officially launched tomorrow because another group of developers have different idea on Open Source's quality standards?

    Can Linus the most influential man gives a single, authoritative guideline?

    1. Re:McHammer: Too Open To Standardize by MoonFog · · Score: 4, Insightful

      Nothing will stop them. If US companies want to listen to the US Open Source Consortium as you name it, then they will. If European companies want to listen more to another OSC, then they are free to to do so. Is this necessarily a bad thing? As long as there is some kind of control and legitimacy over these consortiums, this can be good. Establishing 15 different consortiums within one country just because some developers disagree would probably be overkill though.

  5. Be Careful by omghi2u · · Score: 3, Insightful

    Be careful what you wish for.

    Something "free" or "cheap" might be so for a reason.

    I still say best open source is that tied to proprietary hardware then you really cash in.

    As for la-dee-dah software, operating systems, etc, I stay away from those.

    1. Re:Be Careful by lxt518052 · · Score: 3, Insightful
      Something "free" or "cheap" might be so for a reason.

      I would call that FUD.

      Just because it's free or cheap doesn't mean it's inferior in quality. Similarly, being expensive doesn't guarantee the quality would be good either.

      Actually, for example, *BSDs are arguably the best network operating system and they are free. It is those overpriced proprietary OSes made by you-know-who that are riddled with bugs and security problems.

      Software products do not suffer from resource scarcity like traditional commodity, such as cars, does. When a piece of software is written, it can be copied, compiled and ported to unlimited machines, the cost of it doesn't grow in proportion with the number of machines using it. The more people using it, the cheaper it goes.

      --
      People who dislike China tend to mention Tiananmen Square a lot, but they always forget the Tank Man is also a Chinese.
  6. Questionable quality. by RealAlaskan · · Score: 4, Insightful
    From TFA:
    Our quality standard certification is an ideal route for Open Source Consultancies who wish to be recognised for taking the first steps to implementing a formal quality management system. The OSC Business Standard makes an ideal first step on the road to ISO 9001 or the Excellence Model.
    So, this is for consultancies, not software.

    More to the point, isn't ISO 9001 one of those standards where you prove your ``quality'' by committing to following a process, and documenting that you do indeed follow that process? The inevitable result is that you can commit to shooting your customer in the foot, and document that you have done so, and earn the highest ``quality'' rating for it. That sort of ``quality'' isn't very reassuring.

    1. Re:Questionable quality. by Simon+Lyngshede · · Score: 3, Interesting

      Yes, basicly ISO 9001 just states that your capable of producing the small shit over an over again. It's a more a proces standard than a quality standard. Oh, and in the UK, you can advertise that your product is good because it's ISO 9001 certified.

      If they want to addresse the issue of quality in open source software, there is a lot they need to consider. Most importantly... what do they mean by quality? What represents good quality in one project, may not be relevant to others.

  7. Six Sigma to the resuce!!!!!! by HarveyBirdman · · Score: 4, Funny
    If you have not had Six Sigma training, you might be baffled about what it is.

    If you have had Six Sigma traning, then you are definitely baffled about what it is.

    --
    --- Ban humanity.
  8. Re:I think they do... by ctr2sprt · · Score: 4, Funny

    Is that where they test Linux by throwing it in the ocean? Much like testing Windows by defenestrating it?

  9. YES, it does by DoktorTomoe · · Score: 4, Informative

    I think we all agree that a business world based on OpenSource would be preferable to a Windows-centric system. To achieve this, high-quality-business solutions have to be written and found. I am running my own business and am using Linux on 5 machines. There is some old Mac, but I do not really use it anymore. To please the Finanzamt (the german IRS), you have to file reports, do some accounting etc. This has proven very difficult for me when I tried it with OpenOffice. So I searched for business software, e.g. accounting suits, ERP and CRM-Software. I tried for over 2 months and have compiled about 100 different approaches - but all of them were either abandoned, not scaleable to other countries needs (I cannot use spanish tax forms) or they simply didn't work the way they where supposed to do (I even had an KDE program that was published with internal static linking to the programmers home directory!). I finally settled with lxoffice (http://www.lxoffice.org), which is fairly scaleable and where 95% of the system works, but it was a hard fight. While I am accepting such situations as a hobbyist, as a business owner that's lots of time I am not paid for. Quality control could help in such situations, helping users choose reliable software. And yes, I'd be willing to pay for it.

  10. Needs vs. Shoulds vs. Could Haves, etc. by timothy · · Score: 5, Interesting

    "Who is this 'We,' paleface?"

    Lots of people are quick to say that someone else's work "needs" something. My car needs its cupholder in a sane spot, instead of so it just about blocks the radio buttons. It's true, but that's not exactly a demand on the car maker. Just a hint ... MR. SUBARU!

    Sometimes it's hypothetical and prescriptive; "Red Hat needs to compete in the market X, so it needs to advertise in trade publication Z and add the de-pre-mux-defrobnostication patch that this special niche requires." Fine :)

    Other times, the "need" is expressed as an imperative, when the speaker has no standing to demand anything ("The GIMP interface needs to change!") etc, or (as in the headline here) where there is no single Thing to change. "Open Source" covers a huge range; it's like "Things that have the letter R." It's true that some of these things (like Catherine Zeta Jones) are beautiful, but it it does not follow that all things with "R" better our existence in quite the same way.

    It's perfectly nice and positive and welcome etc that someone has decided to promulgate what they consider higher standards of quality for "Open Source" -- as long as everyone realizes that only a certain subset of open source software can be scrutinized by any given such body, that developers may have their own ideas (even if they are not universally popular, and even if they have no intention of following someone else's ideas of UI perfection), that open source's great advantage in this context is that UIs are a) frequently separate from the underlying code and b) forkable.

    timothy

    --
    jrnl: http://tinyurl.com/c2l8yr / foes: http://tinyurl.com/ckjno5
  11. standards by eille-la · · Score: 3, Insightful

    F/OSS needs more unified standards first! (like for packages).

  12. Linux passed TelecomCarrier Grade Reliability Test by Anonymous Coward · · Score: 5, Informative

    Certain versions of embedded and server Linux had already passed the Telecom Carrier Grade Reliability Test. Carrier Grade Linux is 99.999% Reliable. Any Window is NOT Telecom Carrier Grade Reliable. Microsoft won't even try because it will fail.

  13. The Community chooses. by Nijika · · Score: 4, Insightful
    Ugh, sorry for the marketing like speak, but I feel like the quality standards in OSS are dictated in an "organic" way. Where the best software bubbles to the top, and the quality is assured by continued participation in quality software. Look at Apache. Look at the Linux and BSD kernels. KDE, anything. All of them have organic style quality controls where the community dictates just what is quality.

    I can imagine an organized group like this, though, would be excellent at answering issues like corporate generated FUD in an organized and coherent way. That's our big problem, we lack representation (not counting eccentric geniuses with big ZZ top beards).

    --
    Luck favors the prepared, darling.
  14. SQA is needed. by ichigo · · Score: 3, Informative

    SQA is essentially one of the most important aspects in software engineering. Depending on the nature of a software, open source or not, SQA is definitely a must and key to developing software that meets the needs of the intended end-users without sacrifycing quality. What's the point of having a software that has fancy features of this and that and yet crashes every now and then?

    SQA helps to validate the software whether it is developed up to certain acceptable standards like whether it's functioning the way it supposed to, does it go berserk and stop functioning after the user keys in certain kind of data, etc.

    Just because a software is open source and free, I see no reason why the quality should be compromised especially the operating systems, office productivity and development tools.

    And so I really feel this Quality Standard Certification is needed, I mean just look at the numbers of governments and organizations is using Windows OS despite it's many flaws compared to the number of Linux OS adoption. The reasoning for this that "Linux is harder to use" is lame - it's obviously because of it's reputation and that Microsoft gave "quality assurance" to their product. What about Linux? Is there concrete proof that Linux is better that will convinced the government and the organization that it is a better OS?

  15. And a redundant idea to boot by passthecrackpipe · · Score: 5, Insightful

    Not only an overgenralisation, it is a redundant idea to boot. OSDL already provides a lot of the stuff they publicly talk about - code quality etc. The real purpose of the organisation comes to light when you read deeper into the site.

    You need to be skilled in their "consulting framework" and you need to conform to some "financial framework" as well. Their membership criteria are mysterious (hint, you probably need to be a member of their club of buddies) and some of the organisations that are members (and knowing those organisations intimately, they probably are the drivers behind this thing as well) are decidedly dodgy - Open Forum Europe has publicly spoken as "Open Source Representatives" and as such, have signed a declaration supporting software patents. Looks to me like just another group of people trying to corner a market. Anyone remember the Open Group, and the "good" they did for UNIX? (another hint - a lot of the same people are involved)

    This is so much the wrong crowd to hang out with....

    --
    People who think they know everything are a great annoyance to those of us who do.
  16. Very insightful, more comments by davidwr · · Score: 3, Insightful

    Good to see "Dumb overgeneralization" modded to +5 right off the bat. Other replies in this thread also deserve "insightful" moderation.

    Software should be held to whatever quality standards the customer requires, regardless of it's proprietary or open development process.

    For products where quality IS important, published documentation, including source, code-change-history, published test-cases and results of running those tests cases, etc. can help ensure quality. Commercial outfits typically rely on outside auditors or "trust us" to show that they probably ship quality code. At best, they publish their test cases and the results of those tests. If we are really lucky, a few outsiders have reviewed the code and pronounced it good.

    For projects where quality isn't important, well, nobody cares but the authors.

    --
    Knowledge is how to play a game, intelligence is how to win, wisdom is knowing what game to play.
  17. Slow down cowboy by gosand · · Score: 3, Interesting
    The inevitable result is that you can commit to shooting your customer in the foot, and document that you have done so, and earn the highest ``quality'' rating for it. That sort of ``quality'' isn't very reassuring.


    Don't know much about Quality, do you?


    I'll speak of these things in general, since they are essentially the same types of certifications (ISO, CMM, etc). If your customer agrees to be shot in the foot, and you shoot him in the foot, then the quality of that release is right on the money. One of the things that people miss (or fake) when implementing these processes is that they try to cut corners and fake-out the process. These certifications usually require that you get customer commitment to process changes. That means you keep your customer in the loop of communication. Therefore, you get them to agree to things and hold them to it. Customers don't usually like that, they love to wiggle and worm their way around commitments. But if you follow these processes, you can get them to document their commitment. They aren't very happy when they are called on the fact that they get exactly what they asked for, but in the end the point is to make them happy by getting them to ask for what they really want.


    Everyone loves to put down things like the CMM and Six Sigma, because they "don't work". Just because you worked somewhere where it didn't work doesn't mean the models don't work, it means you didn't do them very well. And they aren't easy to do well, they take effort. Most places will cut corners and fake the behavior that they think will let them slide by to get a certification, then they will usually go right back to doing what they want. There is a difference to "getting to certification level X" and "operating at certification level X".


    And the real definition of quality is the delta between what the customer expects and what is delivered.

    --

    My beliefs do not require that you agree with them.

  18. Re:Who's standards by PhYrE2k2 · · Score: 3, Insightful

    I'll give you that, but for every binary decision, you're going to piss off roughly half the people.

    There are security analysts who do spend time looking at the kernel, but it's a big job. As with most of these projects, they usually start becomes someone pays a security company to spend millions auditing it (ie: a government wanting to use it for sensitive data or voting machines). If only we could get every linux user to do one line of code *smirk* :)
    BTW: FHS is an attempt at getting some standardization.

    You mention 'designed for linux' and 'interoperability' which I think are tough ones. The big difference I find between Linux OS and Windows OS is that one company merges the GUI, kernel, drivers, shared libraries of 3rd party applications (DLLs), and (sadly) web browser into one. Linux, while having folks like RedHat producing distros, has no consistancy.

    Now of course, I'm not saying anything you (or anyone on Slashdot) doesn't already know. But the key factor is that I can make my new audio board 'designed for linux 2.6', but the actual installation is different on every system. Some want a kernel compile, some store modules in one place, others will scream that the kernel is tainted when you load them. So how can one ensure that their board will work properly (and easily)?

    There are a few attempts at standardizing hardware (as you mention linux hardware). The most popular thus far is DKMS: DKMS stands for Dynamic Kernel Module Support. It is designed to create a framework where kernel dependent module source can reside so that it is very easy to rebuild modules as you upgrade kernels. This will allow Linux vendors to provide driver drops without having to wait for new kernel releases while also taking out the guesswork for customers attempting to recompile modules for new kernels.
    See http://linux.dell.com/dkms/ for more information.

    --

    when you see the word 'Linux', drink!