Announcing the KDE Quality Team Project
Quique writes "The KDE Community is pleased to announce the launch of the Quality Team Project, a community of contributors who will serve as a gateway between developers and users in the KDE Project, and as a new way for people to begin contributing. KDE is a very attractive project, offering high quality software and is freely available. There is a lot of people who feel the urge to give something back, but stop in the middle of the way, frustrated by the steep learning curve. The aim of the project is to reduce these barriers by welcoming these potential contributors, and by offering documentation, support, and even guidance if requested. The objective is to support the new contributors, (programmers, documenters, testers, artists...). Have you ever wished to help KDE in some way, but never knew how? Keep reading!"
QA? Testing? This is what open source needs!
Allow me to use Slashdot as an example. Wednesday nights = push development into production. Anyone on the slashteam want to tell me what regression testing tools and system testers they use? Sure, usually (not always) there isn't a crash-and-burn build, but occasionally there is annoyances and such that are just 'thrown into' the build that people didn't know was coming and other things.
Granted, this is Robs code, let him do what he wants with it, but with a 'QA' step it just makes for a better product.
Good quote, too many chars. Seriously, the slashdot 120 char limit sucks!
What was that open source code auditting thing that DARPA set up, but noone showed up to do the gruntwork?
Sounds like KDE is looking for folks to come along and do all the thankless, boring shit. Spellchecking help files, testing obscure check boxes, applying different themes. Of course, all the cool design work and programming, and artistry, etc, will be done by the core team - who will, of course, accept all the credit.
Noone wants to do the monkey work. I don't want to test constantly, read bug reports, track down insignificant bugs in code thats unused 99.9% of the time. I only do so because it's my job.
Which is a shame for open source in general, because it's that QA step, all the thankless hours of gruntwork, that make the final product what it is.
I don't need no instructions to know how to rock!!!!
I think this is exactly what open source needs. It's one thing for programmers, sysadmins and advanced users to contribute to open source projects, but there's often no easy way for the average user to help out.
With ideas like KDE Quality Team, the developers get to hear from the users and integrate features that they would like to see, as well as providing a means by which the average user can contribute. That's why Wikipedia works so well - it is possible for anybody to contribute. It's great to see the "anybody can contribute" idea extend to open source where up till now it's really only the advanced users who can contribute easily.
My operat~1 system unders~1 long filena~1 , does yours?
right you are - but should it be that way? for newbies and technophobes -packages are the way they get stuff onto their machines
For fostering a community unlike any other. www.kde-look.org has been my first stop to see modern ideas on desktop design for years now. I am not nor have I ever been a KDE fanboy (I'm a Blackbox user) but they have managed to form a remarkable bond with the graphics design community (and the graphically inclined). They should be a model for more OSS projects and this is something we should look at as a community as a whole. There is more to good software then 1's and 0's.
Quack, quack.
Seriously I hear all kind of good things with KDE but the thing still looks way too kluttered for the average Joe.
ESR did bring up a lot of good points. However, I doubt this team will have too much to do with that. From the article, it seems to me that it's mostly focused at lowering the entry level requirements for working on the KDE project. They are trying to get people to write documentation, etc. But that doesn't mean that they will actually focus on ensuring that it will all be as simple to use as Windows.
As an open source author and member of a quality assurance team, experience tells me that the greatest effort will go into programming. QA teams generally have enough work to do just fixing bugs, writing documentation and testing releases ("important stuff"), that not enough time is left for making the user interface uniform or even intuitive. In this case, though they are asking users for direct input on the topic. That's a good sign.
The sad part about all this is that ESR will test only Gnome but will bash ALL open source environments, just as he tested only one distribution but bashed ALL Linux, also those distributions which have seamless CUPS configuration.
I certainly don't agree with much Eugenia sais, but at least she doesn't bash A for mistakes B made.
I agree. I've submitted a number of bug reports and comments on existing bugs, and not only were they fixed promptly, but my privileges were raised so that I could close bug reports/mark duplicates/etc.
It sounds like the other two posters don't realise that absolutely anybody can put a comment on an existing bug report.
Yes it is crap for developers, but this initiative is for advanced users and not developers. Basicaly it tells users how to run the most recent and greatest KDE right out of CVS, and how to report bugs. From there they can do as always, run the most recent software just for the kick, and report the bugs they encounter. Or they can decide they want to do something good to pay back the KDE team for its hard work, and just try out every obscure feature and make sure it all works. Doesnt mean you have to code, it just mean you have to know how to use applications and think for yourself.
Come on guys, KDE has a LONG LONG way to go to match the precision, power, beauty, quality, and technological sophistication of Mac OS X. You're getting pretty close to MacOS 7. At this rate, maybe in 10 years or so you'll match the first beta drop of OS X.
You're right but have you tried 3.2? Those issues are still there but certainly have been lessened a bit. Also, the speed, man :) Much faster than Gnome but still can't hold a candle to good old Fluxbox.
This guy is way out there
Evolution, Abiword, and even Gnumeric (still better). Of all the apps on my default Gnome menu, only about two start with G.
Showing facts is what may help people understand.
As long as you show *all* facts, Ali. Your years trolling lists, forums and even bugzilla don't speak very well for you, and justify your reputation much more than any reaction from gnome developers.
You cause your own problems, you're not a victim, even if you want to look as a martyr.
It has been my experience as well that people often confuse "testing for defects" with "quality assurance." The former is doing something to figure out if what you made (note the past tense) is ready for release. The latter is a process or set of processes that assures (or attempts to) that the output of your development cycle has quality. Testing is really only a phase of the entire quality assurance process.
The Spoon
Updated 6/28/2011
Reading through the site, I realize that two important elements of QA are missing. They won't be as fun to do, but it would be great if someone did them.
1) Requirements and specifications. Also known as what you need before you start coding. Otherwise known as the official arbiter of whether the program is doing what it is supposed to be doing.
This is thankless gruntwork, but it is very valuable. Some KDE apps already have some, but all need them. Take an email client for example. Go grab all the RFC's relevant to POP3, IMAP, etc, and distill them down into a set of requirements stating what the program is supposed to do. Open Source is informal enough that we could get away with combining requirements and specifications into one document.
2) Test procedures. Now take that requirements document and write a comprehensive test procedure. Include regression testing. Now anyone can take this procedure and simply execute it to find out if the program follows its requirements. If a step fails, log a detailed bug that states which requirement is not met.
Not only would these two things aid the the developer in creating and improving the application, they would also improve the quality of bug reports. Instead of bug reports saying "it doesn't do what I think it should do", you get bug reports saying "it does x but the requirements say do y." If the applications still doesn't do what you want it to do, examine the requirements yourself, and if they aren't complete, propose a new one.
Requirements are your road map, and test procedures are the person in the passenger seat reading it to make sure you take the correct exit to Albuquerque.
Don't blame me, I didn't vote for either of them!
It's not meant to be for "average joes"! It's a mechanism for people who are very interested in contributing to KDE, but are not developers. Note the adverb-adjective pair in "people who are very interested".
Liberal (adj.): Free from bigotry; open to progress; tolerant of others.
I should point out that most of those topics are rather equivalent to just one:
It's worse than that for FOSS, because the available total man-hours must be scaled by the funness of the task. Programming is more fun than debugging, which is itself more fun than reviewing requirement documents or measuring escaped defects. In paid work, testers are cheaper to hire than coders; but on a volunteer basis, testers can be harder to attract because the job is less emotionally rewarding.
But, always remember that in many Open Source efforts, the users are the testers. That's a valid viewpoint if something is free; Microsoft is excoriated when they periodically lure customers into paying to become testers, but the practice is more defensible when no money changes hands.
If you want solid, defect-finding, QA people who can improve your product, you'll be asked questions like these.
And yet, corporations that have an affirmative answer to everything you listed have still proven themselves fully capable of producing code that's absolute garbage. The public at large might not be aware of this, as the truely bad code dies before making it out the door. Someone who works in the industry will see veracity in the quote "Most software projects fail".
Additionally, the themes of Superprogrammer vs The Horde" are relevant to understanding why. Having seen a few SEI CMM 5 shops in action, it's clear that to fill the man-hours for all the redudant tasks requires hiring a grade of developer that's frankly sub-par. Programming is the one field where a true 20x productivity differential between two professionals is unremarkable. It seems that the prominent Open Source projects have gotten more attention from generous SuperProgrammers than a typical commercial developement is able to attract.
Must we go through this every time there is a KDE or Gnome topic?
It's just like all the "BSD is dead" retards who post in every BSD-related thread.
Frankly, I don't give a shit about the reasons why either of them are better. Just give me one that works.
I've seen this posted before. Hell, the last paragraph talks about some sort of alpha of Gnome and a new version that's going to be released in "December." Gnome 2.6 is due out this month.
I'm sure we could all come up with the same kind of list for KDE. Both projects have endless usability issues.
Weel, seeing as the KDE quality team seems to be a misnomer to me from the description it looks like its a combination of the gnome bugsquad and the gnome-love project.
In general I'd say FOSS doesn't need any QA auditor role at all. That's for *large* corporations with huge projects and a bad tendency to push releases out to the buying public before they are ready... sort of a checks-and-balance system to mitigate management stupidity.
:-)
FOSS tend to be small groups, with small projects. And there is no insane pressure from management to let releases escape to early.
It would be nice to have some dedicated testers around to do smoke tests and general usablity tests. In general FOSS projects rely on the users to want to run the bleeding edge code and test that. But in my experience a group of good testers is the best bang for the buck beyond starting with great programmers.
To the specific points:
>What is the development process? Is it documented?
The development process is pretty typical. Check out any successful project on SourceForge. No need for QA audit role. There's no management around to muck things up, the engineers are in charge.
> What types of estimation procedures do you do?
Irrelevant. It gets done when it gets done. If you pay for the development one can do better... you can audit those circumstances, but in general, don't need QA audit role here.
> What is the SCM process? Is it documented?
CVS or subversion and bugzilla or some such is typically the tool. Much of the SCM process probably depends on the distribution that actually packages the code. Might be Debian's release process. Anyway this is pretty well defined too...
> What is the review/inspection process for all artifacts?
There are usually a few "stars" writing all the code. They can tell crap from not. And if it's crap it probably doesn't work, so no one is going to use it. So you find out one way or another. Reviews of code might help but in general it doesn't matter. If it works well, and the people maintaining it can read it, we're OK. The project will die its natural death otherwise (just like proprietary software... actually its death is usually prolonged too far...).
> Are there software requirements? Are they inspected/reviewed?
What gets implemented is what the creator needs and sounds cool or seems OK and is contributed. Unless someone is paying, in which case this might be useful. But in general, no role for QA here.
> Are there development plans/design docs? Are they inspected/reviewed?
Informal probably. Small team, might trade mockups of screens or working prototype code around. Back of the napkin kind of stuff. Probably works OK for most projects. Wouldn't fly a plane that way though
> Are there code reviews?
Hahah. And you and I both know they don't really matter anyway unless you're dealing with poor programming ability, in which case you're screwed anyway... what are you going to do, fire the volunteer programmer from his own project?
Code reviews don't find bugs. You might be able to get more conformity to the coding guidelines if any that way. But in general, many projects enforce their guidelines by having few people allowed to check in. And good programmers go with the flow as far as code formatting anyway.
> What are your defect escape rates?
Escape rates? Must be some QA auditor speak. Does that mean bugs V&V didn't find before release? Anyway, Not interesting... If the stuff doesn't work people won't use it. It will die a natural death.
> What is your plan for alpha/beta testing?
Release early, release often but maintain a good stable release if you're changing things rapidly. Don't need QA to tell us engineers how to do that.
> What is your release schedule?
Irrelevant. It's done when it's done unless someone's paying.