Slashdot Mirror
Top Q&A Sites Reviewed
prostoalex writes "MIT Technology Review runs a real-world test of top question and answer sites — AnswerBag, Amazon Askville, MSN Live Q&A, Wondir, Yahoo! Answers and Yedda. The sites are rated on the features and originality as well as availability of answers to the journalist's three questions: 'First, I searched each site's archive for existing answers to the question "Is there any truth to the five-second rule?" (I meant the rule about not eating food after it's been on the floor for more than five seconds, not the basketball rule about holding.) Second, I posted the same two original questions at each site: "Why did the Mormons settle in Utah?" and "What is the best way to make a grilled cheese sandwich?" The first question called for factual, historical answers, while the second simply invited people to share their favorite sandwich-making methods and recipes." The results might be surprising to some readers. While it's generally believed that small startups are better at building efficient solutions, the leaders of the MIT Technology Review are all sites built by Internet giants — Yahoo! Answers, MSN Live Q&A and Amazon Askville all ranked above the competing sites."
It turns out "Just Google it." wasn't viewed as an actual answer.
Helium has a pretty unique formula, as well as paying people based on peer review of their answers. I've been there for about a month, and made $1.50. Of course if I can lure more readers there, I'll make more $$. Specifically though, I like the way the answers "battle" against each other, so when you go there you can see the answers ranked in order of "goodness."
Nothing great was ever achieved without enthusiasm
How about asking each of the sites this simple question:
"Which is the best question answering site?"
The more you regulate a company, the worse its products become.
Using things like quotation marks, logical operators, and even more conveniently the 'minus sign' can trim down the results for a search engine that supports them from tens of thousands (or more) to maybe a few dozen key hits.
The "Google it" approach would probably have yielded results as good or better as most of the Q&A sites if the search terms had been entered correctly.
I did it for Johnny.
I tell them to type a plain english question into Google because more often than not that turns up the right answer on the first page.
This is pretty close to the best technique, but not quite there. Googling for the question will find you pages with the question. Googling for as much of the answer as you can give works even better. Compare "what is the average rainfall in the amazon basin?" to "the average rainfall in the amazon basin is".
As someone who's very close to this space, I can tell you that this review was about as shallow as they get. Not only did the reviewer spend no time comparing and contrasting the actual Q&A mechanisms, but he gave random points for random features, a no-no when doing objective reviews. There should be a set list of criteria that each site is compared against. He gave Yahoo Answers 3 points for features, with no real explanation beyond saying they have a "My QnA" page (which Answerbag does as well) and "users can choose and customize their own cartoon self-portraits". I can think of a lot of great features at Y!Answers, but I don't think I'd be handing out 3 points just for the avatars Yahoo has been using for years. Worse, he doesn't explain how he gives points for answer quality. In the Answerbag section, he says the answer about Mormons was "more or less in line with the best answers to this question at other sites", but he only gave it 1 point out of 3. What gives? And for our answer on how to make a grilled cheese sandwich (which seemed pretty good to me), he only gives it a 2 out of 3 with no explanation of where the other point went. What gives? Naturally, as the founder of Answerbag, I'm not claiming that I'm totally objective, but as someone with a background in journalism, I'd like to see a little effort and scientific process go into a review like this. Read a professional home audio review or a car comparison, and you'll see how a real comparison review should be written. I'd love to write a real, scientific review, but I doubt people would see it as very objective. ;)