Slashdot Mirror
Web Geniuses Or Web Dimwits?
ScribeCity writes "The Washington Post has a provocative piece about online experiments at identifying experts. One wonders when someone will come up with a truly effective formula for measuring human intelligence — or take a stab at doing so — that exploits all the stuff people are publishing online." From the article: "This wisdom of the crowd could be outsmarted by what Michael Arrington, editor of the TechCrunch blog, recently dubbed the 'wisdom of the few.' Sites like PicksPal rely on input from the masses chiefly as a venue for auditioning prospective experts, on the theory that these virtuosos could provide even more accurate information and predictions than the crowd. 'If you figure out which ones did the best and get rid of the ones who have no idea, you'd do even better. Distill it down to the people who really know,' Arrington said."
Just get a chimp to throw darts at the wall...
In order to effectively determine the rate of experts vs. everyone else, you could simply scan through all previous Slashdot posts (while removing those prefaced by IANAL) and easily determine those that are experts.
;)
Make sure you are browsing at -1, *those* people are the real experts
One wonders when someone will come up with a truly effective formula for measuring human intelligence
It won't happen, not because it's not possible, but because some group or another will have a lower mean score, and the cries of racism, sexism, ageism, redbluestateism, culturalism, OSism, haircolorism, footsizeism, dicksizeism, or whateverism will drown out the truth.
You know... the way it is right now.
Make a group based moderation system, where you moderate in groups.
Step1: Lets say Democrat/Republican. When a Rep mods something up, all other Reps see it modded up. If a Dem mods something down, no other Reps see it modded down.
Step2: Identify posters who say stuff that gets modded up past a certain point. Lets say you get a point for the top 10 posts of each day. Then the posters with the most points are dubbed experts in their field.
Its simple, and I'm suprised no one has done it before. It's like Digg in some ways, but vastly superior as groups don't bicker over what they declare as news, and it identifies experts.... maybe even political candidates.
God spoke to me.
There is a certain logic to this. How many times have "experts" told us screwy nonsense, and had lousy track records, and yet the public at large retained them as experts? Sometimes, the untrained may be able to see things that the supposedly well-trained can't.
;)
Or to put it another way, it all becomes a set of probabilities. If person X has guessed the outcome of something (say, a football game) correctly 80% of the time, then you're safer betting on his predictions than you are betting on expert Y who is only correct 30% of the time. If you aggregate the probabilities and successes, you should be able to develop a model with a high probability of being correct. You'll never be able to gain 100% accuracy, but that's just the nature of the Universe.
Javascript + Nintendo DSi = DSiCade
... you sound like you could be an expert.
sigs, as if you care.
'If you figure out which ones did the best and get rid of the ones who have no idea, you'd do even better. Distill it down to the people who really know,' Arrington said.
I've always said that elections should qualify each voter's ballot to make sure the decision is made by the people who are best equipped to decide. The first page of a voting ballot should be a questionnaire that asks simple unbiased questions that require the voter to demonstrate knowledge of who or what they are voting on. "What does candidate X say their stance is on abortion?" "When did you first hear about initiative I-456?" "Please specify which political party each candidate below belongs to", etc. The score a voter gets on their questionnaire would then be used as a "weight" factor when counting their ballot, so that people who know the candidates and the issues better get more of a say, which is clearly how things ought to be.
Moderator hint: a comment is neither "Flamebait" nor "Troll" if it is true.
1) Read old threads at +5, new threads at +2
2) If a person has a lot of insightful/informative posts, check their posting history
3) If they are consistently +3/4/5 informative/insightful, add them as a friend
4) add points to friend's posts so they start out +2.
OK, seriously, I don't do that but if I did, I'd see posts of "wise ones" and ignore posts from those that don't make the cut.
Knowledge is how to play a game, intelligence is how to win, wisdom is knowing what game to play.
If about nothing he everything knew then truly the force would be with him!
Old COBOL programmers never die. They just code in C.
Ooh! Just like U.S. Federal Government! Good idea!
My blog
My mother is a professor of education at a college in California and this is something that educators have been talking about for a long while. Google for "multiple intelligences" for a lot more information, but basically there's a theory that says that "intelligence" can be divided up into a number of categories and that people tend to excell in one or two of these areas, but few are outstanding in all of them.
The standard breakdown is something like:
Atheletes tend to excell at Spatial and Kinesthetic, while the stereotypical geek is strongest in Logical-mathematical and weakest in Interpersonal.
I'm not sure I completely agree that this is the end-all-be-all for understanding intelligence, but it does provide an interesting look into ways to classify people who might not be "book smart." For instance, a terrific ballerina might not have excellent Interpersonal or Linguistic intelligence, but she certainly has some special "intelligence" that allows her to excell in an area where I would certainly be an abject failure.I encourage anyone interested in this idea of multiple intelligences to poke around and do some research. Again, it may not be the final answer, but it provides an interesting framework for thinking about the topic.
Interested in a Flash-based MAME front end? Visit mame.danzbb.com
Isn't this just that same old thing, where for each sporting event, you send a mailer to 50% of the people picking one team, and 50% picking the other, and whoever wins, that 50% of your original audience gets split between the two possible winners in the next mailing? Eventually you end up with a small audience, but they're CONVINCED you have a flawless sports betting "system" and pay you to learn it.
Here, by pretending you're figuring out who the "experts" are, you're not diluting your audience with each round of guessing; instead, you're diluting your potential pool of "experts" (or systems), and eventually everyone decides that person X is always right, when really odds were that at least one person in a large pool of guessers would guess right 100% of the time.
Past performance is no guarantee of future performance, people.
This sounds like the old scam. Pick 1000 people. On day 1, send 500 of them a prediction that stock A will go up and send the other half a prediction that the stock will go down.
On day 2, the stock either went up or down. Either way, you made a correct prediction to 500 people. Split the 500 and send two more predictions on an all new stock.
Keep repeating this. On the fifth day, you'll have 75 people who have seen you make 5 perfect predictions in a row. Now ask each of them for $10,000 to invest in your next prediction...
Just because one person happens to have hit the mean each time doesn't mean he's got "the knack". Statistically, there's sure to be someone whose guesses approach the mean. But that doesn't mean that their next prediction is any more likely to be accurate.
Stick with the aggregated mass knowledge.
-- Don't Tase me, bro!
One thing you have to remember: Perception > Reality. Speaking intellegently and writing intellegently is usually enough to convince someone that you actually know what you're talking about, if you're audience is ignorant or naive. That makes for a lot of percieved experts in the field of technology. Take the example of an internet born initiative to ban dihydrogen oxide in some county California http://www.dhmo.org/facts.html. Read this. If you haven't already heard of this, well, dihydrogen oxide is water. See how easy it is to convince a bunch of soccer moms they need to ban water? (Or that apple needs to abandon hardware... hehe)
Similes are like metaphors
If they are posting stuff on the Internet and sound like an expert, they are most likely NOT an expert.
"As God is my witness, I thought turkeys could fly." A. Carlson