Slashdot Mirror


Mob-Sourcing — the Prejudice of Crowds

An anonymous reader writes "ZDNet takes a look at how crowd-moderation can capture and reflect the prejudice of individuals. 'As more web content is crowd-sourced and crowd-moderated, are we seeing only the wisdom of crowds? No, we're also seeing their prejudice. The Internet reflects both the good and ugly in human nature. ... Any system relying on people implicitly encodes prejudices as well. In a world where one politician with a call girl is forced to resign and another is handily reelected, there is no hope for moral or intellectual consistency in crowd-sourced or moderated content.'"

48 of 178 comments (clear)

  1. Clearly by Corbets · · Score: 4, Insightful

    Anyone who needed ZDNet to tell them this clearly hasn't been on Slashdot very long.

    1. Re:Clearly by AnonymousClown · · Score: 3, Funny

      Anyone who needed ZDNet to tell them this clearly hasn't been on Slashdot very long.

      Yeah, just look at many of the moderations in the previous two articles on Linux and Apple.

      --
      RIP America

      July 4, 1776 - September 11, 2001

    2. Re:Clearly by KingAlanI · · Score: 2, Informative

      beat me to it; I figured there would be some comment about Slashdot groupthink (not 100% by any means, but very often a significant majority of people lean a certain way on here TBH)

      --
      I listen to both RIAA and non-RIAA stuff if I like the music, tangential business/politics nonwithstanding.
    3. Re:Clearly by gregrah · · Score: 2, Funny

      Mod parent down.

    4. Re:Clearly by edumacator · · Score: 4, Funny

      That's just stupid. Let's all mod this jerk down...

    5. Re:Clearly by Yvanhoe · · Score: 2, Insightful

      Actually crowdsourcing isn't perfect but it looks so awesome because it is a way to bypass clueless bosses and a typical hierarchy who thinks that a handful of prejudice is a "science of management".

      --
      The Wise adapts himself to the world. The Fool adapts the world to himself. Therefore, all progress depends on the Fool.
    6. Re:Clearly by makomk · · Score: 2, Interesting

      Slashdot actually had a reasonably well-implemented user moderation system, though. If you want spectacular fail, try (for example) Feministe's rather short-lived user moderation setup, which made the site totally useless for its intended purpose of fighting oppression. (It was briefly a very good place for well-off white women to complain about how the uppity black women were whinging too much without hearing too much from them, though.)

    7. Re:Clearly by daem0n1x · · Score: 2, Funny

      The expression "wisdom of crowds" always brings up a mental image of a cattle stampede.

    8. Re:Clearly by Yvanhoe · · Score: 4, Informative

      http://oldweb.ct.infn.it/cactus/peter_principle_sup_material.html

      Actually, some serious works seem to indicate that when promotions are randomly distributed, an organization is more efficient than when promotions are distributed by regular managers. So we can now say with scientific proofs that comparing managers to monkeys is actually insulting for the monkeys.

      --
      The Wise adapts himself to the world. The Fool adapts the world to himself. Therefore, all progress depends on the Fool.
    9. Re:Clearly by Mr.+Slippery · · Score: 3, Interesting

      Most people can't grasp the fact that if you put a random employee in place of the CEO in the company, the company will most likely grind to a halt or even disintegrate.

      Citation needed.

      CEOs of large companies do not generally get there on merit, but on the "old boys" network. I would not surprised if randomocracy generally produced equivalent results.

      --
      Tom Swiss | the infamous tms | my blog
      You cannot wash away blood with blood
    10. Re:Clearly by timeOday · · Score: 2, Interesting
      If you put a bunch of CEOs in a room they wouldn't agree on anything either.

      Top-down control is good when making decisions quickly matters more than getting them right. Battle is the classic example.

      Centrally planned economies (i.e. one corporation on a national scale) always go off the rails. On the other hand, everybody acting as individuals and simply contracting to each other would be way too inefficient. You need a certain amount of centralization; not too much, not too little.

    11. Re:Clearly by bornagainpenguin · · Score: 2, Insightful

      Most people can't grasp the fact that if you put a random employee in place of the CEO in the company, the company will most likely grind to a halt or even disintegrate.

      And this is a problem how? Golden Parachutes for the win, baby!

      Face it the CEO doesn't know how to run the company either, they're just better equipped to abandon ship before the consequence of their mistakes has time to bite them on the ass.

      --
      Have a Virgin Mobile USA smartphone? Give VMRoms.com a try!
  2. Calling Hari Seldon by Black+Parrot · · Score: 3, Interesting

    Someone needs to give it a mathematical treatment.

    --
    Sheesh, evil *and* a jerk. -- Jade
    1. Re:Calling Hari Seldon by jc42 · · Score: 3, Funny

      Someone needs to give it a mathematical treatment.

      It's been done. Years ago, it was determined that the intelligence of a group of humans is inversely proportional to log(N), where N is the number of people in the group.

      Actually, there has been some dispute over exactly what sort of (inverse) function applies, since in some groups, the leaders find ways to divide the group up into functional sub-groups. This produces a set of smaller groups, each with a higher intelligence than the entire group would have if it worked together. But then the top-level intelligence is limited by the inter-group communication, so a similar function may be used to combine the subgoups' intelligence into a measure of the entire group's intelligence, and we all know how exponential functions combine, right? What? Some of us don't? Uh ....

      There have been some wags that claim that the inverse function actually involves N squared or cubed, but there seems little evidence that (outside of politics) it's really all that bad.

      There has also been some confusion caused by tests being done that included religious groups. But that data had to be discarded, since those groups tend to have a firm ban on the application of intelligence in any group activity, and researchers don't have tools capable of measuring the intelligence level of people who are blindly following (and misinterpreting) the commands of a leader. But there is hope that we may some day be able to measure quantities that small, similarly to how physicists can measure individual elementary particles. This may lead to some interesting results in the study of intelligence.

      --
      Those who do study history are doomed to stand helplessly by while everyone else repeats it.
    2. Re:Calling Hari Seldon by fridthjoff · · Score: 2, Informative

      you need a math that can speak about itself consistently.

      OT: Didn't Gödel prove this to be impossible?

    3. Re:Calling Hari Seldon by necro81 · · Score: 2

      An important corollary: nothing was created, either.

  3. Wow! Have they discovered Wikipedia? by Chas · · Score: 3, Insightful

    Welcome back to reality newbs!

    Who, ANYPLACE, promised you prejudice-free surfing on any site on the Internet?

    And did you buy a bridge from them?

    --


    Chas - The one, the only.
    THANK GOD!!!
  4. Do we need consistency? by gman003 · · Score: 2, Insightful

    After giving it a bit of thought, I don't think consistency is too much of a problem. Things that 100% of people like will be up 100% of the time. Things 99% of people like will be up 99% of the time. If only half of people think it is proper, it will be removed half the time. And so on, until we reach the things everybody hates, which will be immediately removed. What happens is that things some people dislike will be reduced, but still available, giving us a compromise - people who disapprove will not encounter it as often, but those who desire it can still seek it out and obtain it. Sure, edge cases may be problematic - if only one in a thousand people considers something acceptable, it will be difficult to find; people who are easily offended will still be often offended. But those are the outliers - for the majority of the probability distribution, it will be relatively fair. Much more so than letting a select few moderate all the content, at any rate - by increasing the number of moderators, you decrease the effect any one has.

    1. Re:Do we need consistency? by Urza9814 · · Score: 2, Interesting

      Except moderation schemes are usually skewed towards hiding things. Look at slashdot: Say 10 people moderate the same post. Half of them like it, half of them hate it. So it gets -5 Troll and +5 insightful or something. It's still at 0 or 1. Nobody will see it.

      Plus, people only read so many items on the average site. So say we have a news site where the highest ranked items go to the top of the front page (basically how Digg works? I think? Maybe?) Well, if 100% or 99% etc of the people like an article, it'll be at the top, and everyone will read it. But if the site has a lot of readers and a lot of articles, the things that only 50% or 75% of the readers like will still get buried too low for anyone to actually read them.

      What we need to solve that problem is more filters on what type of content you want to see - but then people only see things they agree with, further reinforcing their prejudices. There's really no good system I guess.

  5. Re:Why should this suprise anyone? by Anonymous Coward · · Score: 3, Informative

    Also called the illusion of confidence.

  6. I propose... by drmofe · · Score: 3, Insightful

    ...not having RTFA, that the article is bogus.

    Who's with me?

    1. Re:I propose... by sco08y · · Score: 4, Interesting

      ...not having RTFA, that the article is bogus.

      Who's with me?

      Having read the article, the author was irritated that some listings on craigslist got deleted, thought that it was unfair, and spun that into speculation about how moderation through the crowd might encode some prejudices in some way that he hasn't really thought through.

      So, it's not bogus so much as half-baked.

    2. Re:I propose... by Amorymeltzer · · Score: 2, Interesting

      I wouldn't use the word bogus, but it IS essentially one man's whine about how his stuff was deleted. The last two sentences sum it up for me:

      That shows our freedom of speech is better protected when bought and paid for. The web is censored and manipulated in more ways than we know.

      Entitled much? Craigslist is offering a service and if you don't like how their service is run, go elsewhere. But just because the actual customers didn't like your presentation, it doesn't mean CL is a corporate fatcat out to ruin the Constitution. If you want to write about mob rule, write about slashdot, or *chan, or wikipedia, or ancient Athens. As of now, this falls under "stories a friend would tell me that I would nod and smile to and then change the subject."

      --
      I live in constant fear of the Coming of the Red Spiders.
  7. I am Shocked! by Loopy · · Score: 3, Insightful

    Shocked, I tell you, to find humanity in here!

    And another great quote: a person is smart. People are dumb, panicky dangerous animals and you know it.

  8. Or, how about a big plate of SPAM? by one+cup+of+coffee · · Score: 3, Insightful

    More and more it appears the so called voice of the crowd is becoming the voice of the organization paying the spammers.

    http://blogs.discovermagazine.com/80beats/2010/11/02/follow-the-%E2%80%9Ctruthy%E2%80%9D-tweets-to-find-twitter%E2%80%99s-political-spammers/

  9. Re:Dead Fish always float only downstream by MokuMokuRyoushi · · Score: 3, Funny

    I'll prove your first point, watch.

    Jesus Christ is the resurrected Lord and Life giving Spirit.

    --
    Humans are terrible replicators of Godly things.
  10. Re:Dead Fish always float only downstream by TapeCutter · · Score: 5, Insightful

    Yes the system you used to post your comment was created by a singular fisherman, that's why it's called the "net". /sarcasm

    I'd hazard a guess that your karma is in the cellar because your Gallileo complex prevents you from fully thinking thru what you are saying.

    --
    And did you exchange a walk on part in the war for a lead role in a cage? - Pink Floyd.
  11. Our findings prove our findings are prejudice. by VortexCortex · · Score: 4, Interesting

    Wait, so someone actually used crowd sourcing as a way to gather information for a study against the common wisdom of crowd sourcing -- which reveals that crowd sourcing is prejudiced?

    They expect us to believe that their "wisdom" gained from "crowd" sourcing shows "'the wisdom of the crowd' is prejudiced", and theirs isn't?

  12. Re:Dead Fish always float only downstream by gregrah · · Score: 2, Interesting
    This post made me think of the Crackpot Index, i.e.:

    40 points for claiming that the "scientific establishment" is engaged in a "conspiracy" to prevent your work from gaining its well-deserved fame, or suchlike.

  13. Re:Why should this suprise anyone? by hoytak · · Score: 2, Insightful

    I think politics has its own brand of crowd sourcing. This sums things up nicely.

    --
    Does having a witty signature really indicate normality?
  14. Re:Dead Fish always float only downstream by catbutt · · Score: 5, Insightful

    I disagree with the crowd all the time on slashdot, and yet my karma's pretty good. If you can express your point of view intelligently, it doesn't matter so much if you agree or disagree with "the masses". Slashdot's system is far from perfect, but if you compare it to other online forums, it's clear that a well designed karma system can mine the intelligence from crowds. The fact that wikipedia is pretty good, and that it is hard to out-guess prediction markets are other examples.

  15. Re:Dead Fish always float only downstream by Rakishi · · Score: 4, Insightful

    I disagree with people all the time and am a downright asshole on here quite often. My karma is still high.

    Of course, karma is an aggregate measure of reputation in a way. If your karma is low than you're likely a useless asshole to the community who is best gotten rid off. Not always but it's a good rule of thumb I'd say. Disagreeing with people all the time across every topic also likely means you're insane and delusional. Plus not contributing anything worthwhile, trivial to gain karma in various utterly neutral discussions, indicates you're here just as an ego trip and have no desire to help the community.

    In general I found slashdot users actually quite good at moderating up intelligent and logical posts.

  16. Re:Dead Fish always float only downstream by shutdown+-p+now · · Score: 4, Insightful

    That is precisely why an my karma is in the cellar. Anyone who disagrees with the crowd anywhere, even on Slashdot, will get moderated into oblivion.

    The reason why you have your karma in the cellar on Slashdot is because you're a creationist with a long posting history. The first time someone is seen making posts like that, they usually get a reply explaining why they're wrong. But when they persist in posting exact same arguments, already thoroughly debunked in countless past discussions, again and again - yeah, you'll get a Troll mod or whatever pretty soon.

    Not from me, since I haven't seen mod points in years now (I think I post too much). But I'm not exactly surprised.

    And, yeah, it's "groupthink" for sure. I don't see a problem with it, though. "Murder is bad" is also groupthink, and I'm certainly fine with that one.

  17. Re:QQ Less, Pew Pew More by shutdown+-p+now · · Score: 2, Insightful

    The reason we live in a Republic is because a true Democracy almost always degrades into mob rule and eventually an Oligarchy.

    Any form of government where all citizens have a say can degrade into a mob rule - you can only try to increase the size of the mob that it takes to make it happen (by creating laws such as "need 3/4 votes to amend Constitution" etc), but you cannot avoid it except for a benevolent dictatorship (and those things stop being benevolent real quick IRL, even where they start as such).

  18. Re:Already learned... by gregrah · · Score: 2, Interesting

    I call BS here. I don't think you got modded into oblivion for "mentioning that logic should dictate the outcome of a decision and not political motivations." Hell - I'm an extreme liberal and I agree 100% with that statement. I'm thinking it was probably something else that you said.

    Show us the post that got you modded out of existence.

  19. Digg was a classic example of such bias. by Jane+Q.+Public · · Score: 2, Insightful

    Was? Is? Whatever, I don't go there.

    I noticed this effect the first time I saw Digg. A topic that started to trend would stay toward the top, and be seen my many more people, so it tended to trend even more, which means it stays near the top even more... and soon this bias becomes not just obvious, but enormous.

    Theoretically it could happen even to a topic that was voted up by only a very few people, if they did it at about the same time. Which means that there is a certain amount of Chaotic nature to trending topics on Digg, and the eventual trends may bear very little resemblance to peoples' actual preferences, were a simple vote or some other measure taken for comparison.

  20. Re:Dead Fish always float only downstream by shutdown+-p+now · · Score: 3, Insightful

    Dissenting opinions are fine when they are substantiated. However, when the same opinion is repeatedly expressed without being substantiated, or when the arguments given in favor are obviously false (as they were reviewed and debunked when they first appeared a long time ago), and nothing new is added - such an opinion becomes mere boring drivel, and will get modded accordingly.

  21. Re:Dead Fish always float only downstream by Rakishi · · Score: 5, Insightful

    Interesting how you stretch what he said beyond it's meaning in an attempt to support your own point. Good example of how not to post.

    OK, I got it - as long as the dissenting opinions are acceptable and not debunked, they are acceptable.

    Yes, if it's been debunked then it's wrong and as such of low value. Glad to see we're on the same page.

    Of course, if they were acceptable and had been approved by the authorities, they wouldn't be dissenting opinions, would they?

    Yes, the mysterious secret alien authorities running slashdot and sucking out our brains wish to keep you in your place. Now shut up and stand still while they insert the straw.

  22. Re:Dead Fish always float only downstream by francium+de+neobie · · Score: 4, Interesting
    Yet, there're many unwritten rules on Slashdot that have nothing to do with your comment's quality:
    1. If you post near the top, you're more likely to get modded up even if your comment is only mediocre or group think. You can actually quite accurately predict a post's mod points by measuring its position on the thread and its relevance - mod are lazy.
    2. Any rebuttal to your comment, even a very half-assed one, and especially the personal attack kind (!), is likely to get you, the parent poster, modded down. Happened to me many times, the mods are basically encouraging flamewars.
    3. Long, original posts take a long time to get moderation points - even though it can eventually get a 5 Informative from patient mods. Long, unoriginal post get the same points very easily because the poster copied it from the article or Wikipedia. So, original insights are being discouraged from this system unless you're someone famous like Steve Woz.
  23. James Madison Said It First by TTL0 · · Score: 2, Interesting

    "Measures are too often decided, not according to the rules of justice and the rights of the minor party, but by the superior force of an interested and overbearing majority.

    Alert to the dangers of majoritarian tyranny, the Constitution's framers inserted several anti-majority rules.
    http://www.capitalismmagazine.com/politics/democracy/5496-Abhorrence-Democracy-and-Mob-Rule.html

    --
    Sanity is the trademark of a weak mind. -- Mark Harrold
  24. Are you sure that Clinton lied under oath? by Sara+Chan · · Score: 2, Informative

    Are you sure that Clinton lied under oath?

    Clinton was asked, under oath, if he had a sexual relationship with Lewinsky. Clinton did not immediately answer the question, but instead asked what was meant by a "sexual relationship". He was told that a sexual relationship was a relationship where they had sexual intercourse. Clinton then said that he did not have a sexual relationship with Lewinsky.

    Clinton and Lewinsky had oral sex, but they did not have sexual intercourse. Clinton was slippery, but he does not seem to have lied.

  25. Re:Dead Fish always float only downstream by Ginger+Unicorn · · Score: 2, Insightful

    He's not the resurrected Lord and Life giving Spirit - he's a very naughty boy!

    --
    (1.21 gigawatts) / (88 miles per hour) = 30 757 874 newtons
  26. Re:Dead Fish always float only downstream by ffreeloader · · Score: 2, Interesting

    Now, I have no idea who the poster is that you're replying to, but the moderation here is often unthinking groupthink. A majority of people here start from a common basic premise for their thinking/logic on many issues. Anyone who begins with an opposing basic premise, even though they are a logical person, will end up at a much different conclusion than the majority. Groupthink then kicks in and that person is derided as illogical and stupid because because they ended up at a conclusion that seems illogical to those who started from an opposing basic premise, and the moderation around here reflects that attitude.

    Around here Christians and conservatives are stupid, irrational, etc... and ad hominen attacks against them are commonplace. Those posts are modded down sometimes, but more often than not are modded up on nothing stronger than prejudice as the common basic premise between the poster and the moderator. Logical fallacies, such as ad hominen attacks, are not good examples of rational thinking and should never be promoted as such. Yet, here they are on a regular basis if you devote the attack toward what is a minority opinion on this site..

    I've also been on sites where just the opposite is true for who is seen as irrational and illogical. The secularist is modded as troll and illogical, and ad hominen attacks against them are modded up on those sites. Neither group of mods is doing a good job, and neither group of posters show tolerance for logic that has its origins in a basic premise that opposes their own.

    What does it say about our society when we, as a society, are eating our own because of our differences in basic premises? How is this sustainable? How is this good for society? If this keeps on in the same direction it will end in some type of civil war as civility between opposing points of view is rapidly deteriorating. Both sides will have their own thought police. Is that really a society any of us want to live in? If you don't like that society you're the only one who can change our current direction as the only way the current direction our society is taking can change is for individuals to change. Government can't do anything about it, other than try to legislate what point of view is allowed, and I don't really think anyone wants to go there.

    --
    "while democracy seeks equality in liberty, socialism seeks equality in restraint and servitude." de Tocqueville
  27. Re:Dead Fish always float only downstream by dotancohen · · Score: 2, Insightful

    "Murder is bad" is also groupthink, and I'm certainly fine with that one.

    Actually, that's not groupthink but a religious commandment.

    One thing with those ten commandments, though. Of those that deal with human-human relationships and not the human-god relationship, they sure have stood the test of time. Lots of things were important then that aren't important now, but that list is pretty universal.

    --
    It is dangerous to be right when the government is wrong.
  28. Re:Dead Fish always float only downstream by MokuMokuRyoushi · · Score: 2, Insightful

    You have been modded up. Does that prove you're wrong?

    I guess so! I must have been wrong, and the crowd here loves the Lord! Honestly though, it doesn't matter to me how it's modded - I win either way.

    --
    Humans are terrible replicators of Godly things.
  29. Moral consistency does not exist anyway by wealthychef · · Score: 2, Informative

    Morality is entirely subjective, although it often seems objective to the individual. So hoping for moral consistency is a pipe dream. Why even bring it up? A politician with a call girl is not really thrown out due purely to morality reasons -- voters make a judgment about their ability to lead them and whether they trust them to make good judgments and be the kind of person they want to have lead them, which are not moral judgments.

    --
    Currently hooked on AMP
  30. Re:Dead Fish always float only downstream by HeckRuler · · Score: 2, Interesting

    Yeah, some items are so universal that they were even agree upon BEFORE Moses came down the hill. Like murder. I'm pretty sure murder was bad before Moses, and I'm pretty sure that murder was bad in China and India. So it didn't really originate as a religious commandment. Don't get me wrong, I think it's swell that it got made official and written down. "In stone" so to speak. For that little group.
    But your statement makes you a troll for trying to claim that something as universal as "murder is bad" is the sole domain of one particular religious group. Actually, the "badness" of murder is kind of built into the term. So the first creator was really whoever first came up with the concept to differentiate different kinds of killing. Although it might have been a group effort, and it was certainly recreated by others.

    You're religious, that's fine. You're christian, that's fine too. But the point you start making factual errors and claim ownership of a universal concept? And then get modded up for it? That's the point I have to call bullshit. So as to not ruffle your feathers too much, let me put it this way: There are the Mandarin, Indian, and Summarion words for murder. None of those peoples had any interaction with Moses or the commandments, so how did these groups of people know how to define murder?

  31. Re:Not all politics is a matter of mob rule by wealthychef · · Score: 2, Informative

    The hell with parties -- parties have little effect on public opinion -- they just game opinion so they can stay in power. People vote for what they fear and what they want. In some areas, it seems significant that their guy screws hookers, especially if they are married. In some areas, it does not. If districts were not gerrymandered to protect incumbents, maybe we could even find out what really matters to people.

    --
    Currently hooked on AMP