Slashdot Mirror


Data Mining Shows How Down-Voting Leads To Vicious Circle of Negative Feedback

KentuckyFC writes: "In behavioral psychology, the theory of operant conditioning is the notion that an individual's future behavior is determined by the punishments and rewards he or she has received in the past. It means that specific patterns of behavior can be induced by punishing unwanted actions while rewarding others. While the theory is more than 80 years old, it is hard at work in the 21st century in the form of up- and down-votes — or likes and dislikes — on social networks. But does this form of reward and punishment actually deter unwanted actions while encouraging good behavior? Now a new study of the way voting influences online behavior has revealed the answer. The conclusion: negative feedback leads to behavioral changes that are hugely detrimental to the community. Not only do authors of negatively-evaluated content contribute more but their future posts are of lower quality and are perceived by the community as such. What's more, these authors are more likely to evaluate fellow users negatively in future, creating a vicious circle of negative feedback. By contrast, positive feedback does not influence authors much at all. That's exactly the opposite of what operant conditioning theory predicts. The researchers have a better suggestion for social networks: 'Given that users who receive no feedback post less frequently, a potentially effective strategy could be to ignore undesired behavior and provide no feedback at all.' Would Slashdotters agree?"

15 of 293 comments (clear)

  1. BS by marcello_dl · · Score: 4, Funny

    This story sucks.
    Let the game begin :)

    --
    ---- MISSING MISCELLANEOUS DATA SEGMENT --- [sigdash] trolololol
    1. Re:BS by the_povinator · · Score: 5, Interesting
      I read TFA, and unfortunately the research is very weak. They did not do a proper randomized study, they merely trained a classifier to figure out how good they thought a post was, and then divided up posts into pairs where their classifier thought they were the same but the feedback was different. They assume that their classifier is accurate, i.e. really reflects the goodness of a post. The rest of their research follows from this assumption.

      If it had been a proper randomized study (i.e. roll a dice and up/down vote posts) I could have believed it.

      --
      The .sig is dead, and I believe I had a hand in killing it.
    2. Re:BS by fyngyrz · · Score: 4, Insightful

      It's correct. Slashdot's moderators routinely downrate good posts on the basis of "disagree", and the system itself hides good conversations, muzzles the moderators, incorrectly presumes anonymity is a bad thing for posts (wrong), while assuming anonymity is a good thing for moderators (wrong again), and does nothing effective about moderation abuse. The best thing you can say about it is that it can be ignored if you properly configure your browsing options. By far the best way to read slashdot is at -1. I've been doing it for years.

      --
      I've fallen off your lawn, and I can't get up.
    3. Re:BS by Zamphatta · · Score: 5, Informative

      I totally agree. I was getting 15 mod points every 3 days or so. I generally upvote stuff that I find worthy of it, and ignore comments "bad" comments unless they were seriously bad/trollish/obvious flambaiting. Recently, somebody down voted all of my comments in one thread so they were 0'd, and then /. suddenly decided that I'll only deserve 5 mod points every few days. That, to me, is obviously weird. I thought my comments weren't that bad, even if they weren't great. This is the 2nd time this has happened to me, and it happens far too easily. So I just stop commenting 'cause I don't want to risk losing all my karma over 1 comment just because somebody might not agree with my viewpoint.

      For the record, I'm hesitating to submit this comment. I could do it anon, but, I'd like my thoughts to be attached to my identity..... otherwise it just feels like free speech is really dead around in this community.

    4. Re:BS by crossmr · · Score: 5, Interesting

      There is a lot of retaliatory butthurt behaviour on the internet.

      You make one comment someone doesn't like and suddenly it's open season on everything you've ever said, regardless of it's worth. Somewhere like Reddit, someone will go through and downvote your last 40+ comments just because you got the better of them in a debate. Downvoting without commenting is the last vestige of the defeated. They know their argument can't hold water, so rather than concede the point, or move on, they go through and downvote anyone who spoke against them. While some comments are generally stupid enough that they need no reply (or further replies than the ones they've already received), someone who just abandons a discussion in favor of downvoting damages a community.

      I can remember one exchange over on reddit, something on Korean language, where a native Korean chimes in as a reply to my comment "This guy is totally 100% right why is this being downvoted?" And it was all because of some other topic where a handful of butthurt children couldn't handle being proven wrong on a point so decided to run around downvoting anything else I'd posted within the last few days.

      I've had it happen on Slashdot as well. Not in awhile, because I don't comment here as much as I used to (I used to frequently get mod points, but not that much recently). A few times, almost always after a debate with someone, the other party (I can only assume) would get mod points, and then past posts of mine, like ones over a week old, would suddenly all be moderated down as troll or something like that. I think I even made a post a few years ago about vindictive moderation.

       

    5. Re:BS by AthanasiusKircher · · Score: 4, Insightful

      It's correct. Slashdot's moderators routinely downrate good posts on the basis of "disagree"

      I haven't had this experience very often at all, and I frequently post controversial opinions that tend to be against the mainstream opinion here. In fact, one of the most common situations where I bother to post at all is where I see a post that has already been modded "+5 insightful" or something, but it's full of incorrect information or is speaking from ignorance.

      When contradicting such a post, I always make a point of explaining my objections with supporting details and often links to information that shows what is wrong with the parent post. Sometimes I'm ignored, but rarely downmodded below my default karma post level of 2. (I've probably posted something like a thousand posts here, and I bet I could count the downmods below my initial score on one hand.) Once in a while, I get modded up, then modded down, and sometimes up again. I don't monitor my posts closely, but I've seen it happen a few times.

      In general, though, when I post something controversial or against a parent who was already modded up, I explain myself, and I'm not a jerk about it unless the parent is obviously an idiot or has already been a jerk about something.

      And in quite a few years of doing this, I've almost never encountered the sort of abuse you're talking about. Being ignored? Yeah, sometimes. But actively downmodded? Not when I make my point clearly.

      and the system itself hides good conversations,

      As well as a whole lot of spam, trolls, and other nonsense.

      muzzles the moderators, incorrectly presumes anonymity is a bad thing for posts (wrong),

      In any ideal world, I would like for an AC to be equivalent to a registered user with neutral karma. I agree that anonymity should not be penalized simply for anonymity -- especially since in some situations, posters may really NEED to be anonymous.

      Unfortunately, the number of situations where that anonymity is necessary is quite small compared to the number of AC posts that contain spam, trollish behavior, etc. So, Slashdot's decision to mildly encourage pseudonyms over AC is, overall, I think a pragmatic solution. Since Slashdot doesn't require real names, this isn't a problem for me -- pseudonyms are good enough in most circumstances, and it encourages people to be more responsible in their behavior to maintain a generally positive record of contributions.

      I agree that mods seem to ignore AC's more often than registered users, and I think that's a problem. But I think making anonymous users higher in "default karma" would make it worse and harder to sift through the garbage.

      while assuming anonymity is a good thing for moderators (wrong again),

      So, you claim the system is broken because moderators unnecessarily mod people down to disagree with them. But you think that making moderation public will improve this? It might, in some cases. But then you end up with people pissed at other users who modded them down, and they might retaliate by downmodding their "enemies." Some of those reactions may be against unjust mods, but others may be people who are overreacting.

      In essence, you take a system where there are already some reasons to abuse downmodding, and you give people new reasons to do so -- which will tend to lead to more infighting. I agree that it could cut down on some abuse, but it would only work if you had a lot more adminstrative interventions and conflict resolutions (which I doubt would happen here).

      and does nothing effective about moderation abuse.

      I can't speak to this issue, because, as I said, I try to post positive contributions, and the amount of times I get downmodded is incredibly small.

      By far the best way to read slashdot is at -1. I've been doing it for years.

      I only ever

    6. Re:BS by Lisias · · Score: 4, Insightful

      Recently, somebody down voted all of my comments in one thread so they were 0'd, and then /. suddenly decided that I'll only deserve 5 mod points every few days. That, to me, is obviously weird. I thought my comments weren't that bad, even if they weren't great. This is the 2nd time this has happened to me, and it happens far too easily.

      It happens all the time to me, too.

      I just don't care. The 15 mod points will come back, and then someday some mod-troll will hit you again, and you will pass some time with 5 mod points again, and then by some reason the 15 mod points will come back again.

      Some time ago, the meta-moderating used to be used against such practices, but no more.

      My advice? Just ignore the problem. Enjoy the "free time" from moderating and try to enjoy it - you are not paid to moderate this thing, if Slashdot is OK with mod-trolling fskcing up the good moderators, why should we bother either?

      --
      Lisias@Earth.SolarSystem.OrionArm.MilkyWay.Local.Virgo.Universe.org
    7. Re:BS by MrL0G1C · · Score: 4, Interesting

      The seemingly obvious answer is to have I agree/disagree as completely separated options which do not effect the mod level of a post.

      I partly agree about anonymous moderation, I can't make reasoned debate about nuclear power without fearing being modded as troll, the worst part is that this appears to affect my ability to mod in the future, so effectively I am punished for putting forth my view - that's a horrible form of censorship. On the flip side, if I knew which **** was modding me as troll I might mod them as troll in the future as revenge, I'm sure I'm not the only person that would consider this.

      It would be nice to be able to appeal a troll mod, Meta-modding seems to over-look this - most meta-modding is of informative/insightful posts which is a waste of time.

      --
      Waterfox - a Firefox fork with legacy extension support, security updates and better privacy by default.
  2. In other words... by Dr+Fro · · Score: 5, Insightful

    Don't feed the trolls?

    --
    ********************
    I object to Intellect without Discipline.
  3. meta. by stoploss · · Score: 4, Interesting

    I look forward to observing the many ironic and humorous mods this topic will induce. In fact, the act of moderation itself may be the actual discussion more so than any of the content.

    I would mod my own post as insightful troll, for example. I mean, this is just pandering, right?

  4. Slashdot's moderating system by Solandri · · Score: 5, Insightful

    That's the criticism, well maybe that's too strong a word... That's the critique I've had of Slashdot's moderating system. By allowing both up-votes and down-votes, you create a system where the voice of the majority can drown out the voice of the minority. I've often seen people here express the mistaken belief that if a minority viewpoint is introspective or informative, it will survive the unfair downvotes and rise to the top. It doesn't work that way.

    The average ranking is not rank = up - down. It's rank = p1*up - p2*down. Where p1 is the size of the population which would rank it up, and p2 is the size of the population which would rank it down. A minority viewpoint consequently gets a disproportionate number of unfair downvotes simply because it's a minority viewpoint, and thus has to garner a lot more upvotes just to obtain an equal ranking to a majority viewpoint.

    For an apolitical, non-religious example, consider Windows vs. Linux. Say Windows users outnumber Linux users 50:1. Now imagine if a search engine let you rate search results based on whether they were useful or not useful, which is then used to prioritize subsequent search results. In every population, there's going to be an idiot segment who votes stuff down simply because they don't like it, not because it was inaccurate or irrelevant it was to their query. Consequently, if a search for hard disk repartitioning brings up four Windows sites and one Linux site as the top results, the Linux site is going to have 50x as many downvotes from those idiot users who never specified Windows in their search but were upset that an "irrelevant" Linux site was included in the search results. If the idiot segment of the Windows population exceeds 2% (numerically equivalent to 100% of the Linux population), that Linux site will end up with a negative rating regardless of how useful or informative it is.

    I say "criticism" is too strong a word because neither way is the "right" way to do it. They are just different. A moderating/ranking system which only allows upvotes simply generates different results from a moderating system which allows both upvotes and downvotes. Sometimes the former is more useful; sometimes the latter is more useful. The important thing is to understand the limitations of both and how it will bias the rankings, and not fall into the mistaken belief that a minority viewpoint has just as easy a time reaching +5 on Slashdot as a majority viewpoint. If a contrary viewpoint reaches +5 on Slashdot, it must be making a helluva good point.

  5. Re:I disagree by dbc · · Score: 4, Interesting

    What I find interesting is that over the years here on Slashdot, when I've posted an unpopular opinion it tends to simply get ignored. But.... unpopular *data*, now that is what brings out the pitchforks and torches. There is nothing that angers people so much as to be confronted with uncomfortable facts.

  6. Other suggestions by justthinkit · · Score: 4, Interesting

    6 years ago I suggested that any negative mod should cost you 3 mod points.

    2 years ago I said On political threads, all comments should have the same rating.

    Today I would add that maybe /. should increase the maximum points a post can accumulate. Giving more "upside" to the discussion.

    --
    I come here for the love
  7. Re:I disagree by AthanasiusKircher · · Score: 4, Interesting

    What I find interesting is that over the years here on Slashdot, when I've posted an unpopular opinion it tends to simply get ignored. But.... unpopular *data*, now that is what brings out the pitchforks and torches. There is nothing that angers people so much as to be confronted with uncomfortable facts.

    Funny -- I've had the exact opposite experience. If I contradict a popular post on a controversial topic without evidence, it is ignored. If I cite reliable sources to backup my opinion, it often gets modded up.

    I have seen situations where people get downmodded or ignored for posting "facts" from unreliable sources, like conspiracy theories or some quack website. Or they only cite their own "data," which is often just speculation or anecdote.

    I'm not saying it doesn't happen -- but I've contradicted a LOT of posts around here that had already been modded up as "+5 insightful," because the parent was just making crap up, and I responded with a reasoned argument and links to back it up. Unless you're a jerk or your data is of the "tin-foil hat" variety, I've seen the behavior you cite quite rarely... at least in my experience.

  8. Idea: Mod-down costs more points..? by Vegan+Cyclist · · Score: 4, Interesting

    It seems the down-mod still has some use, but the up-mod is preferred...how about if it just 'cost more' to mod-down posts?