Slashdot Mirror


Inside the Largest Virtual Psychology Lab In the World

bearhuntz writes: Riot Games has been using League of Legends as a psychology lab to run scientific experiments and reduce toxic player behavior for a while now. This article explains some of the experiments they're doing, and what the results have been. "For example, one product is a restricted chat mode that limits the number of messages abusive players can type per match. It’s a temporary punishment that has led to a noticeable improvement in player behavior afterward —on average, individuals who went through a period of restricted chat saw 20 percent fewer abuse reports filed by other players. The restricted chat approach also proved 4 percent more effective at improving player behavior than the usual punishment method of temporarily banning toxic players. Even the smallest improvements in player behavior can make a huge difference in an online game that attracts 67 million players every month."

49 of 81 comments (clear)

  1. first to post Clockwork Orange by turkeydance · · Score: 3, Insightful

    ah. that's better.

    1. Re:first to post Clockwork Orange by Anonymous Coward · · Score: 1, Interesting

      I'm somewhat disturbed at how often we see Westerners, especially ones who should know better (like academics, students, and professionals) so actively supporting and forcing outright censorship on others.

      While they have the right to express such ideas, anyone claiming to support Western ideals just cannot support censorship at the same time. It's inherently contradictory, and extremely hypocritical, to do so.

      It's bad enough when censorship is used by those in power to maintain or increase their power. But it's far more disgusting when censorship is used for "improving player behavior", or worse, when such abusive action is taken in the name of stamping out other allegedly "abusive" action!

      When it comes to online communities, Reddit and Hacker News are among the worst offenders. They often go out of their way to quench and destroy any sort of original thought. If your ideas don't conform to the existing beliefs there, then you will be down-voted at best, but more likely banned. Every time I read HN, I see numerous other comments wrongfully voted down, numerous unjustifiably "hell-banned" users, and of course the typical accusations of other commenters being "disingenuous" or "snarky".

      I think the most hypocritical people are probably those in the anti-bullying movement, however. Here we have them saying how it's wrong to target a specific group of people and direct negativity toward them, yet that's exactly what we see them doing to people they have alleged to be bullies! These anti-bully advocates target bullies with more ferocity and outright hatred than we ever see the bullies direct toward anyone else.

      I sure hope this trend toward censorship and intolerance ends soon. It's far worse than whatever ills it may be trying to "cure".

    2. Re:first to post Clockwork Orange by ihtoit · · Score: 1

      Not an AC here. It's still at -1, and I agree, there's a bit of rage moderation going on in here. There are tells on styles of writing that experienced readers will be able to read and say "Oh, that AC is that registered user", which is particularly troublesome when downmodded comments turn out to be the most insightful, on topic gems and very often the least offensive, that get modded to oblivion just because someone's been made to look like an idiot on a forum.

      --
      Political debates have me rolling my eyes so much I think I got optical whiplash. I should sue. - Foamy The Squirrel
    3. Re:first to post Clockwork Orange by Fwipp · · Score: 2

      This just in: Not letting shitty people send as many messages in your game for a short while is "outright censorship." Even 4chan has mods, you know.

    4. Re:first to post Clockwork Orange by blue+trane · · Score: 4, Interesting

      Why can't you just use an /ignore function? Why impose your idea of what is abusive on everyone else? We have the technology to implement censorship at the client, without forcing prior restraint upon anyone.

    5. Re:first to post Clockwork Orange by Skidborg · · Score: 4, Insightful

      Why, exactly should Riot Games be obliged to spend their resources supporting a toxic player that their other (profitable) players find distasteful? They have a business to run. Don't pretend that LoL matches are some kind of forum for enlightened and creative thought. It's a game. A game which is made worse for all involved when enraged ranting is allowed to fill the chat in place of useful tactical communication.

      --
      Supporter of the +1 Over Dramatic mod option. In memory of apk.
    6. Re:first to post Clockwork Orange by Sardaukar86 · · Score: 1

      Why impose your idea of what is abusive on everyone else? We have the technology to implement censorship at the client, without forcing prior restraint upon anyone.

      Because stupid people, I'm afraid.

      The (cynical?) entrepreneurial amongst us long ago learned that the quickest and easiest buck to be obtained is the stupid dollar. Fully 50% of the population is at one's disposal if one has a sufficiently guilt-free complex. The work is probably as rewarding as taking candy from a stupid baby and certainly much easier (if you enjoy that kind of thing, that is).

      To me it's always been a bit of a cop-out. I'm sure it is easy once one gets past one's moral event horizon, rather like selling heroin to kids when one is otherwise capable of cutting useful code (for example). Still, there's no doubting the might of the combined dullard purchasing power but it's really their voting power that I find.. uncomfortable.

      However they're viewed by the rest of us they sure are capable of throwing their weight around and bringing about change. Stupid change, of course, but that's more about the desired outcomes of whomever is manipulating them at that time.

      Thus all corporate decisions are likely to go through the 'how will the stupid respond?' filter and sometimes they get it wrong, resulting in the mob-mentality behaviour you describe.

      --
      ..Mullah or Pope, Preacher or Poet, who was it wrote: "Give any one species too much rope and they'll fuck it up"?
    7. Re:first to post Clockwork Orange by blue+trane · · Score: 1

      Why wouldn't they want to implement an "all things to all people" approach, where you could experience only the chat you wanted to see, while they could still rant? Isn't this really about imposing personal taste on others?

    8. Re:first to post Clockwork Orange by ezdiy · · Score: 1

      Well put, though a bit fallacious.

      Reddit, HN and even slashdot are not censorship, but democratic rule of the mob. Majority conservative groupthink silencing the outrageous opposition.

      Mobs can be smart (delphi method), or dumb (torches and pitchforks).

      Sadly its often the case of the latter because people refuse to be rational about their confirmation bias. Exact same thing goes in politics or cultures in general.

      But I'd defer dissing democracy as such just because people are so bad at executing it.

    9. Re:first to post Clockwork Orange by geminidomino · · Score: 3, Insightful

      Except it's not terribly insightful, nor is it particularly truthful. There's a big gap between "abridging freedom of speech" and "not giving assholes a platform for their bullshit." Let them provide their own, with hookers and blackjack, etc.etc.

      It's not any different dropping spammers and that asshole who keeps trying to dictionary attack your SSH teergrube into a blocklist: crying "censorship" because you get smacked down for behaving like a tit isn't "insightful," it just makes you look like a 12 year old.

    10. Re:first to post Clockwork Orange by Skidborg · · Score: 1

      Racist-ranting 12-year-olds aren't the most profitable demographic, and FTP players are the product, not the actual customers.

      --
      Supporter of the +1 Over Dramatic mod option. In memory of apk.
    11. Re: first to post Clockwork Orange by geminidomino · · Score: 2

      And you're exactly the kind of person I'm referring to. If I invite someone over for a dinner party and they decide to piss on my couch "Becuz freedum," then they're going to be removed, bodily, and not allowed back.

      Your rights end where others' begin. And I'm not referring to the non-existent "right to not be offended", before you start bleating about that. I'm referring to the game owners' right to decide who they want to invite into their game - aka "Free Association".

      If they don't want their game associated with narcissistic little shits (which, let's be frank, LoL et al have been for a long time), they have that right as much to do so, as you do to spew your attention-whoring drivel: they're not stopping you from sharing your inane little opinions, which would be "censorship:" they're just making you get your own fucking microphone.

    12. Re: first to post Clockwork Orange by blue+trane · · Score: 1

      But this is billed as "the largest psychology lab". How likely do you think the findings about censorship are likely to be applied in other contexts, by government even?

    13. Re:first to post Clockwork Orange by blue+trane · · Score: 1

      Let's work on smart filters. How difficult can it be, to use big data to infer which posts you will probably want to see? If this company doesn't want to do it, their loss. Ultimate freedom for all, simultaneously, without affecting anyone else who doesn't choose to be affected, is the promise of technology. Market pressures are throttling progress towards that goal.

    14. Re: first to post Clockwork Orange by geminidomino · · Score: 1

      I doubt the government will pay any attention to it whatsoever. This is already handled quite well in meatspace (at least in the US) unless the target is the government itself - then the fuckers cheat, and that has been going on for 15+ years.

    15. Re:first to post Clockwork Orange by Fwipp · · Score: 1

      Sure, if you think that #gamergate is a cool thing by cool dudes.

  2. Not Really... by Stormy+Dragon · · Score: 2

    The largest virutal psychology lab. The scientists have just been conditioned to think it is.

  3. I doubt it by Ziggitz · · Score: 2

    This is a common practice used by a huge number of consumer facing businesses. Just off the top of my head I imagine Youtube, Facebook and Amazon all eclipse League of Legends in terms of A/B testing

    --
    There is no memory shortage. yes I have heard of XFCE. Go away.
    1. Re:I doubt it by zippthorne · · Score: 3, Interesting

      A/B testing is using feedback from your users to determine how to configure your product so that it is most useful to them. What LoL seems to be doing is using feedback from their product to change the users to be more useful...

      --
      Can you be Even More Awesome?!
    2. Re:I doubt it by Skidborg · · Score: 1

      It's an understandable move. In a FTP multiplayer game, the userbase is half the product you're selling to the real paying customers.

      --
      Supporter of the +1 Over Dramatic mod option. In memory of apk.
  4. But, voice is worse by Anonymous Coward · · Score: 2, Interesting

    I played derivatives of it like hon or maybe dotA, I forget. But in my brief time playing trying to get the hang of it, I just remember being told that I was a retard and a faggot and that I should kill myself. I think I missed something in mid as well.

    I've played fps with voice chat, and people get mad when objectives fail but I think most people are just doing their own thing and try to make up for crappy players by upping their own game. Some don't even care because it's more about having fun than anything else.

    Nothing in dota, lol or hon can be fixed with a mute button or a report button. I'm convinced the game mechanics simply flips a switch in normal people. Like an exaggerated version of that shitcocks image that is used to explain forum trolls.

  5. Real terrorists are born of conditions that game.. by Anonymous Coward · · Score: 1

    Real terrorists are born of actual life conditions that social media butterflies and game-playing losers could not imagine in their most lethargy-fueled nightmares.

    It is amazing how much time first-worlders can waste and still continue to exist, even prosper.

    I can't see this absurd status quo continuing much longer.

  6. ... Says Guy Commenting On Well Moderated Site by TrollstonButterbeans · · Score: 1

    So why are you posting here? Shouldn't you be posting on site with no moderation?

    --
    Priest: "Universe from nothing, no laws of physics, sped up time"+ huge discrepancies. Creationism? No. Big Bang Theory
    1. Re:... Says Guy Commenting On Well Moderated Site by blue+trane · · Score: 1

      Well I can set my filter to -1, and hide the moderation scores, even though it doesn't work too well: for example, a post above that was rated -1 (as a response to it noted) was not fully displayed; I had to click on it to read it. I wish slashdot would fix that bug so when I tell it I want unfiltered comments with no moderation scores, I can see everything.

      BTW I lost my mod privileges here over a decade ago, after I upvoted this comment.

    2. Re:... Says Guy Commenting On Well Moderated Site by TrollstonButterbeans · · Score: 1

      Interesting story. No doubt a different environment.

      --
      Priest: "Universe from nothing, no laws of physics, sped up time"+ huge discrepancies. Creationism? No. Big Bang Theory
  7. Misleading headline by grub · · Score: 1

    I was expecting this to be about slashdot.

    --
    Trolling is a art,
  8. The Toffee Approach by SuperKendall · · Score: 2

    Why not let abuse take place online in virtual environments?

    Because it sucks and leads to much more offline abusive behavior by otherwise good people after they have been repeatedly harassed.

    Instead, this psychology of banning and throttling likely leads to more offline abusive real-life suffering.

    The opposite is true. Because the natural abuser is inclined to fight through any system thrown at them, throttling and other attempts drain their energy more than simply letting them post would, leading to more relaxed (or at least less) behavior offline.

    Not to mention, we all know that trolls online are probably losers who would never in a billion years have the nerve to say or do anything offensive offline...

    --
    "There is more worth loving than we have strength to love." - Brian Jay Stanley
    1. Re:The Toffee Approach by guises · · Score: 1

      We do not know any of those things. We do know that trolls are sadists, but it's taking a jump to suggest that the average abusive League of Legends player is a troll. At least by the strict definition of troll used in that study.

      A lot of people act like it's just bad luck that League of Legend's player base is so abusive, or they say things like "Isn't it too bad that MOBAs attract such a bad group of people?" I hardly ever see the community blamed on the game itself, but you're talking relatively high stress game where you invest a significant amount of time and where victory means something in terms of unlockables and ranking. Further, a poor teammate not only fails to help you win but can actually aid your enemies. The game creates an environment that's just asking for abusive behavior from stressed out, frustrated players.

      It's entirely possible that this stress will come out from players in real life as well as in the game, but I don't think it's safe to jump to any conclusions about whether it will happen more if they're allowed to vent more in game. What you could do if you wanted to address that is give them a little cool down period after a match... Meh. Or just get them to play a different game.

    2. Re:The Toffee Approach by blue+trane · · Score: 1

      "The opposite is true. Because the natural abuser is inclined to fight through any system thrown at them, throttling and other attempts drain their energy more than simply letting them post would, leading to more relaxed (or at least less) behavior offline.

      Not to mention, we all know that trolls online are probably losers who would never in a billion years have the nerve to say or do anything offensive offline..."

      Yeah, but I have personal experience with censorship leading to depression. After being banned from some chatroom or forum, I feel something has been taken away, not because of any scarcity of resources (though that is often presented as an excuse), but rather because some self-styled memetic power brokers decided to come down hard on some types of speech they had a personal problem with.

      I felt less depressed, when I could vent online about what was making me depressed.

  9. World of Tanks by ihtoit · · Score: 1

    Turning ingame chat OFF does a lot of favours for the game - I don't even see what other players are typing while I'm shooting the snot out of them from clear across the map.

    --
    Political debates have me rolling my eyes so much I think I got optical whiplash. I should sue. - Foamy The Squirrel
  10. Re:So it just comes out in other ways. by BadPirate · · Score: 2

    Instead, this psychology of banning and throttling likely leads to more offline abusive real-life suffering.

    Factless speculation.

    Actually, when people behave better online, and are surrounded by people behaving better online, the net result is better real life behavior.

    See I can do it too.

    --
    - Holy crap, I've got MOD points! Who thought that was a good idea.
  11. The research could help there by SuperKendall · · Score: 1

    Perhaps the research could help over time those distinctions exist and pair like-minded people together.

    I thought most modern games already had systems to at least try and match players with similar skill levels.

    --
    "There is more worth loving than we have strength to love." - Brian Jay Stanley
  12. Re:So it just comes out in other ways. by The+MAZZTer · · Score: 2

    ... Because then people would stop playing their game and start playing one made by devs who cared?

  13. Oh man, I'd hate to see how your kids turn out. by Sowelu · · Score: 3, Interesting

    ...addressing the common theme in the above comments collectively. Trying to make people act less anti-social, in a privately run setting, is horrible censorship and a terrible evil? Trying to get people to act civilly is more unethical than telling people to kill themselves? Are you serious? I hope you don't take that approach raising kids, or managing workers. Jesus Christ.

    1. Re:Oh man, I'd hate to see how your kids turn out. by blue+trane · · Score: 1

      It's the forcing that's the issue for me. Try with words, not bans or throttling. Or if your words aren't good enough, just /ignore them.

      The implications of this story go beyond the mechanics of the particular game involved. It's branded as a psychological study; you don't think people will try to use the conclusions in other social media settings?

    2. Re:Oh man, I'd hate to see how your kids turn out. by del_diablo · · Score: 1

      I see where its going. If you make the assumption that players who just sit around and shout "puta puta puta" at their teammates the entire game, and they can't be corrected. They don't understand what they are doing, or so the assumption goes.
      The big question is basically: How many of these people understand they are toxic, and how many can improve themselves? I see why they call it a study in psychology, since the subject here is interisting.
      If its valid for a study is a entirely different issue, since is metric into metrics into metrics.

    3. Re:Oh man, I'd hate to see how your kids turn out. by Salgat · · Score: 1

      It's the same reason why the guy yelling "I WILL F*** YOUR MOTHER" at Disney World will get kicked out. Riot depends partly on the gameplay experience, including social interaction, for player retention. They are a business and have every right and every reason to push for a more friendly atmosphere that will make for a more enjoyable (and profitable) gameplay experience for their users. I don't want to have to /ignore people in the first place, and am really glad Riot is doing this as a means to reduce this kind of behavior around myself, my wife, and anyone else who plays this game (including many children).

  14. Re:Censorship is the only toxic behavior here. by blue+trane · · Score: 1

    Back in the good ol' days on freenode, there was a #politics which had a no kick/ban policy, and a ##politics which was like every other irc channel, with active mods. Guess which was more popular? The little girls who run freenode became so jealous of the fun we had in #politics that they had to shut it down.

    I loved the freedom of the old #politics, under aksis who set up the no kick/ban policy. I would argue with the bigots and racists and other trolls. I could make them shut up or leave, just with words, maybe half the time?

    The way to deal with toxic memes is to come up with better memes to fight them. Censorship leads to supertoxicity, which comes out in other ways (real-life violence, other forums).

    Besides, technology provides the solution to this particular social problem: /ignore. Filter speech at your client; don't restrain free speech.

  15. LoL game mechanics cause the toxicity by Glucose98 · · Score: 1

    I really think the toxic community is produced by the game mechanics. The whole notion of a hero that can 'carry' the team coupled with the fact that a player death feeds the strength of said hero makes dying really problematic. The carry hero is going to grow too strong to defeat after a few kills thus making the game bitter for the losing side. As a result, its your own teammates that berate and thrash you, not the opposing team. I do feel like Blizzard's latest rendition of this MOBA model (Heroes of the Storm) has took a step in the right direction to prevent the toxicity by changing the penalty of death and dramatically reducing the strength of a 'carry hero',

  16. Re:So it just comes out in other ways. by blue+trane · · Score: 1

    So do a real psychological study, not like this one which doesn't examine the potential ramifications of banning and throttling.

  17. Re:So it just comes out in other ways. by Skidborg · · Score: 1

    Because that creates more work for the client, which isn't actually something most clients want? If it's a political control thing it's completely redundant. There is never anything of intellectual value discussed in a LoL match.

    --
    Supporter of the +1 Over Dramatic mod option. In memory of apk.
  18. Re:All the efforts to correct virtual "abuse" by Skidborg · · Score: 1

    Actually, yes, it does. Along with paying that money they also sign an agreement to abide by Riot's terms of service. If they violate those terms, Riot Games is fully justified in terminating their service entirely.

    --
    Supporter of the +1 Over Dramatic mod option. In memory of apk.
  19. Re:Censorship is the only toxic behavior here. by Skidborg · · Score: 1

    That's kinda what's being done here. By limiting the amount that toxic players can say, the proportion of good messages is increased, increasing the 'normality' of the chat in general.

    --
    Supporter of the +1 Over Dramatic mod option. In memory of apk.
  20. Re:So it just comes out in other ways. by blue+trane · · Score: 1

    What if they were having fun trolling online, and the only harm done was a few thin-skinned squares had to type /ignore? What if they could vent against bullying without any consequences, like being called "toxic"?

  21. The game mechanics depend on the worst players by UpnAtom · · Score: 1

    The more one of your players dies, the stronger the other team gets. It often literally is that player's fault you lose.

    I'm trying to get S2 to reduce that effect because it heavily limits the effect of your own play -- making it approach a game of chance, rather than skill.

  22. Re:Censorship is the only toxic behavior here. by del_diablo · · Score: 2

    There is a large medium difference, and if you don't get that, the discussion can not be had.
    League isn't a hangout place, its a entertainment medium. You go there to do something, and interaction is a secondary concern.
    You describe #politics as a place where you go for the sake of interaction, where the contrast with ##politics also makes it seem that the latter is filled with butthurt banhammers.

  23. Re: All the efforts to correct virtual "abuse" by geminidomino · · Score: 1

    s/bigot/murderer/

    You're an idiot who can't differentiate between "existence" and "action," and it's because of simpletons like you that the SJWs you hate so much are able to continue to spread their hate, hypocrisy, and propaganda and keep their credibility among the other idiots, who parrot their own bullshit memes right back in and endless cycle of reality-defying masturbation.

  24. Re: Censorship is the only toxic behavior here. by Skidborg · · Score: 1

    By 'here' I mean in League of Legends, as described by the article.

    --
    Supporter of the +1 Over Dramatic mod option. In memory of apk.
  25. Perfect Result by SuperKendall · · Score: 1

    Sounds like the system worked perfectly then. Others were not affected by your miasma, and depression would naturally lead you to interact less with others.

    Your mental health is nothing compared to the tens or thousands of mental states you negatively impacted.

    --
    "There is more worth loving than we have strength to love." - Brian Jay Stanley