Google Releases an AI Tool For Publishers To Spot and Weed Out Toxic Comments (bbc.com)

Google today launched a new technology to help news organizations and online platforms identify and swiftly remove abusive comments on their websites. The technology, called Perspective, will review comments and score them based on how similar they are to comments people said were "toxic" or likely to make them leave a conversation. From a report on BBC: The search giant has developed something called Perspective, which it describes as a technology that uses machine learning to identify problematic comments. The software has been developed by Jigsaw, a division of Google with a mission to tackle online security dangers such as extremism and cyberbullying. The system learns by seeing how thousands of online conversations have been moderated and then scores new comments by assessing how "toxic" they are and whether similar language had led other people to leave conversations. What it's doing is trying to improve the quality of debate and make sure people aren't put off from joining in.

Comments

Good news!

[Anonymous Coward]

So all those posts from SJWs can easily be removed. I'm a fan of this.

"Toxic" comments huh?

[Mashiki]

Well, let's all bow down the moral arbiters of justice then. I'm sure that they'll be right on top of removing speech they disagree with. Then moving onto the useful idiots that cheered this on in the first place.

If you're willing to remove some speech because it makes you upset, there's nothing stopping others from doing the same to you later.

Re:"Toxic" comments huh?

[Mashiki]

Yeah here's the problem. Let's look at a site like neogaf, ever wonder why at one time it was the place to go and developers would post there and people would leak information. And now developers don't? Active participation is down? It was the moderation as you pointed out, but let's look at their definition of a troll, which basically boils down to "anyone who doesn't subscribe to the narrative." Let's look now, at what will get you banned. Have a contrary view of feminism? Banned. Support some ideas of a MRA? Banned. Have differing view points on global warming? Banned. Prefer the xbox vs playstation? Likely banned. Don't like your vidya characters to look like they were hit with a bat? Banned.

The problem is in many cases, moderators especially in this day and age use that as a form of power projection. A good example of this is /r/politics or /r/canadapolitics where you have moderators who ban people for pointing out factual information because it goes against the prevailing group think. Have a nice article about how forums become infiltrated by people pushing authoritarian viewpoints.

I ran a BBS in my teens, and it got large enough that I was considering applying for a regional fido:net hub. At nearly 700 people and 4 nodes, I picked moderators for my forums who weren't assholes, who usually worked, and if they stepped over the line they were given one warning then booted. As sysop, I expected my mods to be impartial. And if a friend was involved to pass the issue to another mod to deal with. I ran on Renegade.