Slashdot Mirror


Google Releases an AI Tool For Publishers To Spot and Weed Out Toxic Comments (bbc.com)

Google today launched a new technology to help news organizations and online platforms identify and swiftly remove abusive comments on their websites. The technology, called Perspective, will review comments and score them based on how similar they are to comments people said were "toxic" or likely to make them leave a conversation. From a report on BBC: The search giant has developed something called Perspective, which it describes as a technology that uses machine learning to identify problematic comments. The software has been developed by Jigsaw, a division of Google with a mission to tackle online security dangers such as extremism and cyberbullying. The system learns by seeing how thousands of online conversations have been moderated and then scores new comments by assessing how "toxic" they are and whether similar language had led other people to leave conversations. What it's doing is trying to improve the quality of debate and make sure people aren't put off from joining in.

4 of 195 comments (clear)

  1. The sign of our times: Censorship-Supression City by adosch · · Score: 4, Interesting

    I can't speak for everyone else, but all this AI, machine learning, heavy algorithm, neural network, data mining that's been going on for well over a decade now and has become almost normal in terms of tech news conversation is really scary as hell.

    For starters, the claim to the quote/unquote "internet" and plaguing social media is it's given absolutely everyone a platform to opinion-ate, alienate, berate, tolerate and flat out hate anyone, any topic, any agenda, any other opinion, idea, thought, preference, look, feel, ect. Let's face it: all that in itself alone as opened pandora's box to a metric shit-ton of people who flat out should not be sharing anything that bubbles in their skull. So now we all sit here with big thumb-tapping or keyboard-clacking loud mouths who can't act appropriately in a digital world.

    But I have to say, when the hell did everyone become a bunch of sensitive sally's in terms of taking everything at face value, and buying into some internet handles drivel (or lack there of), hate speech. Look at slashdot and the anonymous coward approach? Hell at least we provide anonymity and low rank to toxic troll garbage here.

    All that aside, we don't 'remove' it, cover it up and scrub it away because everyone likes to wave the I-am-offended-all-the-time flag. It becomes part of the culture, ambiance (if you laugh it it, I guess) and overall conversation. We don't un-ring bells, do we? I don't see how that's any different digitally.

  2. How this will kill Truth. by geekmux · · Score: 3, Interesting

    If you have a troll problem, then moderate properly by banning. Censorship is not the answer because truth will ultimately suffer.

    The definition of toxic will never be a constant, and I can already seen forums looking for revenue streams to favor those paying for certain "filters".

  3. Re:"Toxic" comments huh? by johanw · · Score: 3, Interesting

    Posts are not removed, only given score. I can even conveniently select I want to see all posts, even those who are modded down. Having this treshold set to -1 shows my "trust" in the moderation process.

  4. Re:Of course by meta-monkey · · Score: 4, Interesting

    It's not some government control, and it's not something you can't already do on your own.

    The issue of "government control" is moot when the companies that control the government also own the social media platforms. See my .sig.

    --
    We don't have a state-run media we have a media-run state.