Slashdot Mirror


Facebook's 'Rosetta' System Helps the Company Understand Text Within Image, Which is Crucial In Handling Memes, Flagging Abusing Content (techcrunch.com)

Facebook announced on Tuesday a new AI system, codenamed "Rosetta," which helps teams at the company as well as those at Instagram identify text within images to better understand what their subject is and more easily classify them for search or to flag abusive content. From a report: It's not all memes; the tool scans over a billion images and video frames daily across multiple languages in real time, according to a company blog post. Rosetta makes use of recent advances in optical character recognition (OCR) to first scan an image and detect text that is present, at which point the characters are placed inside a bounding box that is then analyzed by convolutional neural nets that try to recognize the characters and determine what's being communicated. This technology has been in practice for a while -- Facebook has been working with OCR since 2015 -- but implementing this across the company's vast networks provides a crazy degree of scale that motivated the company to develop some new strategies around character detection and recognition.

3 of 45 comments (clear)

  1. crucial at suppressing speech by Anonymous Coward · · Score: 3, Interesting

    It will be used to suppress speech.

  2. LOL. Just license the Battlefield V chatbot by elrous0 · · Score: 1, Interesting

    You know, the one that labeled "white man" as hate speech.

    https://www.forbes.com/sites/e...

    --
    SJW: Someone who has run out of real oppression, and has to fake it.
  3. Re:Abusive Content? by Anonymous Coward · · Score: 2, Interesting

    Think back to the very worst moment of your life.

    Now imagine that somebody recorded a video of it and posted it to Facebook.

    To me, that video is "simple information".
    To you, the video is not just "simple information".

    Should the video be taken down?
    Let's consult the Platinum Rule: Treat others the way they want to be treated
    My answer is your answer to the question: Do you want the video of the worst moment of your life taken down?