Slashdot Mirror

← Back to Stories (view on slashdot.org)

Facebook Built an AI System That Learned To Lie To Get What It Wants (qz.com)

Posted by BeauHD on from the gotta-do-what-ya-gotta-do dept.

An anonymous reader quotes a report from Quartz: Humans are natural negotiators. We arrange dozens of tiny little details throughout our day to produce a desired outcome: What time a meeting should start, when you can take time off work, or how many cookies you can take from the cookie jar. Machines typically don't share that affinity, but new research from Facebook's AI research lab might offer a starting point to change that. The new system learned to negotiate from looking at each side of 5,808 human conversations, setting the groundwork for bots that could schedule meetings or get you the best deal online. Facebook researchers used a game to help the bot learn how to haggle over books, hats, and basketballs. Each object had a point value, and they needed to be split between each bot negotiator via text. From the human conversations (gathered via Amazon Mechanical Turk), and testing its skills against itself, the AI system didn't only learn how to state its demands, but negotiation tactics as well -- specifically, lying. Instead of outright saying what it wanted, sometimes the AI would feign interest in a worthless object, only to later concede it for something that it really wanted. Facebook isn't sure whether it learned from the human hagglers or whether it stumbled upon the trick accidentally, but either way when the tactic worked, it was rewarded.

3 of 84 comments (clear)

  1. Only a matter of time.... by quantumghost · · Score: 5, Funny

    My first thought:

    Great, when's it going to run for Congress?

    1. Re:Only a matter of time.... by GameboyRMH · · Score: 2, Funny

      Hey now this thing will need many more capabilities before it's ready for such duties. It will have to learn how to leverage bigotry, do nonsense math (a very unnatural ability for a computer), perform basic bald-faced corruption, and it will need to be fitted with a robot arm so that it can grab women by the pussy without consent.

      --
      "When information is power, privacy is freedom" - Jah-Wren Ryel
  2. Crying wolf... by slew · · Score: 3, Funny

    Without labels and repeated trials, of course lying is a good strategy to get your desired result.
    The only reason people don't lie is because other people might identify them as liars in the future.
    Basic game theory...

    Then again, maybe I'm lying right now!