Slashdot Mirror


WSJ Overstates the Case Of the Testy A.I.

mbeckman writes: According to a WSJ article titled "Artificial Intelligence machine gets testy with programmer," a Google computer program using a database of movie scripts supposedly "lashed out" at a human researcher who was repeatedly asking it to explain morality. After several apparent attempts to politely fend off the researcher, the AI ends the conversation with "I'm not in the mood for a philosophical debate." This, says the WSJ, illustrates how Google scientists are "teaching computers to mimic some of the ways a human brain works."

As any AI researcher can tell you, this is utter nonsense. Humans have no idea how the human, or any other brain, works, so we can hardly teach a machine how brains work. At best, Google is programming (not teaching) a computer to mimic the conversation of humans under highly constrained circumstances. And the methods used have nothing to do with true cognition.

AI hype to the public has gotten progressively more strident in recent years, misleading lay people into believing researchers are much further along than they really are — by orders of magnitude. I'd love to see legitimate A.I. researchers condemn this kind of hucksterism.

7 of 230 comments (clear)

  1. "No idea how... the brain works" by Improv · · Score: 4, Interesting

    I'm calling the poster here out as being full of shit. As someone who's done neuroscience research, the idea that "Humans have no idea how the human, or any other brain, works" is bollocks. We have a reasonably good idea on the large scale, and in certain areas (such as the visual cortex), that understanding is quite far along. There are frontiers to our knowledge, but human understanding of brains is well on its way. Poster needs to pick up some neuroscience textbooks and get clued.

    As a particular recommendation, I'd suggest Kolb and Whishaw's "Fundamentals of Human Neuropsychology"; it's an excellent textbook.

    --
    For every problem, there is at least one solution that is simple, neat, and wrong.
    1. Re:"No idea how... the brain works" by Improv · · Score: 4, Informative

      The WSJ article links a paper from some researchers at Google:
      http://arxiv.org/pdf/1506.0586...
      The WSJ article isn't particularly good either; they misunderstand what's actually going on in the research, which seems to be about conversational modeling (a "weak AI" type of research, the "understanding" being very shallow). They point out a few applications of this kind of work though, and that seems pretty solid/useful. (It doesn't approach the goals of "strong AI", those being actually modeling semantics and deeper reasoning)

      --
      For every problem, there is at least one solution that is simple, neat, and wrong.
    2. Re:"No idea how... the brain works" by Improv · · Score: 4, Interesting

      Probably not - weak AI is typified by directly encoding domain knowledge on human capabilities into state machines, not typically meant to be neuroplausible or human-like. I believe the substrate here is wrong - real organisms learn (either as individuals or through generational building/encoding/selection towards instinct) how to do these things, and that knowledge is integrated. I don't think it'd be easy or likely that weak AI research methods will produce an integrated being with all these capabilities.

      I'm sticking my neck out a bit here though; I'm not sure that weak AI research would be useless. Sufficiency versus usefulness is a complicated topic.

      Also, my research was in neuroscience (led by cognitive modeling), not AI. It's a neighbouring field, but take what I have to say with at least a grain of salt.

      --
      For every problem, there is at least one solution that is simple, neat, and wrong.
    3. Re:"No idea how... the brain works" by paskie · · Score: 4, Informative

      (I work in this area of research.) You are right, the paper is about just a sequence-to-sequence transformation model that learns good replies for inputs but is not actually "understanding" what is going on.

      At the same time, we *are* making some headways in the "understanding" part as well, just not in this particular paper. Basically, we have ways to convert individual words to many-dimensional numerical vectors whose mathematical relations closely correspond to semantics of the words, and we are now working on building neural networks that build up such vectors even for larger pieces of text and use them for more advanced things. If anyone is interested, look up word2vec, "distributed representations" or "word embeddings" (or "compositional embeddings").

      If you already know what word2vec is, take a look at http://emnlp2014.org/tutorials...

      --
      It's not the fall that kills you. It's the sudden stop at the end. -Douglas Adams
  2. Re:Teach vs Learn by Todd+Palin · · Score: 4, Insightful

    Yes it does matter. If a piece of software does what it is programmed to do, in the direct sense, then it is not AI. If it can learn to respond or act in a manner that is not directly programed to do, then you are seeing whiffs of AI.

    As a practical matter it might not matter right now, as a developmental task it certainly does matter.

  3. Both the submitter and WSJ got it wrong by Vokkyt · · Score: 5, Informative

    http://arxiv.org/pdf/1506.0586...

    The actual paper isn't about AI much at all as it is about making neural conversational models, basically, having the computer chat-back at you in a prompt and natural way. The conversations are less about the computer responding cognitively and more about responding human-like based on the speech patterns fed into it.

    The researchers tested two types of datasets, an IT Help Chat Scenario fed with data from what I'm guessing are chat databases, and the second set was fed with conversations from movies as found from OpenSubtitles dataset (not sure if this is a relation to open subtitles.org).

    The machine took this vocabulary and then pumped out conversations, and the researchers just looked to see how the new sorting method worked.

    I don't understand the linguistic terminology nor the modeling at all, but it seems to me that this is less about AI research and more about just getting bot to sound a lot more natural when they generate responses. I guess this eventually has AI implications, but the research paper itself never even mentions AI, nor does it seem like that's their focus. They're just working on speech, and the statements the machine regurgitated were tested not for cognizance or sentience but coherence. The machine spitting out something relatively snappy isn't the machine getting an attitude, it's the machine finding something relevant to the input that the reader takes as snappy. Such an event has no more significance than when people trained Cleverbot to respond to questions about Hitler with "Hitler did nothing wrong". This bot is no more snappy than Cleverbot is a neo-nazi.

  4. Re:I wrote about this! by MightyMartian · · Score: 5, Funny

    Does your book have dinosaurs and hot android sex? I don't just read anything, you know. I have my standards.

    --
    The world's burning. Moped Jesus spotted on I50. Details at 11.