Slashdot Mirror


Can a Robot Learn a Language the Way a Child Does? (zdnet.com)

MIT researchers have devised a way to train semantic parsers by mimicking the way a child learns language. "The system observes captioned videos and associates the words with recorded actions and objects," ZDNet reports, citing the paper presented this week. "It could make it easier to train parsers, and it could potentially improve human interactions with robots." From the report: To train their parser, the researchers combined a semantic parser with a computer vision component trained in object, human and activity recognition in video. Next, they compiled a dataset of about 400 videos depicting people carrying out actions such as picking up an object or walking toward an object. Participants on the crowdsourcing platform Mechanical Turk to wrote 1,200 captions for those videos, 840 of which were set aside for training and tuning. The rest were used for testing. By associating the words with the actions and objects in a video, the parser learns how sentences are structured. With that training, it can accurately predict the meaning of a sentence without a video.

10 of 86 comments (clear)

  1. BS by 110010001000 · · Score: 4, Insightful

    MIT has been claiming this type of BS for decades. They haven't done anything. Literally they have been talking about this since the 1970s. Think about it: if it worked it would have been incorporated into something like Siri and be worth billions. But Siri is pathetic.

    1. Re: BS by Zero__Kelvin · · Score: 2

      I love how you list a number of things that naysayers have traditionally cited as pipe dreams that are now either realized or on the verge of being realized to try to make a case for something you don't understand in the least being impossible. Seriously ... Give it up. "There will never be computers in most homes! It's impossible and the idea is absurd!" - virtually everyone I told that this would happen circa 1982

      --
      Guns don't kill people; Physics kills people! - John Lithgow as Dick Solomon on Third Rock From The Sun
  2. Re:No by hey! · · Score: 4, Insightful

    What if we rephrased the question, e.g., "What would an AI need to be able to acquire grammar and semantics by being trained on natural language sentences (the way human children are)?"

    Those of us who have a mechanistic position on consciousness and intelligence see no theoretical obstacle to building a machine that does anything or indeed everything humans do. But many of us are dubious that AI will ever achieve true parity with the full range of human abilities. My doubts are economic in nature. I doubt that any such generalist AI will ever be the cheapest way to get whatever it is we want out of a machine.

    Take the "AI" that's hot in the market now. It's not an AI like the robots in Asimov's storeis -- a mechanistic simulation of what people can do. The machine learning stuff being flogged by companies today is just a way of replacing people on certain tasks with something that is cheaper and in some case more consistent, albeit less versatile.

    There's one exception to the rule that a generalist AI isn't really what we want, and that's if we want to prove a non-material soul is unnecessary for explaining anything about humanity. And I doubt anyone really cares enough about such a demonstration to pay what it would take to do it convincingly.

    --
    Post may contain irony: discontinue use if experiencing mood swings, nausea or elevated blood pressure.
  3. Re:No by ShanghaiBill · · Score: 2, Interesting

    Chomsky famously called it a "black box inside their heads."

    Noam Chomsky was being a bit modest. He did more than anyone to figure out what is going on inside that black box, and what innate language learning ability children are born with, which is far more than the "tabla rasa" theory pushed by behaviorists. Chomsky learned that all human languages, even those invented by isolated groups of children, have nouns, verbs, adjectives, and adverbs. All of them have words for discussing hypotheticals, and situations separated in both time and place from the here-and-now.

    Chomsky wasn't right about everything. He believed that all human languages were based on recursive grammars, and for decades this was thought to be correct. But recently it was reported that the Pirahã language does not allow recursive phrases.

  4. Re: No by phantomfive · · Score: 2

    Chomsky wasn't wrong, the reports of lack of recursion were wrong. (Even if the reports were correct, it doesn't mean Chomsky was wrong, he merely said humans are capable of recursion, not that they use it all the time or need to use it)

    --
    "First they came for the slanderers and i said nothing."
  5. Re:I think we might have a problem here... by gweihir · · Score: 2

    "AI" has failed to deliver on grande promises for half a century now. Nobody of those deciding about money seems to notice, so yes, they will be fine. The failure will continue though for a long, long time and maybe forever.

    What has delivered a lot of results is classical, dumb automation. Calling it "AI" is just a marketing lie that seems to work well though.

    --
    Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
  6. Re:I think we might have a problem here... by religionofpeas · · Score: 4, Insightful

    It's good that we understand how humans acquire natural language well enough that 'just make the computer do it that way' is a plan.

    We don't understand how humans acquire knowledge of Go, yet people made a computer that started from nothing and learned it simply by playing itself and discovering all the knowledge.

    The same method has been used in many different machine learning applications, and it seems to work pretty well, regularly scoring much better results than a human.

  7. Re: AIs are trained on grammatical sentences by Zero__Kelvin · · Score: 2

    We are machines and we can "do understanding" so clearly your claim that machines can't "do understanding" is proved already to be false. People said that everything we are doing today with technology could never be done. Claiming something can never be done is a claim that is as easily made as it is foolish to assert.

    --
    Guns don't kill people; Physics kills people! - John Lithgow as Dick Solomon on Third Rock From The Sun
  8. Re:I think we might have a problem here... by 110010001000 · · Score: 2

    That is baloney. The Go/Chess/whatever playing computers didn't "start from nothing". They were PROGRAMMED to understand the game. The rest is marketing BS. They didn't just put the computer down and show it a bunch of Go games and it suddenly understood what Go was. Ridiculous. Computers are good at games with strict rules. We all know that. That is what computers are BEST at. You guys are just easily impressed and don't really understand technology.

  9. Re:AIs are trained on grammatical sentences by religionofpeas · · Score: 2

    Translation from one human language to another is a different problem than understanding the semantics of natural language.

    I would agree for a crude translation. However, as you want to approach 100% accuracy in translation, understanding of language becomes essential. Look at how Google translates jokes or song lyrics.