Slashdot Mirror


New Contestants On the Turing Test

vitamine73 writes "At 9 a.m. next Sunday, six computer programs — 'artificial conversational entities' — will answer questions posed by human volunteers at the University of Reading in a bid to become the first recognized 'thinking' machine. If any program succeeds, it is likely to be hailed as the most significant breakthrough in artificial intelligence since the IBM supercomputer Deep Blue beat world chess champion Garry Kasparov in 1997. It could also raise profound questions about whether a computer has the potential to be 'conscious' — and if humans should have the 'right' to switch it off."

21 of 630 comments (clear)

  1. Reach for the switch... by Kid+Zero · · Score: 5, Insightful

    and see if it complains, first. If it does, then call me back.

    1. Re:Reach for the switch... by i+kan+reed · · Score: 5, Insightful

      Desire to continue to exist is a result of being alive, and evolution, not intelligence. Hamsters don't want to die, but they aren't especially intelligent, and routinely fail self awareness tests.

      Human qualities!= intelligence.

    2. Re:Reach for the switch... by Ethanol-fueled · · Score: 5, Insightful

      Agreed, the human brain is greater than the sum of its parts. It's easy to show that a robot is equal to a human but it's difficult to believe that a collection of circuits feels the range of emotions and instincts biologically passed down through the ages.

      The author of the book and Piccard both sucessfully argue that Data is equal to a human. The most familiar arguments come from the TNG episode "Measure of a Man" in which Starfleet tries to claim ownership of Data so that they can dismantle him.

    3. Re:Reach for the switch... by haystor · · Score: 5, Insightful

      Data was "alive" because he was defined as such in a work of *fiction*.

      He could have equally been a one eyed one horned flying purple people eater if they decided to spend 5 minutes one episode writing that in. It would have fit in as well as any other "plot" in Star Trek.

      All that Star Trek shows is that man can conceive of a machine that could be alive. It is a statement about man (the author) not any machine.

      --
      t
    4. Re:Reach for the switch... by lysergic.acid · · Score: 5, Insightful

      you're making groundless assumptions here. complex phenomena can often emerge from fairly simple systems. this can be seen in nature as well as in mathematics and AI. for instance, ant colonies demonstrate very complex group behaviors but each ant is simply following a very small set of hard coded behaviors, and on its own is quite stupid.

      your matter of fact attitude can just as easily be applied in reverse by a cybernetic being--it's difficult to believe that a collection of cells has the cognitive capabilities of an advanced AI algorithm running on a supercomputer with complex circuitry and powerful microprocessors.

      don't delude yourself. what you experience as "consciousness" is merely the unintended side-effect from the flux of chemical causality occurring in your brain. and all complex organisms are merely cooperative colonies of specialized cells, which by themselves are no more complex in structure, and no more intelligent or self-aware, than primitive unicellular organisms.

      AI researchers have an advantage over unguided biological evolution--they don't need to rely on blind trial-and-error, as they are intelligence. we can also analyze existing natural models, such as animal brains, and even human brains. there's no reason why an artificial/digital neural net can't be designed to produce true artificial intelligence. it may not be accomplished in this century, but there's no physical or metaphysical reason why it cannot be done.

    5. Re:Reach for the switch... by Joe+Tie. · · Score: 4, Insightful

      I think it's a pretty safe assumption to rule out magic when talking about the real world.

      --
      Everything will be taken away from you.
    6. Re:Reach for the switch... by Pervaricator+General · · Score: 3, Insightful

      your just jealous at our futuristic grammar

  2. Well... by Quiet_Desperation · · Score: 4, Insightful

    Are they really *thinking* or have the programmers just done some tricks to make it seem that way.

    "Teaching to the test", so to speak.

    1. Re:Well... by Eustace+Tilley · · Score: 4, Insightful

      Are you really thinking?

      Prove it.

    2. Re:Well... by Brandano · · Score: 5, Insightful

      If a computer could explain it as well as you do, or couldn't explain the things you can't, apart from whether this means the computer is aware or not, does it really matter? If you see something that is so indistinguishable from a human that nobody could tell, does it matter whether it's a real human being or an emulation of one? Your best bet would be to treat it as a human, he could well be.

    3. Re:Well... by Saxerman · · Score: 4, Insightful

      The Turing Test is way past it's prime by this point. The original thought of experiment of how to tell if a machine can think has merely become a test to see if a program can fool a human. Mostly it's building up a simplistic way to parse responses to match your massive yet limited supply of answers. We're certainly getting close to having programs able to pass the Test, and I can't see many who would try and claim any of them actually 'think'.

      That said, it's still an interesting exercise. The raw amount of data that a program requires to mimic the knowledge of a person is an important challenge by itself. And you might be surprised by either how much... or how little it actually requires. Yet there are other bits that are less clever. In order to pass the Test you really want to create a fake persona so the program can share life experiences it's never had, or else cleverly camouflaged 'experiences' that seem human. "Q: Do you enjoy the outdoors at all? A: Not really, I spend a lot of time in the lab." But then you have to place limits on what the program can do, such as not crunching out math problems on the fly. You'd want it to make mistakes, such as typos or forgetting things or only vaguely remembering things. Acting like it needs to take a break, or has been interrupted.

      And then you need to dive into the deeper questions of what it really means to be human, or to be able to think. What would we want an AI to be like? Would we want them to have traits so they seem more human, or would we prefer they be merely efficient thinking machines without our 'limitations'?

      --

      A steaming cup of soykaf would be real wiz right now.

    4. Re:Well... by phantomfive · · Score: 5, Insightful

      Exactly how to treat a computer is a problem of ethics, not AI. Heck, I EAT PIGS, and those guys are pretty intelligent. I feel mildly bad about it, but they taste so good.....

      One of the computers they are using is named 'Ultra Hal.' They even dare to use that name! Hal is a good example: he could talk, reason, teach himself to read lips, TEACH HIMSELF TO LEARN THINGS OUTSIDE OF THE DOMAIN THAT ANYONE HAD IMAGINED FOR HIM, and as mentioned in the movie, no one really understood how he worked exactly, but they understood the general idea to set him up and get him going. If we can do that, then we are close to AI.

      On the other hand, a bunch of souped up Eliza bots aren't anything more than weak AI. A sad shadow of the real Hal.

      --
      Qxe4
  3. I doubt it will raise any questions by heatdeath · · Score: 5, Insightful

    It could also raise profound questions about whether a computer has the potential to be "conscious" -- and if humans should have the 'right' to switch it off."

    Maybe in the esteemed opinion of vitamine73 it will, but if you knew anything about how artificial conversation engines were constructed, you would understand that it's anything but sentient. Right now, conversation logic is simply trick laid upon trick to stagger through passing as a human, and doesn't, at its core, contain anything remotely similar to self-aware thought.

    --
    I'm sorry. The number you have reached is imaginary. Please rotate your phone 90 degrees and try again.
  4. Computer Chess has not been AI for a long time by MasterOfMagic · · Score: 4, Insightful

    It is likely to be hailed as the most significant breakthrough in artificial intelligence since the IBM supercomputer Deep Blue beat world chess champion Garry Kasparov in 1997.

    I don't understand how this is a breakthrough for artificial intelligence. Deep Blue didn't "think", at least not in the way most people think when they consider artificial intelligence. It did what computers are really good at - it computed.

    Deep Blue applied an evaluation mechanism specifically tuned to chess - taking the location of pieces on the board and computing a number telling it how "bad" or "good" this position was and how "bad" or "good" responses to this position would be. Granted, it took this to a depth farther than any other chess computer in history, but it was doing essentially what a small, handheld chess computer does.

    Of course a computer is going to be good at computing. That doesn't mean it's thinking.

    Early chess computers used AI techniques to try and cut out candidate moves. This was expensive in CPU cycles, but the thought was to get them to play chess like humans. Computer chess since AI Winter has been all about number crunching - let Moore's Law take hold and just brute force our way through the problem - evaluate deeper because we have a faster processor. This is what Deep Blue did.

    If Deep Blue were true AI, then it wouldn't be limited just to chess. It's an interesting experiment in computer chess, and an interesting experiment in tuning an algorithm working against a human, and in interesting experiment in making a computer chess opening book, but a huge leap forward in AI it isn't.

  5. Nowhere Close to Passing Yet by ironwill96 · · Score: 4, Insightful

    If you read TFA they have a sample chat which just shows you how stupid these chat bots still are. It is extremely easy to get them to just parrot responses and then try to change the subject in completely random directions.

    I have yet to see any chat bot that can figure out the line of questioning, then pick up and introduce interesting things to the conversation that are corollary to that subject. I think the only way you will get bots that will "pass" this test is to have massive databases of words, relationships between words and subjects with corresponding topics of discussion. Still, the computer won't be intelligent, it will just be reciting from its huge database of responses.

    I think the type of question i'd ask these bots is something that would require them to extemporize and they'd all fail. For example: "You have two rubber ducks, what are the possible ways you could use them if you don't have a bathtub?"

    Any human could reply to that with things like "i'd put them in a stream, run over them with my car, put them on a lake, in the swimming pool" etc but a computer program isn't likely to respond to that in any way that makes sense. The response i'd expect from the computer would be "You like ducks then?".

    --
    "To strive, to seek, to find, and not to yield." - Tennyson
  6. Re:Artificial Intelligence? by phantomfive · · Score: 3, Insightful
    Yes, you are right, there are many great algorithms that have come from AI, but to say "weak AI is here, therefore we don't need strong AI" is kind of sour grapes. Especially when we are talking about something like a Turing test, it is a very hollow victory to say you've won when really all you've managed to do is trick a few candidates.

    As far as it goes, there are probably a dozen good questions to figure out if it is a computer or human:
    • Why did the chicken cross the road? Look for the feeling of humor in the response, they will probably think it's funny.
    • Have you ever had your heart broken? This is something you can't lie about: if you haven't had a broken heart, and you pretend you have, it will be easy for listeners to know.
    • What does it feel like to hold your breath under water? Simple experience, but will be hard for any knowledge bank to answer.

    Any of these questions might possibly be answered by copying someone's answer from the internet, but if you ask a few of them, pretty soon you will realize this guy is either schizophrenic, or a computer.

    So yeah, this might trick a few people, or even a lot, but it's not going to really make old man Turing feel good about it. Unless they actually have solved it.

    --
    Qxe4
  7. Re:AI? Pffft by ceoyoyo · · Score: 4, Insightful

    Can you create a symphony? Oops, did you just fail your own definition of sentience?

  8. Re:If it's really thinking.. by ceoyoyo · · Score: 3, Insightful

    If a computer program couldn't read a sentence like that you'd just have gotten yourself hired by Google to write their next captcha. Any job offers appear in your inbox this morning?

  9. Re:AI? Pffft by gregbot9000 · · Score: 4, Insightful

    the problem is how long you talk to it. If you talk to it daily it would need to learn and expand for you not to reach the end of its tricks. I think that is where the quality of the turing test comes in. It would have to be capable of self expansion and learning in order to make you think it is capable of the learning and self expansion of a human.

    I'm sure these bots could fool you for an hour in a select setting, but if you were to talk to them on AIM every night for 6 months on a variety of subjects from opinions to jokes, to hopes and dreams, they would need to be practically human to not fail.
    Sure you can argue that it would just be an awesome ball of clever tricks, like auto-reading news feeds and analyzing stories for conversation currency. The thing about clever tricks is that a lot of what the human brain does in the separate lobes are just clever tricks, it's when you combine these all together and they start working with each other that you get something amazing.

  10. Remember, kids... by Locke2005 · · Score: 3, Insightful

    Really useful artificial intelligence is currently just 10 years away... just as it has been for the last 40 years!

    --
    I've abandoned my search for truth; now I'm just looking for some useful delusions.
  11. Re:For as long as I'm paying for the electricity.. by Cajun+Hell · · Score: 3, Insightful

    If you're paying for the electricity on a human's life-support equipment, you have the right to turn it off, too. But beware that someone might charge you with murder. I'm not quite sure how other people's situations turn into obligations on our parts, but there are a lot of people that do think it happens.

    --
    "Believe me!" -- Donald Trump