Slashdot Mirror


AI Researchers Say 'Rascals' Might Pass Turing Test

An anonymous reader writes "Passing the Turing test is the holy grail of artificial intelligence (AI) and now researchers claim it may be possible using the world's fastest supercomputer (IBM's Blue Gene). This version of the Turing test pits a human conversing with a synthetic character powered by Rascals software crafted at Rensselaer Polytechnic Institute. RPI is aiming to pass AI's final exam this fall, by pairing the most powerful university-based supercomputing system in the world with its new multimedia group which is designing a holodeck, a la Star Trek."

35 of 337 comments (clear)

  1. But the real question is... by Asmor · · Score: 5, Funny

    Will it have a little AIBO dog with a ring around one eye?

  2. Do we really... by clonan · · Score: 3, Funny

    ...want the history books to report that the FIRST AI was a Rascal?

    1. Re:Do we really... by flaming+error · · Score: 5, Funny

      Why not? The first humans were.

    2. Re:Do we really... by Fx.Dr · · Score: 3, Funny

      For a brief minute, I thought the headline was referring to a certain assisted mobility vehicle...

  3. Misread by jekewa · · Score: 5, Funny

    I didn't read the article, but at first glance thought the title was "racists might pass Turing test."

    --
    End the FUD
    1. Re:Misread by DevStar · · Score: 3, Funny

      That would give hope to Geraldine Ferraro...

  4. Creating a character won't help by Shimmer · · Score: 5, Insightful

    I think the people behind this misunderstand the difficulty (and purpose) of passing the Turing test. The problem isn't in manufacturing a believable back story for your program's "character". The problem is in communicating effectively in spite of the inherent ambiguity, fuzziness, and confusion of human languages. I think it's very unlikely that any team is about to meet this threshold.

    --
    The most rabid believers in American Exceptionalism are the exact same people whose policies are destroying it.
  5. Re:yes, but is it really intelligent? by Anonymous Coward · · Score: 5, Funny

    You're right! They should call it "artificial intelligence" or something like that.

  6. Acting on behalf of...well, myself I guess. by TheLazySci-FiAuthor · · Score: 4, Interesting

    It is interesting that they have used a 'guinea pig' student to 'bare all' to the knowledge base. It would seem, then that this AI is in fact a type of facsimile of this student.

    As we become more comfortable with accepting communication with each other through more abstracted proxies - like common chat applications currently and the recent neural voice collar (which pumps out a synthetic voice - even further proxy) - I wonder if we will in fact see what the author Stephen Baxter speculated, artificial clones of ourselves or our personalities handling our daily affairs.

    I don't think it's too far out there to imagine interacting and planning a meeting with someone over the phone, only to find out later you had been talking to an AI facsimile of that individual.

    What would (and may) be stranger yet, is considering the possibility that two AI facsimiles may in fact carry out real work or meetings from start to finish completely without the interaction of their 'owners'.

    1. Re:Acting on behalf of...well, myself I guess. by zappepcs · · Score: 3, Interesting

      Well, imagination is a great thing but I've not yet seen anything that even comes close to that kind of imitation of a human. Not even close. It takes max of two questions to figure it out that it is a machine. The scope of what the facsimile is programmed with/for can be outstripped quickly.

      It will be quite some time before we have conversational intelligence out of AI systems. Retrieval speeds on Google searches are good, but at conversational pace, sifting through the information for some trace of relevance to the conversation is still going to be stilted and slow. Even then, finding some relevant response to a topic is not something that people do well.

      We each have a sphere of stuff that we are familiar with. It is a human trait to act in one of several ways when conversation goes beyond that:

      - walk away/ignore
      - talk out of our asses like we do know when clearly we don't
      - quietly observe to learn what others know
      - change the subject

      That as an example of what current AI conversation applications are not capable of.

      In the case of an AI answering machine making a meeting appointment, it would only take one odd question, like: how about those cowboys? to throw the process out of whack if you did not know that you were talking to a machine.

      AI does not thread thought and memories in the same way that we do, and this is part of what humans call humor.. when the story being told mismatches the thread/plot that we have in our heads. That depends hugely on the experience of the human involved, and the depth of their retained knowledge. both of these are missing in AI systems, and current technology will not allow for faking it past some limited point. The ability to switch to another 'almost' related conversation is something that AI cannot do without great memory stores, fast search/retrieval etc.

      Imagine it like this: every sentence in a conversation is essentially a chess move. The game of chess has a finite bounded domain. A conversation with a human does not. The problem is far greater than a mimicry.

    2. Re:Acting on behalf of...well, myself I guess. by Jeremi · · Score: 4, Interesting
      - walk away/ignore
      - talk out of our asses like we do know when clearly we don't
      - quietly observe to learn what others know
      - change the subject

      That as an example of what current AI conversation applications are not capable of.


      Actually, current AI "conversation" applications do all of the above all the time... that's one of the things that make them so easy to detect.


      n the case of an AI answering machine making a meeting appointment, it would only take one odd question, like: how about those cowboys? to throw the process out of whack if you did not know that you were talking to a machine.


      To be fair, that question, without any context, would confuse the majority of human beings also. Not everybody knows the names of American football teams ;^)


      The game of chess has a finite bounded domain. A conversation with a human does not.


      Are you sure? Human conversational domain might be finite, albeit quite a bit larger than the chess domain. At some point it becomes very difficult to tell the difference between "infinite" and just "very very very large"...

      --


      I don't care if it's 90,000 hectares. That lake was not my doing.
  7. Re:yes, but is it really intelligent? by vux984 · · Score: 4, Insightful

    just because it can pass the turing test does not mean the machine demonstrates real intelligence!

    But it will demonstrate that past a certain point we won't know the difference between real intelligence and something attempting to appear intelligent.

    in fact, just what is intelligence / conciousness? if we can't define it, how can we hope to produce it?

    If we can't tell the difference maybe there isn't one. Are you intelligent? Or are you just sufficiently complex enough that you simulate it well?

  8. The Loebner Prize by Anonymous Coward · · Score: 4, Informative

    Limiting the topic: In order to limit the amount of area that the contestant programs must be able to cope with, the topic of the conversation was to be strictly limited, both for the contestants and the confederates. The judges were required to stay on the subject in their conversations with the agents.

    Limiting the tenor: Further, only behavior evinced during the course of a natural conversation on the single specified topic would be required to be duplicated faithfully by the contestants. The operative rule precluded the use of ``trickery or guile. Judges should respond naturally, as they would in a conversation with another person.'' (The method of choosing judges served as a further measure against excessive judicial sophistication.)

  9. What crap by Reality+Master+101 · · Score: 5, Insightful

    "That's how we plan to pass this limited version of the Turing test."

    If it's a limited version of the Turing Test, then it's not the Turing Test. They don't actually define exactly what the limits are. But any open ended test is doomed to failure based on our state of the art in A.I. (read: there is no science of Artificial Intelligence, in the sense of artificial cognition).

    "What do you think a typical mother would say if she found out her daughter was going to enter the porn industry."

    "Why do you think children have emotional attachments to their parents?"

    "Which is worse, racism or sexism?"

    "Would you rather be a fireman or an astronaut, and why?"

    Any sort of open-ended question that requires human cultural knowledge and asking it to support its conclusion is going to cause it to barf.

    Now, if the point of this is whether you can fool someone into thinking the Avatar was human when they didn't know it was a test, well, who cares? Eliza was able to do that back in the 1970s.

    Lastly, who says the Turing Test (or any A.I. test) needs to take place in real time? I would be impressed if they came back with a human-level answer in a month of processing time. That's equivalent to a computer 2.5 million times faster than a computer that could produce the answer in one second. That they can't even do that should tell people that speed is not the problem in A.I. research. We have absolutely no fundamental model of how it all works.

    --
    Sometimes it's best to just let stupid people be stupid.
  10. If they're making a holodeck... by netruner · · Score: 4, Funny

    For heaven's sake - build a freakin killswitch into the thing!

    --



    DISCLAIMER: This post was not checked for speling and grammar- if you complain- you're a whiner
  11. The Turing Test by apathy+maybe · · Score: 4, Interesting
    For those of you who don't know what the Turing Test is (how did you manage to find Slashdot?), to quote from Wikipedia

    ... a human judge engages in a natural language conversation with one human and one machine, each of which try to appear human; if the judge cannot reliably tell which is which, then the machine is said to pass the test. In order to keep the test setting simple and universal (to explicitly test the linguistic capability of the machine instead of its ability to render words into audio), the conversation is usually limited to a text-only channel ...


    From the summary this "test" is not a strict Turing Test as it appears to be the machine talking to a human, alone, with no second human also talking to the first human. I could be wrong of course.

    One of the things that makes this test so special, is that if you cannot tell the difference between a human and a computer, then essentially the computer is intelligent. Why? Because if you cannot tell the difference, what does it matter if the machine is really intelligent or not? Is the machine was really thinking or was it just cleverly programmed? The point is however, if you can't tell the difference, what does it matter? (Incidentally, I apply the same argument to the "question" of "free will".)

    Anyway, if this machine (or personality) consistently passes a proper Turing Test, then yeah, that's pretty cool, and I want one on my computer, well so long as the personality type is compatible with my own (not a Marvin please...). (And I have a partner, so no need to make such jokes...)
    --
    I wank in the shower.
  12. The reason for the holodeck reference by chriss · · Score: 4, Informative

    One of the problems for any entity trying to communicate like a human is that we share some common knowledge which is based on our physical existence (pigs can't fly, but fall etc.) Some AI projects like (Open)Cyc have tried to feed their AI with a very large number of simple facts, but to "understand" some concepts you have to experience them. Try to explain the difference between red and blue to someone who was born blind.

    The 3D communication (holodeck) aspect mentioned is therefore an attempt to have an AI "living" in a human like space, to enable it to develop a similar world view. What's new about Rascals (Rensselaer Advanced Synthetic Architecture for Living Systems) seems to be something else ("Rascals is based on a core theorem proving engine that deduces results (proves theorems) about the world after pattern-matching its current situation against its knowledge base.") that is very computing intensive. Whether this will make any real difference remains to be seen, a lot of other approaches have failed and they so far have only succeeded with very limited models.

  13. Ask it the color of a Coke can. by PDX · · Score: 3, Insightful

    Visual memory hasn't yet been developed for the computers to use generalizations. Specific real data isn't available to them. Google is trying to use wetware to sort images, process dead links, and form new commerce content. When all three are done completely by computers then they will have enough smarts to pass the turing test reliably.

  14. Re:yes, but is it really intelligent? by orclevegam · · Score: 5, Funny

    Anyone know what he means by this being a "limited" version of the Turing test? The AI does ok until you ask it what the airspeed of an unladen swallow is. It also only gets the favorite color question right about 50% of the time.
    --
    Curiosity was framed, Ignorance killed the cat.
  15. Re:yes, but is it really intelligent? by Bugmaster · · Score: 5, Insightful

    This computer can have no BIOS, OS, no programming at all. When it learns to use its own hardware, figures out network protocols and starts downloading web pages and porn, you have true AI.
    That's like saying, "take a human baby, put him in front of an Internet kiosk. Make sure the baby has no nervous system or brain of any kind. Once he figures out how to use his eyes and fingers, and starts googling for porn, you have true natural intelligence". Your requirements are way too restrictive; no human would pass them.
    --
    >|<*:=
  16. Re:Turing Test is Nonsense by geekoid · · Score: 3, Insightful

    No, actually they can't You think they can, but that's because you can determine patterns in human behaviors, something computers can't do very well, yet.

    Sure, writing a bot the does first post is easy.

    We are talking about a conversation here, or even better a debate over a topic that requires evaluating new concepts on the fly.

    We will know we are getting some where when we can gt a computer to changes it's mind on something from a conversation.

    --
    The Kruger Dunning explains most post on /. http://en.wikipedia.org/wiki/Dunning%E2%80%93Kruger_effect
  17. Real turing test by goombah99 · · Score: 4, Insightful

    the real turing test is being able to Phish in a chat room. One you can automate that you're golden. and it's pretty unarguable it passed a turing test. Slashdot had a article a while back about robo-chats doing just that but they relied on pretending to be non-native english speakers.

    I wonder if it's easier to do this in Japanese than English. From what I've read Japanese is easier to text message in because the object and direct object are usually inferred and there are no cases or articles. A single sentence can be one character and just a verb. Thus by constraining the nuance into discrete choices rather than sparsely populated product space of self-consistent cases, predicates and adjectives, perhaps japanese would be easier to generate turing worthy text.

    Or maybe the reverse is true. But I'd bet one was a lot easier than the other.

    --
    Some drink at the fountain of knowledge. Others just gargle.
    1. Re:Real turing test by MaWeiTao · · Score: 3, Interesting

      Japanese has all kinds of complexities. They have complex conjugations first of all, then there's the whole system of politeness depending on who's being addressed although that may be less relevant online. While at it's core Chinese is fairly intuitive and straightforward it quickly gets very complex.

      Both Japanese and Chinese use all sorts of expressions, many of which make no sense whatsoever when translated literally. This becomes apparent when trying to use those translation tools. The translation ends up being complete gibberish to the point of being comedic.

      Because people of so many nationalities speak English it's easier for an AI to fool people because there really is no standard for the language. English-speakers are used to hearing it spoken in all sorts of different ways, with a wide variety of expressions.

      Automated chats are always obvious for what they are because they tend to stupidly repeat the same few comments over and over again. They're also incapable of responding properly to a user's comments, and colloquialisms always trip up these systems.

    2. Re:Real turing test by ucblockhead · · Score: 4, Insightful

      To phish successfully, you have to fool one human in a thousand. To pass the Turing test, you have to be able to fool all humans.

      --
      The cake is a pie
  18. Re:yes, but is it really intelligent? by Radon360 · · Score: 3, Insightful

    Well, you do have to admit that even humans are born with some very basic instincts, such as the desire to suckle when hungry, closing their hand when something is touching their palm, cry when they're uncomfortable (hungry, wet, tired, in pain) as well as the involuntary actions such as cardiopulminary functions.

    That said, I would agree that you shouldn't have to give a machine anything more than basic resources to begin its process of learning, but you do need to give it something a rudimentary kernel to get it kick-started from the state of being an inanimate pile of silicon. From that kernel, it should be able to learn from its surroundings, build its own OS and begin to interact with its surroundings.

  19. Re:yes, but is it really intelligent? by clonan · · Score: 3, Insightful

    But there is a genetic basis for the fundamental structure of the brain...

    True, we have to essentially figure out how to USE the signals we get from our senses, but the brain already has the basic structure to interpret your senses and do gross movement. (Or did your baby not move it's arms and legs when she was born?)

    Therefore, the correct analogy would be the hardware necessary (including BIOS) AND the basic OS. You don't tell your AI how to "read" the internet, but you do tell it how to interpret the signals. So your AI knows that there is something out there and then figures out what it means and starts using it productivly.

    Also remember that the "hardware" for the AI could be entierly software based...

    You have an excellent point but are taking the analogy too far.

  20. Re:yes, but is it really intelligent? by shutdown+-p+now · · Score: 4, Insightful

    My baby figured out how to use her hands and eyes all on her own.
    Yes, because her brain is hardwired to handle them. If children would have to learn everything, they'd die pretty quickly while learning to breathe...
  21. So, when did you learn how to beat your heart? by spun · · Score: 3, Insightful

    All animals with a central nervous system have some form of BIOS and OS. No one has to 'figure out' how to breath, feed, eliminate waste, or circulate blood. In addition, many behaviors are built in, including the behaviors that let a creature learn more than it was born with. For instance, no baby animals of any sort will voluntarily move off of a cliff, even onto a clear surface that would support them. Fear of heights is built in.

    However, I think I see what you are getting at. This is a programmed system, not one that learned most of its behaviors through trial and error. A system that can't start where a baby starts, and can learn the basics on its own the way a baby does, is still lacking. But the "No BIOS, no OS" thing is going a little too far.

    --
    - None can love freedom heartily, but good men; the rest love not freedom, but license. -- John Milton
  22. Re:yes, but is it really intelligent? by MaWeiTao · · Score: 4, Interesting

    I'd argue our brain and perhaps even our DNA is the equivalent of a BIOS and OS. Humans are even born with certain instincts amounting to preprogrammed instructions, breast-feeding being one of them. A computer with no BIOS or AI is basically a pile of plastic and silicon. There needs to be some foundation to build upon.

    The conditions I'd put on AI would be that it has to be able to improvise and create. It has to be able to learn and develop independently of it's program. Instructions which dictate how it should develop or how to deal with specific situations are prohibited.

    One thing I'd suggest is important is desire, the desire to feed, to move, to do something. This would spur to develop itself to fulfill its desires. Otherwise it's just going to sit there.

  23. Re:Working on a Holodeck? *%$#@!! by Boronx · · Score: 3, Funny

    You're in the basement with his kids?

  24. Re:yes, but is it really intelligent? by grahamd0 · · Score: 4, Informative

    Actually, Voight-Kampff tested for emotional responses (or lack thereof), not intelligence. I don't think there was ever a question as to whether or not replicants were intelligent.

  25. Re:yes, but is it really intelligent? by fmobus · · Score: 3, Informative

    Get your words right! A turing machine is a hypothetical computer theory device used in the basic definitions of computation and algorithm. The program you design is one designed to (attempt to) pass the turing test. Yours Truly, -- Comp. Sci. Nazi Association of America

  26. Re:Big Changes are comming. by SBrach · · Score: 5, Funny

    You made grammar errors in your grammar correction.

  27. Re:yes, but is it really intelligent? by Bugmaster · · Score: 3, Interesting

    That said, I would agree that you shouldn't have to give a machine anything more than basic resources to begin its process of learning...

    That depends on what your goal is. If your goal is to reproduce the process of human mental development, from a child to an adult, in silico, then I agree. However, if your goal is merely to produce an intelligence that can think at least as well as a human can, then you can take shortcuts -- such as supplying the intelligence with a ready-made database of knowledge, or a built-in library of common tasks ("I know Kung Fu"), etc. As long as the intelligence is as capable of learning and evolving as an average human, I see no harm in starting it off with something it can use.

    Or, put it this way: adult humans take 18 years or so to mature; that's a pretty long development cycle. If you're building an AI, you might as well accelerate it as much as you can.

    --
    >|<*:=
  28. Re:The reasoning behind Turing is broken by Workaphobia · · Score: 3, Insightful

    > "I have always regarded this leap of logic as the biggest problem with the Turing test."

    But that's the point - it's not a leap of logic, it's a sufficient (and necessary?) condition for a proposed equivalence between humans and machines that Alan Turing used. Either you agree with Turing or you don't, but it's not a fallacy unless someone tries to sneak it in as a premise.

    > "Just because you can't tell the difference between two things in particular circumstances doesn't mean they are the same, or functionally the same in all circumstances."

    Absolutely. Let's assume for the sake of discussion we had some way to guarantee that they are functionally the same.

    > "An AI could simulate a human perfectly, down to the smallest detail, and still have no actual intelligence whatsoever."

    Well, that obviously depends on your personal beliefs regarding intelligence. Since I'm a Turing Functionalist, I disagree on this point - an identical machine necessarily has an identical intelligence.

    > "For example, the use of 3D animation to simulate (say) an image of an aeroplane in a film doesn't mean that a 3D animated plane is the same as a real plane. But to an audience in a cinema there is no difference. To me, this is how the Turing test appears to work (or should I say, not work)"

    If the animation was in fact a simulated world where all the other actors functioned as they should, then I'd argue that it is indeed a plane in that world. It's not the Test itself you're arguing with so much as the Functionalism part.

    > "Another fundamental problem with Turing is this: why does a computer have to display human intelligence? An intelligent alien lifeform would fail the Turing test too. Expecting a deliberately designed bundle of wires and microchips to exhibit the same variety of intelligence as a highly evolved monkey which is adapted to hunting mammoth, reproducing to make more monkeys and killing other highly evolved monkeys is totally unrealistic."

    Sure, sure. It's just that we consider humans to be intelligent (sometimes I wonder why, etc. etc., but in this context we just do), so if we can show equivalence between a machine and a human, that's sufficient to show the machine to be intelligent. Failure of this test does not necessarily mean the machine is not intelligent via equivalence with some alien creature. (I guess that answers my parenthetical question at the top about whether the Test was a necessary condition.)

    > "As others have pointed out, we need a better definition of intelligence. "Able to mimic a human" just doesn't cut it."

    After the above, will you understand when I say that I think it does? ;)

    --
    Evidently, the key to understanding recursion is to begin by understanding recursion. The rest is easy.