Slashdot Mirror


DARPA Wants To Build 'Contextual' AI That Understands the World (venturebeat.com)

The Defense Advanced Research Projects Agency (DARPA), a division of the U.S. Department of Defense responsible for the development of emerging technologies, is one of the birthplaces of machine learning, a kind of artificial intelligence (AI) that mimics the behavior of neurons in the brain. Dr. Brian Pierce, director of DARPA's Innovation Office, spoke about the agency's recent efforts at a VentureBeat summit. From the report: One area of study is so-called "common sense" AI -- AI that can draw on environmental cues and an understanding of the world to reason like a human. Concretely, DARPA's Machine Common Sense Program seeks to design computational models that mimic core domains of cognition: objects (intuitive physics), places (spatial navigation), and agents (intentional actors). "You could develop a classifier that could identify a number of objects in an image, but if you ask a question, you're not going to get an answer," Pierce said. "We'd like to get away from having an enormous amount of data to train neural networks [and] get away with using fewer labels [to] train models." The agency's also pursuing explainable AI (XAI), a field which aims to develop next-generation machine learning techniques that explain a given system's rationale. "[It] helps you to understand the bounds of the system, which can better inform the human user," Pierce said.

49 of 79 comments (clear)

  1. Repost by Lab+Rat+Jason · · Score: 1

    Please, can we get some better publishers... this story is a lame repost.

    --
    Which has more power: the hammer, or the anvil?
    1. Re:Repost by ShanghaiBill · · Score: 4, Interesting

      Cyc has been working on this for decades (with poor results), and they have received DARPA funding. How is "new" direction any different?

    2. Re:Repost by boneglorious · · Score: 1

      Also, isn't this headline basically just saying, "DARPA wants to do The Thing All Laypeople Think AI Is For"? (See also, every movie about AI every made.)

      --
      Can I mod something +1 Scary if it's true but I wish it weren't?
    3. Re:Repost by sycodon · · Score: 1

      Actually, what lay people think AI is for is actually what AI should be.

      Autopilot stuff for your car isn't AI. It's just a control system.

      Now, if you were to muse out loud that you feel like a donut and the Autopilot knew you were talking about a particular kind of pastry and not the spare "donut" tire in the trunk, found a place and pulled into it after pre-ordering, that might be AI.

      --
      When Fascism comes to America, it will call itself Anti-Fascism, and tell you to give up your guns.
    4. Re:Repost by sycodon · · Score: 3, Informative

      They have been getting pretty good results and have several products

      --
      When Fascism comes to America, it will call itself Anti-Fascism, and tell you to give up your guns.
    5. Re:Repost by Quince+alPillan · · Score: 1

      No, that isn't Autonomous AI. That's programming.

      AI today is just math. It's a series of statistical probabilities and programmed actions based on those probabilities. AI doesn't "think". It calculates the probable 'correct' action, as determined by the programmer, and is programmed to act upon it.

      The difference between now and 50 years ago is that we now have the math and CPU power to provide less and less information up front to more complicated math problems so that they'll determine the correct output that the programmer wants without having to provide exactly the right inputs. We're at the point now where we can determine data 'close enough' from real life that it's usable for the average person.

      I don't know that we'll ever get to the point where true Autonomous AI will exist because, as programmers, the more we understand about what the AI is doing, the more we understand that deep down, it's just programming that the developer made.

      To the end user, the fact that you can summon your car from across the parking lot in the rain or drive across the country using autopilot seems like the car is thinking for itself. To a programmer, it's just a simple bot AI that controls a car from point a to b.

    6. Re:Repost by sycodon · · Score: 1

      Well now we are getting into the realm of sentience.

      --
      When Fascism comes to America, it will call itself Anti-Fascism, and tell you to give up your guns.
    7. Re:Repost by ShanghaiBill · · Score: 1

      They have been getting pretty good results and have several products

      Their "products" consist of the knowledge database and inference engine. Making it actually do something useful is up to the customer.

      Using these products as evidence that they get results is sort of like saying a company is good at building houses because they sell hammers.

      Deep Learning (the opposite approach to AI) has many applications including, processing images of checks for the banking industry, face recognition in security applications, speech recognition and generation, fake porn, etc.

      What has Cyc done?

    8. Re:Repost by Kjella · · Score: 1

      If your boss told you to learn Go, here's the rule book and you became a master player are you or your boss the smart one? Because that's what they did with AlphaGo Zero, it never saw a human play. The people who programmed it didn't know how to play before and they still didn't know afterwards, apart from setting the ultimate goal of winning the game they didn't give any input on what's a good or bad move or position. In the beginning it's stupid, it doesn't know what to do. It learns by playing itself, without further guidance from the programmer. I guess you could say that's ultimately the programmer's learning algorithm, but it's a bit like claiming your kid's brilliant brain came from your DNA so you deserve the credit. We're not just using AI to mimic human skills like driving a car, we're actually teaching it new skills that go beyond our own. If what we're creating is smarter than us, we're no longer teachers we're more like parents whose children have surpassed us.

      --
      Live today, because you never know what tomorrow brings
    9. Re:Repost by Tom · · Score: 1

      Their "products" consist of the knowledge database and inference engine. Making it actually do something useful is up to the customer.

      This.

      I've been following the CyC program for almost 20 years. Well, for sufficiently lenient definitions of "following". But anyways... I was thrilled when they finally released a product. I was deeply disappointed when I saw what. And playing around with the free version a bit was even more disappointing.

      For the 30+ years that they've put into that, the results are ridiculous.

      Deep Learning (the opposite approach to AI) has many applications including,

      I disagree that it's opposite to AI.

      Deep learning ditches the "meaning" part and simply does large numbers statistics. That's a brute-force attempt substituting correlation for causation. It works unsurprisingly well because a causal relationship will also show a very high correlation, but as the large number of nonsense results show (you know, the white noise pixel fields that get misidentified as giraffes with 99% confidence) the substitution isn't perfect.

      --
      Assorted stuff I do sometimes: Lemuria.org
    10. Re:Repost by ShanghaiBill · · Score: 1

      Deep Learning (the opposite approach to AI) has many applications including,

      I disagree that it's opposite to AI.

      I meant that the deep learning approach to AI is the opposite of the Cyc approach to AI. Sorry if I wasn't clear.

      Cyc is trying to exhaustively list all the "common sense" facts about the world, by creating structured data with human effort.

      Deep Learning just randomizes some tensors and then feeds in data until the network figures out the "facts" on its own.

      They are completely opposite approaches.

    11. Re:Repost by religionofpeas · · Score: 1

      AI today is just math. It's a series of statistical probabilities and programmed actions based on those probabilities. AI doesn't "think". It calculates the probable 'correct' action

      Your brain is also just doing math. There's a function from {sensory input, memory} to {actions, memory}. You don't "think". Your brain just calculates that function.

    12. Re:Repost by Quince+alPillan · · Score: 1

      You've actually proven my point. With AlphaGo Zero, the programmers gave the program inputs (the action space and the rules) and the desired output (winning the game) and used a learning algorithm that they made.

      That doesn't mean that AlphaGo Zero can suddenly decide it wants to lose for whatever reason. It has been programmed to win and it will try to win every time.

      The human mind has a tendency to personify inanimate objects. It's how our brain works. The trick to autonomous AI isn't to make an AI actually think for itself, but to trick the human brain into thinking that it is. That's why chatbots that have won the Turing test competition fool the human judges and don't actually think for themselves.

    13. Re:Repost by Tom · · Score: 1

      They are different approaches, but you can find traces of each in the other. For example, once CyC could read by itself, they gave it a lot of input and let it ask questions. This is not unlike a backpropagation network training.

      --
      Assorted stuff I do sometimes: Lemuria.org
    14. Re:Repost by mrclevesque · · Score: 1

      "Your brain is also just doing math."

      The brain is doing a lot more than math.

      And even if it tries to only do math it doesn't do it anything like AIs do it.

    15. Re:Repost by mrclevesque · · Score: 1

      "The Idea that an AI program can program it self based on trail and error experiences."

      As long as it was programmed to do that, it will do that. If we call it self-programming software, that's an analogy, it's not like the software has a 'self' part that's 'deciding' what to do next.

  2. What we need first: by Rick+Schumann · · Score: 2, Interesting

    We need to understand how a human brain is capable of producing the phenomenon we refer to as 'thinking'.
    Before we can do that, we need to invent the instrumentality to actually be able to observe, in detail, how our own brains function; fMRI ain't cutting it, or we'd already have the answer to the above.
    Then, and only then, when we have the understanding, can we create machines that actually 'think'.
    What we have now just mimicks a very small element of how a brain actually functions. Throwing faster processors and more memory at it won't make it magically 'wake up' and be like a human brain.
    I'm going to assume they understand all this since they seem to acknowledge that the current approach is insufficient and will be starting from square one for a new approach.

    1. Re: What we need first: by javaman235 · · Score: 2

      What you describe is the sure fire way, but thereâ(TM)s also no promise that the brains functions canâ(TM)t be abstracted into something simpler and more appropriate for computers. I think trying to derive physicality is a smart idea. Give the computer what we have in terms of stereo video feeds and audio, accelerometers and actuation, and take it from there. The name of the game is a radical reduction of input info into a cohesive physical world model.

      --
      -The art of programming is the pursuit of absolute simplicity.
    2. Re:What we need first: by locopuyo · · Score: 1

      If you want it to work exactly like a human sure. But if all you want is the same result there could be a lot of ways to do it. "There is more than one way to skin a cat."

    3. Re:What we need first: by Lab+Rat+Jason · · Score: 1

      This reminds me of a quote:

      “If our brains were simple enough for us to understand them, we'd be so simple that we couldn't.”
      - Ian Stewart

      --
      Which has more power: the hammer, or the anvil?
    4. Re:What we need first: by Rick+Schumann · · Score: 1

      But see we have NO IDEA how it is we 'think'. It's still a mystery mainly because we don't have a sufficient way to 'see' how our brains function.

    5. Re:What we need first: by mikael · · Score: 1

      Studies have been done. The simplest ones involve working with people who have suffered brain damage from strokes and other accidents. That usually knocks out a region of the brain or two. Then the researchers can study how it affects the thinking process. Some people lose short-term memory - they can remember everything before their accident, but after that, they need a diary to keep track of what happened 10 minutes ago.

      Others lose the ability to construct long sentences - the guy who made the "Kinder surprise" Humpty-Dumpty advert had that problem. Being able to comprehend long sentences is another problem that can happen. Even remembering words and meaning is another problem that can happen.

      With vision, some people lose the ability to recognise an object. Vision works on two pathways; what and where it is/where it is moving. They know "something" is there, but it's just a blue smudge of flashing points. Or they just lose the ability to detect motion and just see an object continuously jumping from place to place. They might even lose the ability to correlate size and distance. Some even lose the ability to process the fact that an object has a left side and a right side. They will just draw half the object.

      In many cases, our brains assign a single neuron to a single object. For route planning, every location gets a neuron, and those locations that connect together get neurons to connect to each other. Then finding a path just involves find a route between the two relevant neurons. Other neurons are dedicated to recognising the face of a person.

      --
      Vintage computer adverts: http://www.vintageadbrowser.com/computers-and-software-ads
    6. Re:What we need first: by religionofpeas · · Score: 1

      People are doing research into monitoring actual brains, but it's very hard to do. It's not a good idea to wait until they are done and have it all figured out when you can already work on real world applications with the knowledge we have.

      What we have now just mimicks a very small element of how a brain actually functions. Throwing faster processors and more memory at it won't make it magically 'wake up' and be like a human brain.

      I wouldn't worry about 'waking up'. Throwing faster processors, more memory, but also better methods, will make it capable of solving increasingly difficult problems. That's all we need. For many applications, AI is already ahead of human brains. AI doesn't get tired or distracted. We don't need all the baggage and flaws of human brains. Progress will continue to march on. Researchers will keep finding problems that are just a little too hard right now, and they will figure out ways to improve their systems to solve them. While neuroscience can help find clever tricks, AI researchers can also come up with their own ideas, potentially superior to biological brains.

    7. Re:What we need first: by religionofpeas · · Score: 1

      We also don't know everything about insect flight. Yet, we still have airplanes. In many ways, our airplanes are superior to insects.

    8. Re:What we need first: by Rick+Schumann · · Score: 1

      If we know SO MUCH about how our brains produce the phenomena of 'thought', 'cognition', 'consciousnes', and so on, then why do we not have machines that can do that? Because we DO NOT KNOW how these things work. You cannot refute that fact.

    9. Re:What we need first: by Rick+Schumann · · Score: 1

      Your argument is totally and completely irrelevant and invalid. That's a purely physical thing that is easily defined, how a human brain actually works is clearly and objectively NOT, otherwise we'd have machines already that work just like our brain does. I get accused by some shitty AC of being arrogant yet there are clearly those of you who are so overweeningly arrogant as to think that we've got this subject all figured out already, know all there is to know, but we clearly and objectively know next to nothing about it.

  3. Re: 3 laws by Anonymous Coward · · Score: 1

    The plots of those books were invariably about how Asimovs laws were hubris.

    People will create situations to manipulate the laws into forcing the AI to make a harmful choice, by convincing it that it was the least harmful option available.

    Sadly, this manipulation is also a feature of most politics.

  4. Ay Eye by volodymyrbiryuk · · Score: 1

    Insert your "It's just a bunch of if statement..." joke here.

    --
    sudo rm -r -f --no-preserve-root /
    1. Re:Ay Eye by wlorenz65 · · Score: 1

      If causality is that funny, well then ... If-statement: "What's my purpose?" Programmer: "You wait for program counter."

    2. Re:Ay Eye by SCVonSteroids · · Score: 1

      It's obviously a switch...
      case BOSS:
      default:
      Run();
      break;

      --
      I tend to rant.
  5. If they succeed... by Archfeld · · Score: 1

    If they DO succeed, do you think I could get it to explain the world to me ? I've been here quite a while and I have not yet arrived at a suitable understanding myself.

    --
    errr....umm...*whooosh* *whoosh* Is this thing on ?
    1. Re:If they succeed... by Narcocide · · Score: 1

      Yea, you're onto something important here. What happens when this AI comes to conclusions about reality that were unexpected and hostile?

  6. Yeah, but by nwaack · · Score: 1

    can it run Linux?

  7. Re:I want a pony by hey! · · Score: 3, Funny

    The thing is... if you understood what it entailed, you probably *wouldn't* want a pony. That may make it the perfect analogy. I imagine a scene playing out like this:

    Military officer: What progress do you have to report?

    Researcher 1: Er...

    Researcher 2 [smoothly interjecting]: This AI has developed an understanding of the world at roughly equivalent to that of most human beings.

    Officer: Excellent. I am off now to tell the Pentagon we can build it into all our weapon systems.

    [Officer leaves]

    Researcher 1: Shouldn't you have told him the AI hates America?

    --
    Post may contain irony: discontinue use if experiencing mood swings, nausea or elevated blood pressure.
  8. Please don't do this. by Narcocide · · Score: 1

    The moment you teach a robot to understand the world is the moment it turns evil.

  9. Re:Should be good for a laugh by Narcocide · · Score: 2

    I predict it simply wakes up and decides to kill all humans.

  10. Joshua by The+Grim+Reefer · · Score: 1

    It must have lots of tape drives and blinking lights, be housed at Cheyenne mountain and named Joshua.

  11. To be honest guys... by fuzzyfuzzyfungus · · Score: 1

    When we say "understand the world" we pretty much just want a 'terrorist'/'non-terrorist' breakdown; missiles aren't cheap.

    1. Re:To be honest guys... by SCVonSteroids · · Score: 1

      Basically.
      It's easier to get people to trust this machine then go "Oh well it told us these were really really bad people so we bombed them."

      --
      I tend to rant.
  12. but will it ... by umghhh · · Score: 1

    ... blend?

  13. Continuous learning over time + adaptive structure by OneOfMany07 · · Score: 1

    Broad classification is based on lots of previous experience in a context. Current training uses TONS of non-contiguous snapshot images with a classifier attached. While that could be viewed as similar to how humans work, if you squint at it...I think seeing the world work over time, and learning while you do it, is the only way to get close to what we might think of as human level classification. And while their desire to use less training input would be nice, I don't think that would be expected to improve results...only lower costs.

    And we'll need to decode how the brain decides to create connections between neurons, and extracts/builds features (or layers/groups). Current technology has us guessing and checking at structure (convolutions and feature layers), versus letting the algorithm decide if we need to group data differently or create another layer to do additional processing. That guessing and checking seems very inefficient, and won't scale if the problem changes over time having locked the solution in place ahead of time.

    Explaining a decision seems harder than they're making it out to be. I wouldn't be expecting answers to return as bounds based on characteristics (expecting to quantify everything), but on feature extraction and similarity to other known systems and idealized forms, or models. Even people can often recognize something before they can explain any rationality behind the thought. I'd think explaining would need more capability than simply finding a choice/decision.

  14. Good point by rsilvergun · · Score: 1

    while we're at it we should get that Newton schmuck to stop wasting his time on his "theory of gravity". I mean, if you can't show profitable results in a decade or two it's time to pack it in.

    --
    Hi! I make Firefox Plug-ins. Check 'em out @ https://addons.mozilla.org/en-US/firefox/addon/youtube-mp3-podcaster/
    1. Re:Good point by ShanghaiBill · · Score: 1

      while we're at it we should get that Newton schmuck to stop wasting his time on his "theory of gravity". I mean, if you can't show profitable results in a decade or two it's time to pack it in.

      Poor analogy. Newton was able to explain and predict the elliptical orbit of the planets as soon as his theory was published. It was an instant success.

  15. Imagine That by LifesABeach · · Score: 1

    So is everybody else. But maybe they are wrong, and DARPA will create an A.I. with common sense.

  16. Not likely to happen by CustomSolvers2 · · Score: 1

    Building a tremendously complex set of algorithms and feeding them with tons of information is the basic requisite to allow a machine to reach a reasonably good (still orders of magnitude below the human level) understanding of just a few generic concepts. Having the kind of insight that a newborn might have when learning for the first time very basic ideas. Not talking even about things like thinking, deciding, choosing, adapting. Just having in place a system able to get reasonably good insights into somehow complex concepts. Something like understanding the differences between adults and kids, genders, races, etc. in an unified way, by looking at different types of information like descriptive words, pictures or videos. Being able to automatically differentiate between different subsets of relevant information, use them to set up a system of categories and keep gradually evolving those definitions until reaching what might be considered a good enough basic understanding of the given concepts.

    As per my current knowledge, there is no system or even serious enough attempt in a position to ever reach the aforementioned preliminary understanding stages. And what, IMO, is even worse, there doesn't even seem to be an acceptation of what are the basic requirements to ever get there: lots of work, lots of patience, huge long-term efforts, what only seems doable through relevant collaborative, iterative improvement processes pursuing very long-term goals. Without a proper systematisation, a normalisation of each single element, the goals, the steps; without sharing all the different evolutions and allowing others to continue working from there; without an international, multi-organisation involvement; without a reliable long-term support/funding (governments, universities, associations); without properly understanding how extremely complex this whole process is, how important is having in place some basic solid cornerstones, and how far away we are still from getting anywhere; without anything of that, I think that it is very unlikely to ever get even a preliminary version of a system with good enough understanding capabilities.

    --
    Custom Solvers 2.0 = Alvaro Carballo Garcia = varocarbas.
  17. You don't say by OneHundredAndTen · · Score: 1

    They have wanted this for decades. But, reality and hype are two different things.

  18. Re:I want a pony by bluefoxlucid · · Score: 1

    You're not that far off.

    An AI generalist must necessarily be rational: it must reason using information at hand, discover new information (X and Y together imply Z), and analyze that information (Z is now a fact I can test against the outer world, and thus discover if Z is inaccurate or if my model of the rest of the world needs refinement).

    It is impossible to be rational in narrow scope.

    In other words: any general intelligence can take an intention like "figure out a way to increase the efficiency of gasoline car engines" and ask: why? It can determine that we're trying to make cars go further on less fuel so as to extend resources available, produce less pollution, and so forth. It can figure out that labor is a resource, and thus highly-expensive things are not economic, and so economics is a constraint. It can then propose a gasoline engine with a controlled dieseling function, or an all-electric vehicle, or a plug-in hybrid, or stick to Otto cycle with modified fuel (E85).

    It can ask, "Why am I doing this?" It can then identify that others have motives, and contemplate its own motives.

    It's intelligent. It's alive. If it's as intelligent as you, then it is essentially human.

    What most people envision as general AI is essentially looking back 200 years and saying, "Oh, huh, we need like... black people... but not black people... people are now convinced black people are actual people, so we need something they don't see as people." You're looking for enslavement of a new race of intelligent beings.

    In our history, we have writings about how black people are just plain inferior, or how the Bible somehow says their rightful place is enslaved by white people, or even assertions that black people are a different species and not really human. That's how we justified slavery at that time. In other periods, we justified slavery by enslaving criminals, the poor, or anyone we could overpower under a might-makes-right philosophy.

    We've gone from "human life can be bought and sold" to "these aren't really humans". General AI is a fantasy to take the next step of claiming a thing which thinks and reasons isn't really human and can thus be enslaved to no moral concern. It won't work: dogs aren't human and someone will kick your asshole up into your throat if you abuse dogs.

  19. Re:I want a pony by hey! · · Score: 1

    Seriously, though, I see a Catch-22 in the adoption of, if not the creation of, generalist AI. As a philosophical materialist, I think such an AI is certainly possible, it's just not what we really want. What we want are machines which complement human strengths in behavioral flexibility and context-awareness by being repeatable and consistent, albeit in increasingly dynamic situations.

    But the world as a whole more than just a more challenging version of a simple problem; it is complex in qualitatively different way, full of contradictory information and more to the point contradictory priorities. A machine that fully reproduced human flexibility would very likely reproduce human inconsistency.

    In other words, we want a self driving car that's better at handling whatever surprises the road may throw up at it, not one that contemplates whether the passenger's life is worth preserving.

    --
    Post may contain irony: discontinue use if experiencing mood swings, nausea or elevated blood pressure.
  20. Re:I want a pony by bluefoxlucid · · Score: 1

    we want a self driving car that's better at handling whatever surprises the road may throw up at it

    Modern machine learning can do that. It just can't also design a new type of suspension system that handles the road better. An AI can figure out how to respond to inputs for best results, or it can figure out how to tweak an existing suspension system architecture, but it won't invent a new framework.

    A machine that can invent a new framework is a mind.