Slashdot Mirror


DARPA Tackles Machine Learning

coondoggie writes "Researchers at DARPA want to take the science of machine learning — teaching computers to automatically understand data, manage results and surmise insights — up a couple notches. Machine learning, DARPA says, is already at the heart of many cutting edge technologies today, like email spam filters, smartphone personal assistants and self-driving cars. 'Unfortunately, even as the demand for these capabilities is accelerating, every new application requires a Herculean effort. Even a team of specially-trained machine learning experts makes only painfully slow progress due to the lack of tools to build these systems,' DARPA says."

26 of 95 comments (clear)

  1. Oblig... by famebait · · Score: 4, Funny

    Even a team of specially-trained machine learning experts makes only painfully slow progress due to the lack of tools to build these systems

    Why not just teach a machine to do it?

    --
    sudo ergo sum
    1. Re:Oblig... by gshegosh · · Score: 4, Funny

      Programming a machine to teach is not as hard as it sounds.

      I hear you man, I probably had the same German teacher ;-)

  2. Skynet by Edis+Krad · · Score: 4, Funny

    Defense agency investing in Machine Learning technology? What could possibly go wrong?!

    1. Re:Skynet by Required+Snark · · Score: 2, Informative

      Yep, just another stupid waste of time by DARPA, just like the internet.

      --
      Why is Snark Required?
    2. Re:Skynet by Anonymous Coward · · Score: 3, Interesting

      As somebody who is currently taking an advanced class in machine learning *shutter, no more prob stat, no more vector calculus, no more linear algebra, please!*, I'm not going to claim to be an expert by any means, but I will point out that as far as I can tell machine learning is more about classifiers, i.e., is this a square peg, or a round peg, and is that a square hole or a round hole. In other words, take a piece of data, figure out if it belongs in a particular class, or decide if a new class should be created. I can't see any form of sentience coming from anything happening right now.

    3. Re:Skynet by Anonymous Coward · · Score: 4, Interesting

      Then you haven't seen my spam filter!

      Seriously, I am an AI PhD student/researcher. We get this kind of crap all of the time.
      "you are working on robots, when is SkyNet? Hahaha"
      "...so... the robot is lost and can't figure out where it is... I'm trying to make it so it can figure it out by how many steps its taken and looking around"
      "SkyNet!"

      "you are working on a program to control a controller for a video game, when is SkyNet? Hahaha"
      "...so... I'm trying to figure out how the computer can make Mario jump over the bad guys without telling him that the bad guys are 'bad'"
      "SkyNet!"

      "you are working on a program to figure out emotional states of students, how long before you unemploy all the nation's teachers?"
      "...so... I'm trying to figure out how to teach a computer to recognize when people are bored..."
      "Why do you hate your teachers?!"

      Seriously, the idea that we will be able to classify spam, or map a room, of jump over an obstacle, or recognize boredom so well that it gets sentience (and decides to kill all of us) is laughable.

      Posting Anon from work.

  3. "DARPA Tackles Learned Machines" by hildolfr · · Score: 5, Funny

    a headline for future 2030.

  4. This headline pops up every few years by Viol8 · · Score: 4, Informative

    They've been trying it since the 50s without it has to be said, too much success given the amount of effort thats been put in. I suspect until we REALLY understand how boligical brains do it (not , "meh, some sort of neural back propagation", yeah , we know that , but what propagation and how exactly?) then machine learning will still remain at the bottom rung of the intelligence ladder.

    Personally I think at the moment pre programmed intelligence is still a more successful route to go down. Though hopefully that will change.

    1. Re:This headline pops up every few years by WillAdams · · Score: 4, Interesting

      A.I. is a classic case of moving goal posts --- there's an assumption a hard problem requires it, the problem gets solved using ever-more sophisticated analysis/pattern-matching/data-processing --- the problem domain is no longer considered A.I.

      --
      Sphinx of black quartz, judge my vow.
    2. Re:This headline pops up every few years by g4b · · Score: 3, Interesting

      exactly.

      the research field of AI already considered the idea of "artificial intelligence" to be more "solutions based on imitating intelligence", and it has long been postulated, that while the dream is still the real thing, it probably will not be possible with electronics (which do great in calculus, but still have problems with parallelism).

      the results in the last decades were OOP, neuronal networks, or the good known Spamchecking algorithms.

      But the approach to learning in all these cases is still very different each time. I am e.g. not sure, if spam filters really use neuronal algorithms - it mostly concentrates on the relations of words in a text, or the alterations of a word in a text, and how to use the statistical data about these relations to flag content which is probably spam.

      Since humans (or any intelligent mammals) learn to learn by playing, both establishing recognition of rules, and the usage of data, I wonder if it will be ever possible to have an abstract learning machine, which not just "learns", but also learn "what to learn", and "why to learn" on its own. But each respective problem is getting addressed.

      Oh yes, and the latest implications, like gamification in industry, and the revelations of the true meaning of "playing", researched more in social and psychological sciences is maybe also an indirectly linked to the field of AI. Which still has a long way to go in a society, where "playing" is associated with "kids", and a waste of time.

    3. Re:This headline pops up every few years by Spottywot · · Score: 5, Insightful

      I think that learning how the biological brain does it before building a learning machine is the wrong way around. I think that the person/team that builds the first genuinely successful learning machine will give the biological researchers a clue about potential mechanisms for learning, it will take a genuine leap of imagination as well as the type of grunt work the DARPA guys are doing.

      --
      In a cybernetic fit of rage she pissed off to another age...
    4. Re:This headline pops up every few years by bangular · · Score: 2

      The same thing could have been said about computers. Machine learning algorithms can predict really useful things today way better than a human. Sure, they may not be able to understand the context of spoken language very well, but given sufficient training data we can already prescribe medical treatments from ML that surpasses a human doctor in effectiveness.

      I do think understanding the human brain would be a big breakthrough, but I don't see them as sequential. ML will actually help us understand the brain better because it will allow us to process the big data of medical experiments in a meaningful way.

  5. Re:ROLLOVER AD by programmerar · · Score: 2

    That ad is super annoying. But as an answer to parent, I actually leave ads *on* for slashdot - only for their gesture to let me turn them off. You know the setting up in the corner on slashdot. This alone made me keep them on, to support them.

  6. The best chess programs do not learn by Viol8 · · Score: 4, Informative

    They're hard coded and use massively parallel depth searching. The brute force approach has been the best for chess computers for decades.

    And google search and translate isn't really learning, they're just statistical systems that given the best result based on the data they've gathered. They don't "think" about it in any meaningful way.

    1. Re:The best chess programs do not learn by citizenr · · Score: 2

      And google search and translate isn't really learning, they're just statistical systems that given the best result based on the data they've gathered. They don't "think" about it in any meaningful way.

      This is machine learning, they derive results based on statistical data, but new data input changes statistics = learning

      --
      Who logs in to gdm? Not I, said the duck.
    2. Re:The best chess programs do not learn by snarkh · · Score: 2

      I never said that chess was machine learning.

      >And google search and translate isn't really learning, they're just statistical systems that given the best result based on the data they've gathered.

      And what exactly is your definition of learning?

    3. Re:The best chess programs do not learn by eennaarbrak · · Score: 2

      They don't "think" about it in any meaningful way.

      O yes? And what does it mean to think about something in a meaningful way?

    4. Re:The best chess programs do not learn by ralphdaugherty · · Score: 2

      At what point does one "know" it's rubbish? Saying "wibble wibbke wibble" to a baby will evoke a smile if said in the right tone of voice.

  7. We need data, not algorithms by Anonymous Coward · · Score: 3, Insightful

    There are a ton of off-the-shelf machine learning toolkits that are sufficient for 90% of possible use cases. The problem is getting annotated data to feed into these tools so they can learn the appropriate patterns. But all that requires is a host of annotators (i.e. undergrads and interns), not machine learning experts.

  8. Re:Didn't IBM do this? by Rockoon · · Score: 2

    Its a form of A.I. for sure, but the skill shown has more to do with the volume of data it uses than it has to do with a skill at learning.

    Machine Learning is a very particular subset of A.I, often characterized by one or more training phases which build of model of the training set that is smaller than the set itself.

    --
    "His name was James Damore."
  9. Re:Didn't IBM do this? by DI4BL0S · · Score: 3, Informative

    Jeopardy, and the machine is called Watson

  10. Good luck with that by Black+Parrot · · Score: 3, Insightful

    Sounds like the 1990s fetish for making programming languages so simple that even your boss could make reports and do other stuff for himself. Unfortunately, programming language syntax wasn't the primary hurdle: I've had bosses request reports that would add pounds of product and shipping costs.

    For ML, it takes a good bit of training just to know what kinds of problems you can apply it to. A cookbook toolkit isn't going to reduce the need for expertise very much.

    --
    Sheesh, evil *and* a jerk. -- Jade
    1. Re:Good luck with that by Black+Parrot · · Score: 3, Insightful

      Here's an analogy: We've had sophisticated, easy-to-use statistics software packages for decades. What percentage of the population can use them correctly for anything non-trivial?

      Tools are nice, but some stuff just inherently takes training. No tool is going to make me a competent oceanographer or particle physicist.

      --
      Sheesh, evil *and* a jerk. -- Jade
    2. Re:Good luck with that by bangular · · Score: 2

      Creating new programming languages for domain specific problems has never worked. However, there really is a lack of developer friendly tools out there. On one end we have the researchers creating algorithms and (if we're lucky) implementing that algorithm as a stand alone script in Java. On the other end are developers. Most developers are fickle and if the tool requires knowledge of the internals, probably won't use it. That's where the Microsoft's and Oracle's and Google's are supposed to step in and make a crap-ton of money packaging these algorithms with a shiny API.

      However, the current state is that no middle man has really stepped in.

  11. Quality of tools by bangular · · Score: 2

    I was just talking with someone about this the other day. Machine learning is going to be the SQL database of the next generation. In 15 years it will be hard to find basic apps that don't use it. The tools will reach a point that it's so easy to include them in your program, people will assume to include them even though they may not really be the most appropriate method to solve the problem. This is how SQL is today. Go to any SMB and try to find a non-trivial application that doesn't use a SQL database. It's difficult.

    However, the state of current tools is not good. We currently have really good algorithms for machine learning. The gap is in actually getting a developer to use them. If it's not branded and blessed by Oracle or Microsoft, many businesses won't use it. If you search for implementations on the internet you can usually find an implementation of R or Matlab. However, people are weary of including R and Matlab in their programs to begin with. If it's not in .net or Java, they won't use it. Weka can be used for Java, but it's a difficult library for a machine learning novice to use. The developer has to know some internals of machine learning to know which algorithm to use and their pros and cons. Meta learners complicate the issue even more. Modern RDBMS have been sugar coated so much a developer can use a RAD IDE and not understand a single line of SQL. I'm not saying that's really a good thing, but it definitely has made SQL databases very common and improved the state of the industry for everyone.

  12. The Reasons for "Herculean effort" by scruffy · · Score: 3, Informative

    Raw data need to be cleaned up and organized to feed into the ML algorithm.

    The results of the ML algorithm need to be cleaned up and organized so that they can be used by the rest of the system.

    No one (currently) can tell you which ML algorithm will work best on your problem and how its parameters should be chosen without a lot of study. Preconceived bias (e.g., that it should be biologically based, blah, blah) can be a killer here.

    The best results typically come from combinations of ML algorithms through some kind of ensemble learning, so now your have the problem of choosing a good combination and choosing a lot more parameters.

    All of the above need to work together in concert.

    Certainly, it's not a bad idea to try to make this process better, but I wouldn't be expecting miracles too soon.