Slashdot Mirror


New Object Recognition Algorithm Learns On the Fly

Zothecula writes "Scientists at Brigham Young University (BYU) have developed an algorithm that can accurately identify objects in images or videos and can learn to recognize new objects on its own. Although other object recognition systems exist, the Evolution-Constructed Features algorithm is notable in that it decides for itself what features of an object are significant for identifying the object and is able to learn new objects without human intervention."

66 of 100 comments (clear)

  1. I could be wrong... by barlevg · · Score: 2, Insightful

    ...but I don't think an evolutionary algorithm approach to pattern recognition is anything new.

    1. Re:I could be wrong... by Anonymous Coward · · Score: 2, Funny

      The big news here is that it's being trained to detect bullshit. It's currently 0-10.

    2. Re:I could be wrong... by medv4380 · · Score: 1
      Depends on what they mean by "evolution constructed". I assume that rather than have a human input the best guess at what features to look for, like eye spacing/nose placement, they use a Genetic Algorithm to narrow down to a good enough input. Still requires a person to load a bunch of pictures of air planes, and tell it to "learn" these objects. It's not really learning objects on its own, but rather learning which traits are best for identifying the object on its own.

      With our algorithm, we give it a set of images and let the computer decide which features are important.

      Without seeing their code that is my best guess from the article.

    3. Re:I could be wrong... by durrr · · Score: 4, Interesting

      The way I understand it is that it identifies recurrent features and learns them. Meaning that giving it a huge image library with no labels would mean it can recognize say, roses, but it would call them "object 193131", not "rose".

    4. Re:I could be wrong... by MLBs · · Score: 1

      The features part is really the tricky part. You could supply a set of pictures of aircraft and the algorithm would need to determine what is common to all those examples.
      With regards to training, It is possible to perform this learning task without direct supervised (tagged data) training.
      Imagine the following:
      Take a trillions of images from the web, and use unsupervised, clustering methods to group images into groups of equivalence, given that you have great features that allow you to do that.
      Then, given a cluster of millions of examples, take the surrounding text around the images source and try to find common denominators in the text. It's not far fetched to think that similar objects in the images will have similar words in the text.

      Such "Big Data" research is now being done in various research facilities around the world.

    5. Re:I could be wrong... by Kookus · · Score: 1

      And it has figured out that all objects have been constructed from an all knowing being. Divine intervention if you will.

      http://aims.byu.edu/mission_statement

    6. Re:I could be wrong... by fatgraham · · Score: 2

      This can't be far off, I read a paper a while ago (still trying to find it, this post is a bit redundant without it) which would "detect" the capital of a country from how often they were found in text together. (Probably pre-loaded with country names, this would just have the image as the needle)

      I'm sure "Object 1387" and "Nyan cat" will soon be matched :)

    7. Re:I could be wrong... by Anonymous Coward · · Score: 5, Funny

      Well, you know what they say... "a rose by any other name would posess eigenvalues closely matching those of object 193131."

    8. Re:I could be wrong... by climb_no_fear · · Score: 1

      "What's that mommy?" "Why, Jimmy, that's an airplane".
      I am not a programmer so could someone explain to me how that is different?

    9. Re:I could be wrong... by Zalbik · · Score: 1

      Still requires a person to load a bunch of pictures of air planes, and tell it to "learn" these objects. It's not really learning objects on its own

      But that is exactly what people do. Other than a few hard-wired patterns (e.g. faces), we "learn" to recognize objects by being exposed to multiple examples of those objects and told the label to apply to them.

      Though the argument could be made that people don't learn on their own either...

    10. Re:I could be wrong... by Tablizer · · Score: 1

      But how is that different from current AI?

    11. Re:I could be wrong... by timeOday · · Score: 3, Insightful
      There is no way an image-based unsupervised algorithm can learn to recognize objects. "Shapes that frequently go together," yes. But what we consider "objects" is not an objective reality, it is a mental construct that is largely functionally-determined. It will never figure out all the different forms to which we ascribe the label "chair."

      Sitting on a street, a "bicycle" is an object because it is most like to be operated on as a unit. But to a bicycle mechanic, a bicycle is a collection of objects, such as a frame, a seat.. and so on because they need to decompose the "bicycle" construct to do their job. To somebody on an assembly line putting together bicycle seats, a seat is (at least initially) several different objects.

      So, truly unsupervised algorithms cannot do useful recognition - that is, classify objects the same way people do. (A robot that could experiment with its environment and learn to use "objects" could come closer).

    12. Re:I could be wrong... by medv4380 · · Score: 1

      Well the OP was asking about whether or not this is anything new, not about whether or not this was "AI" that was similar to being human. So your sarcasm is lacking proper context. To answer your sarcastic question with a questions, do you honestly believe that when you are told that an object is X that you generation a thousand different possible representations of that object then generate a "test" to see which set is closest to what you are seeing then jumbling the closest together again and again until you have a good match? How we actually learn is still a black box worth exploring. Pretending that we know how it fully works is a good way to never find out.

    13. Re:I could be wrong... by JanneM · · Score: 2

      So, truly unsupervised algorithms cannot do useful recognition - that is, classify objects the same way people do.

      That's an overly narrow defintion of "useful recognition".

      --
      Trust the Computer. The Computer is your friend.
    14. Re:I could be wrong... by an+enormous+void · · Score: 1

      mismod...

    15. Re:I could be wrong... by medv4380 · · Score: 1

      I don't see it that way because in the article and the BYU article the examples clearly lable a Tree a Tree, an Airplane an Airplane, and a Human a Human. Ether you're right and someone went though and relabeled the object ID labels with human readable versions, or you've given it more credit then then they are trying to take.

    16. Re:I could be wrong... by maxwell+demon · · Score: 1

      But how is that different from current AI?

      Current AI would call it "object 0x2f26b".

      --
      The Tao of math: The numbers you can count are not the real numbers.
    17. Re:I could be wrong... by maxwell+demon · · Score: 1

      Perhaps the news is that someone from Utah accepts the principles of evolution?

      He taught them to machines because he didn't manage to teach them to the people around him.

      --
      The Tao of math: The numbers you can count are not the real numbers.
    18. Re:I could be wrong... by Lamps · · Score: 2

      The unsupervised algorithm discussed in the article seems to code some sort of visual input and, I'd infer, to perform clustering, which permits it to assign labels (i.e. let's say, 'tree', 'human', etc.) to objects it has encountered. It can use this schema which it has constructed to assign objects it hasn't seen before to a cluster - that is, it labels novel inputs in accordance with its schema. Thus, the algorithm 'recognizes' classes of objects. I'd imagine if you granularize the detail level of detail to which the algorithm pays attention, it can recognize (categories of one object)/particular instances of a general object category/a particular object.

      Sitting on a street, a "bicycle" is an object because it is most like to be operated on as a unit. But to a bicycle mechanic, a bicycle is a collection of objects, such as a frame, a seat.. and so on because they need to decompose the "bicycle" construct to do their job. To somebody on an assembly line putting together bicycle seats, a seat is (at least initially) several different objects.

      That goes way beyond the task of 'classifying objects', which is what the algorithm is intended to do. It's like expecting a mechanic to drive your vehicle for you once he has repaired it.

      So, truly unsupervised algorithms cannot do useful recognition - that is, classify objects the same way people do. (A robot that could experiment with its environment and learn to use "objects" could come closer)

      Sure, the algorithm doesn't entail a neurological equivalent of what humans to classify objects, but the effect is the same, no? Is not the task of accurately classifying objects useful in and of itself? For example, how would you build said robot that can manipulate objects in a useful fashion if it cannot recognize the objects in its vicinity?

    19. Re:I could be wrong... by Tablizer · · Score: 1

      You are full of 483027!

    20. Re:I could be wrong... by Zordak · · Score: 1

      Perhaps the news is that someone from Utah accepts the principles of evolution?

      That's cute and all. But my brother, who is a devout Mormon, got an MS in evolutionary biology. At BYU.

      --

      Today's Sesame Street was brought to you by the number e.
    21. Re:I could be wrong... by smallfries · · Score: 1

      Your logic is flawed.

      By splitting object-recognition into two cases...
          A: Atomic shapes
          B: Collections of shapes ... you have not proven that algorithms cannot perform object-recognition. You still need to show that one of the cases cannot be performed by an algorithm. As case A is trivial, and case B is what this algorithm does your argument falls apart. Collections of shapes can be recognised by probability of occurrence. There is no need for interactivity, simply enough video to reduce the impact of outliers.

      --
      Slashdot: where don knuth is an idiot because he cant grasp the awesome power of php
    22. Re:I could be wrong... by ozmanjusri · · Score: 1

      73 68 69 74

      --
      "I've got more toys than Teruhisa Kitahara."
    23. Re:I could be wrong... by fatphil · · Score: 1

      And a human who looks at a bike and says "that's a nice collection of different parts" isn't doing "useful recognition" either, in the eyes of most people.

      --
      Also FatPhil on SoylentNews, id 863
    24. Re:I could be wrong... by timeOday · · Score: 1

      If you used video, rather than images (or frames from images taken in isolation), and the video showed how things are used, then you could get somewhere. For example each grape in a bowl of grapes is an "object" for eating purposes whereas each bump on a raspberry is not, despite how visually similar those are.

  2. Bah ... by gstoddart · · Score: 1

    Let it loose at the Adult Entertainment Expo.

    If it can figure out what half of that stuff is, it's a brilliant algorithm.

    If not, it will probably be hilarious to see the results.

    --
    Lost at C:>. Found at C.
    1. Re:Bah ... by K.+S.+Kyosuke · · Score: 2

      If not, it will probably be hilarious to see the results.

      Let me check...BYU...sex toys...yes, it probably would!

      --
      Ezekiel 23:20
  3. Enhanced reality by Gaygirlie · · Score: 2

    I know it's popular for people to immediately start with all the Terminator-claims and whatnot, but that's not the first thing that comes to my mind when reading stuff like this. Personally, I think of coupling this with something like e.g. Google Glass, so that you can tell the system to identify the item in the center of the view and then ask for it to automatically search for instructions on use or repair or whatnot. Even better if you have a device that covers both of your eyes so that the system can overlay things in your whole visual field, identifying things and showing their connections and whatnot.

    1. Re:Enhanced reality by icebike · · Score: 2

      Like I've said in the past, mankind simply can't seem to stop itself from building Skynet piecemeal. Too dumb and trusting to think all those interesting things could ever be made into weapons or instruments of control.

      --
      Sig Battery depleted. Reverting to safe mode.
    2. Re:Enhanced reality by Charliemopps · · Score: 1

      Governments are already building them into weapons. The question is, are we going to have the same arsenal? All this tech is coming, we can't just stick our heads in the sand and hope for sane competent leadership when it does arrive.

    3. Re:Enhanced reality by barlevg · · Score: 1

      Why does everyone assume that our AIs are going to turn into Skynet? Why couldn't we end up with Tachikomas?

    4. Re:Enhanced reality by MetalOne · · Score: 1

      If they are sentient, and require the same resources as humans, and are more intelligent than humans, it seems safe to assume they will want all the resources for themselves. If they are smarter, then its not hard to imagine them attempting to eliminate humans.

    5. Re:Enhanced reality by icebike · · Score: 1

      But we can demand technology kill switches.
      Just as security was bolted onto the internet to make up for the lack of it being designed in, we shouldn't find ourselves in a position of having to bolt security onto our televisions, cars, and robotic servants.

      This particular algorithm has a lot of uses. We'd want that garbage sorting automaton to the entire system stop dead in its tracks when a human hand came through in the stream of cans and bottles and waste paper being dumped into the maw of a waste sorting facility. But we don't want machines roaming the streets looking for what might be an enemy soldier, and trying to distinguish between that and someone hanging the wash on the line to dry.

      --
      Sig Battery depleted. Reverting to safe mode.
  4. Evolution at BYU by Anonymous Coward · · Score: 1

    At least there's one professor at BYU that believes in evolution!

    1. Re:Evolution at BYU by ComfortablyAmbiguous · · Score: 5, Informative

      At least there's one professor at BYU that believes in evolution!

      I understand why it might be tempting to put BYU in a basket along with the rest of the evangelical christian universities. However, on the issue of evolution it could not be more different. I graduated from there with a degree in microbiology and my college at least evolution was the coin of the realm, just like it is in any serious biology department. I did not have a single professor that did not see evolution as you might expect a biologist to see it; as the only serious explanation of the data at hand, the only theory that works with what we know and provides valid predictions of future results. Not once did I hear even the smallest bit of credibility being given to creationism or its various variants (intelligent design, etc).

      And yes, my professors were all Mormons. You might ask yourself how they square this. It turns out that while there are certainly Mormons that take a very literal reading of the bible on this issue, that is not the official church position, and there are many members that don't see it that way at all. Basically I had several professors that explained it as religion was about how to live life, science was about how life works, and we really have no idea how the two come together. The bible, while providing a lot of information to believers on a moral life, provides no real information on how the world works in any of the scientific fields.

      Interestingly, many believe this is on purpose, that God has no interest in proving his existence; it's a matter of faith for a reason. Because of this He stays out of offering scientific explanations. I realize that sounds distinctly like a cope-out, but frankly it leads to a fairly rational place where you can function as a scientist an still be a Mormon. And by function I don't mean some half-way hands over eyes sort of a way, but in a real, go where the evidence takes you sort of a way.

      Take it for what it's worth, but that was my experience

    2. Re:Evolution at BYU by DownWithTheMan · · Score: 2

      I graduated from the Y too - and while most of my professors were not irrational about science, much of the student body was. I had a professor in a 100 level geology class who would start off most of his lectures by saying, "Now I know for some of you, your testimonies may tell you the earth is only such and such many years old. I'm not here to rock your testimonies or shake your faith, but simply to present scientific evidence as we understand it today."

      I laughed every time he had to make a disclaimer to the believers about the validity of his lectures (and then face-palmed myself for going to a school where so much of the student body sticks their heads in the sand).

    3. Re:Evolution at BYU by ComfortablyAmbiguous · · Score: 1

      Yea, I expect if you signed up for biology you tended to get over that pretty quick, or generally dislike your life. It's easier to have an irrational viewpoint about science as an English major where you don't have to face it to function each day.

    4. Re:Evolution at BYU by smoothnorman · · Score: 1

      "testimonies"? ...is that some specialized mormon terminology like being 'sealed' rather than married? i've read endless screeds about how one can make religion and science happily co-exist. but in the final analysis, it can't happen; at least not with standard faith-based religions. science essentially demands that nothing can be taken on faith; and religion essentially demands that anything important (the root of one's philosophical tree, if you will) must be taken on faith. if you're a faithful you cannot be a clear-minded scientist. i know this will be tediously countered, but faith is anti-science, and faith is the basis of religion.

    5. Re:Evolution at BYU by fishybell · · Score: 1

      Indeed. "Testimonies" are very much along the lines of "I testify that I hold X/Y/Z ideas on faith." Every month (usually the first Sunday of each month) there is a special meeting fast and testimony meeting where members of the congregation get up and "bear their testimony." As a kid growing up with a dad teaching at BYU, these Sundays were the worst. They often dragged on longer than normal not just because church service ran longer, but the fasting portion of "fast and testimony" meant we were hungry all day until dinner.

      --
      ><));>
    6. Re:Evolution at BYU by ComfortablyAmbiguous · · Score: 1

      I suppose this depends on a number of things, and perhaps in the end you may be right. But at the moment there really isn't a clear conflict; the conflict is more manufactured than real, especially if you see religion as a road to life happiness and not an explanation of all things. I admit that there is a certain about of dealing with ambiguity that is required. Frankly, I tend to be much more of an agnostic or a deist than your average Christian. I tend to believe that my life is mine to live, there is such a thing as a good way to live life from a happiness perspective, and my religion provides some guidance along those lines, but ultimately I have to figure it out for my own life

      So far as science is concerned I tend to think that we are very, very far from a complete understanding of the universe. There are so many things that we simply don't understand that I don't worry too much about conflict between the possibility of the existence of a God and what science is telling me. The evidence is what it is, we build theories to understand and predict it, and we use those to move forward, but I don't kid myself thinking that we have a complete understanding of the world around us. We will be working for a long time yet to get there.

      You could make an excellent argument you can only be clear minded about science or religion. That is to say, if your world is evidence based but you are willing to work with things where there is no evidence I think you can still be a clear minded scientist. On the other hand if you put assertions without evidence in the first place and try to work science around it you're going to have problems.

      If the religion is really real, the first approach will leave the two in agreement in the end, but if it is not true you aren't really in a bad place when you can see the whole picture. If you adopt the other approach inevitably you will end up with some kind of conflict that just doesn't leave room for thinking.

    7. Re:Evolution at BYU by smoothnorman · · Score: 1

      that reply is of the "but Einstein believed in God" sort. whereas i stated that religion is based on faith and faith is inconsistent with science. i did not state that someone who currently is willing to believe that a god is possible (even probable) cannot do good science; just that they cannot hold this belief in the face of contrary evidence, which is to say faith. faith accepts no evidence and cannot be placed aside for evidence. so "real science" (as you introduce the term) is entirely inconsistent with "real faith" (as you introduce the term). they are philosophically orthogonal concepts.

    8. Re:Evolution at BYU by kwbauer · · Score: 1

      So you, personally, have performed every experiment ever done? Or are you trusting (having faith) that somebody a bit smarter and/or with more resources than you has done so and not lied to you?

    9. Re:Evolution at BYU by ComfortablyAmbiguous · · Score: 1

      It's easy enough to compare. It was not my last degree in sciences (others not at BYU), and I work in the field. Even during my undergraduate at BYU I had friends at several other significant universities, including MIT and Princeton. I took time off to spend a few week with each attending classes. I'm not looking at this from an isolated perspective.

  5. On the fly, but.... by fatgraham · · Score: 3, Insightful

    Does it work in real time? I can't find any more information than marketing buzz in the article (and the BYU article)...

    Is there a paper or anything with a bit more [technical] detail?

    1. Re:On the fly, but.... by FriendlyStatistician · · Score: 2
    2. Re:On the fly, but.... by pmontra · · Score: 1

      I wonder... do they get paid to publish in those paywalled publications or they do it for free? Do they keep the copyright? If they do, why not publishing the article on the university site?

    3. Re:On the fly, but.... by FriendlyStatistician · · Score: 1

      Academic journals traditionally require the authors to assign the copyright to the publisher. The authors do not get paid directly, but publications are an important factor in tenure decisions and general academic prestige--"publish or perish."

      Some journals allow the authors to post the paper on their website, and some journals which do not technically allow it have generally ignored it in the past, but some publishers have been cracking down on the practice recently.

  6. Here's what I hope they get by GoodNewsJimDotCom · · Score: 1

    I would hope they'd get a sensor that would be able to identify new objects. Maybe let a robot pick it up, spin it around, get a 3d digitization model of the object then label it something temporary until someone tells it what it is. A quick look at how AI is probably going to be done when all the techs come together

  7. Paper? by StripedCow · · Score: 2

    Anyone got a link to the actual paper?

    I wonder if this can be used for image compression. Because if you know e.g. what a bicycle looks like, you don't have to compress it.

    --
    If Pandora's box is destined to be opened, *I* want to be the one to open it.
    1. Re:Paper? by wagnerrp · · Score: 3, Informative

      Data compression is often considered to be a key component of artificial intelligence. There is a competition that gives out prizes for compression of a sample of the Wikipedia database.

    2. Re:Paper? by Lamps · · Score: 1

      Is this the one? It doesn't appear that the researchers have posted a manuscript, and I'm not sure that Elsevier would take kindly to it if they posted the published draft (although many researchers do so anyway). That, along with a lack of public interest in reading articles upon which pop science articles (like the one in the link) are based, probably explains the lack of a link or reference to the original article. If you have access to a library that subscribes to Pattern Recognition, you can get the article.

  8. Not new by benob · · Score: 1

    Nothing is performed on the fly. It's just another feature extraction and selection pipeline.
    1) Deep Neural Networks also save the feature engineering step (for instance http://media.nips.cc/nipsbooks/nipspapers/paper_files/nips26/1210.pdf)
    2) If as suggested by the title you are interested by on-the-fly object recognition, look at Tracking-Learning-Detection (TLD) (http://info.ee.surrey.ac.uk/Personal/Z.Kalal/tld.html)

  9. Hope it will not fail Tranny or Female test by Anonymous Coward · · Score: 1

    Hope it will not fail "Tranny or Female" test

  10. On the fly? by wonkey_monkey · · Score: 1

    New object recognition algorithm learns on the fly

    I know wearable computing is the next big thing but putting one there - especially if it has a camera attached - is going to look a little bit... weird.

    --
    systemd is Roko's Basilisk.
    1. Re:On the fly? by maxwell+demon · · Score: 1

      No, they are making very small devices you'll not notice on the fly. And they'll add circuits to control the fly. The result will be a biological espionage drone which nobody will suspect.

      However people will try to kill it anyway.

      --
      The Tao of math: The numbers you can count are not the real numbers.
  11. *Sigh* by Wootery · · Score: 3, Interesting

    notable in that it decides for itself what features of an object are significant for identifying the object and is able to learn new objects without human intervention

    For Christ's sake. The AdaBoost face-detection algorithm - the one that everyone uses today - does precisely this, and was developed in the the 90's.

    1. Re:*Sigh* by Wootery · · Score: 1

      ...that's right, the the 90's...

    2. Re:*Sigh* by Wootery · · Score: 1

      No, all its knowledge about what constitutes a face is learned.

      There's a 'training' process, where the algorithm is fed a set of images of faces and another set of non-face images, and from there the algorithm determines what features it should be looking for to determine face from non-face.

      AdaBoost does face detection (is this a face?), not recognition (whose face is this?), however, so it's not quite as impressive as the algorithm in TFA, which is able to recognise lots of different types of objects.

    3. Re:*Sigh* by Wootery · · Score: 1

      Indeed. My issue was with the poor reporting, not with the actual research.

  12. PDF or it did not happen by jopet · · Score: 3, Insightful

    Why should I get excited about something written by a journalist where there must be something writeen by scientists? Where is the PDF of the scientific paper to download?

  13. What is the novelty of this algorithm? by Lamps · · Score: 1

    First of all, is this the right paper?

    It seems that the topic of the linked article is a new unsupervised algorithm that categorizes images. The linked article says that 'the Evolution-Constructed Features algorithm is notable in that it decides for itself what features of an object are significant for identifying the object', which unsupervised algorithms do implicitly, no? It is also stated that the algorithm 'is able to learn new objects without human intervention' - so if I'm interpreting this and the article's abstract correctly, the algorithm uses a novel approach to coding some sort of more or less raw image data which it receives as input? Otherwise, it appears that what makes the approach newsworthy is its extremely high accuracy, which was 95 to 100% on some measures. That sounds very good if the tests were representative of a real-world environment.

  14. actual link to paper by Anonymous Coward · · Score: 3, Informative

    team,

    fyi: http://contentdm.lib.byu.edu/utils/getfile/collection/ETD/id/3021/filename/503.pdf

    -me

    1. Re:actual link to paper by pmontra · · Score: 2

      This is the paper. Please mod it up.

  15. Need better examples by Tablizer · · Score: 1

    Perhaps if this was explained in terms of an example whereby you describe how existing AI uses or learns the training set and how the newfangled way does it different.

  16. Sounds like NEIL by jrincayc · · Score: 1

    This sounds a lot like the Never Ending Image Learner project: http://www.neil-kb.com/ which is crawling the web and trying to extract visual knowledge.

  17. Mild Sensationalism by AiTuDou · · Score: 1

    Looks like a bit of click-bait sensationalism by Gizmag. This algorithm is a couple of years old, the new research is just related to a new paper on domain specific usage (classifying fish). It's an unsupervised genetic algorithm, that uses basic image processing steps as the genes, hence Gizmag trying to tout it as 'learning on its own'. It's a cool technique outright, but not as world changing as they make out.