Slashdot Mirror


Breakthrough In Face Recognition Software

An anonymous reader writes: Face recognition software underwent a revolution in 2001 with the creation of the Viola-Jones algorithm. Now, the field looks set to dramatically improve once again: computer scientists from Stanford and Yahoo Labs have published a new, simple approach that can find faces turned at an angle and those that are partially blocked by something else. The researchers "capitalize on the advances made in recent years on a type of machine learning known as a deep convolutional neural network. The idea is to train a many-layered neural network using a vast database of annotated examples, in this case pictures of faces from many angles. To that end, Farfade and co created a database of 200,000 images that included faces at various angles and orientations and a further 20 million images without faces. They then trained their neural net in batches of 128 images over 50,000 iterations. ... What's more, their algorithm is significantly better at spotting faces when upside down, something other approaches haven't perfected."

142 comments

  1. Upside Down? by Anonymous Coward · · Score: 5, Insightful

    "What's more, their algorithm is significantly better at spotting faces when upside down, something other approaches haven't perfected."

    Add this step: Rotate the image and run the algorithm each x degrees. What am I missing?

    1. Re:Upside Down? by Anonymous Coward · · Score: 0

      lololol

    2. Re:Upside Down? by kekx · · Score: 5, Insightful

      Performance.

    3. Re:Upside Down? by Anonymous Coward · · Score: 0

      I was waiting for this. So "better at spotting faces" has nothing to do with accuracy in this case? Rather than "better" it should be "more efficiently" (a type of being better)? I looked at the paper and did not see where "performance" was defined or any hint as to what units it has. How is performance calculated? I see they compare "precision" to "recall".

    4. Re:Upside Down? by idontusenumbers · · Score: 2

      False positives

    5. Re:Upside Down? by schlachter · · Score: 1

      a worse case scenario of x4 times worse performance...and/or battery life if working on a mobile.

      --
      My God can beat up your God. Just kidding...don't take offense. I know there's no God.
    6. Re:Upside Down? by binarybum · · Score: 2

      We are finally going to catch this guy!! - http://img.izismile.com//img/i...

      (the problem is the background - your brain is very good at understanding what upside-down means, but an algorithm trained by seeing tons of right-sided up images only understands that a silo is rounded on top and straight on the bottom. - The question I have, is what are the pratical implications of all the extra processing power that might take? Finally figuring out who that gymnast was from that circ-du-soleil screenshot? )

      --
      ôó
    7. Re:Upside Down? by baker_tony · · Score: 1

      I looked at the paper and did not see where "performance" was defined or any hint as to what units it has. How is performance calculated? I see they compare "precision" to "recall".

      From the article: “We evaluated the proposed method with other deep learning based methods and showed that our method results in faster and more accurate results,”

      Therefore, I'd say that it's doing more than just rotating the image and re-running the algorithm, but you stick to doing that, it's cool.

    8. Re:Upside Down? by Anonymous Coward · · Score: 0

      It takes practically zero performance to rotate an image.

    9. Re:Upside Down? by Anonymous Coward · · Score: 0

      I am sure performance is just jargon for something real. What is the actual definition?

    10. Re:Upside Down? by Loconut1389 · · Score: 1

      do it in parallel in hardware. There are FPGA and ASIC solutions that can do hardware rotation, just send one through the rotate matrix into identical hardware. It costs twice as much, but in todays terms that still shouldn't be too bad.

    11. Re:Upside Down? by Anonymous Coward · · Score: 5, Interesting

      As someone who literally works on face detection/tracking software on low power ARMv7/8 CPUs, I can safely say you are dead wrong.

      Assuming width==height (not likely given any current video formats or cameras), and assuming width%8 == 0 - it's a simple transposition of the rows and/or columns to do +/- 90/180 degrees, yes - and assuming you can fit your ENTIRE image in L1 cache you're going to incur minimal stalls (especially with an SoC that has a decent prefetch engine).

      In reality:
        * width != height
        * width is however typically divisible by 8 so you can do pure NEON (not hybrid NEON + ALU/VFP) transpositions
        * an 8bit grayscale VGA (640x480) image doesn't even fit in L1 cache, let alone a 720/1080p format (though most CV applications scale things down significantly, you tend to work at 320x180 - but that still doesn't fit in most L1 caches, although it does fit in 'some')
        * L2 cache hits are dozens of cycles, L2 cache misses are HUNDREDS of cycles
        * A real world case of rotating a 320x180 image takes ~2ms on a 700Mhz Cortex A9, that is not 'practically zero', that's 12% of your processing time at 60Hz - 36% of your processing time if you're going to rotate 3 times.

      (Note: using 700Mhz Cortex A9 as an example as that's typical in automotive hardware systems we typically deal with, although the last 2 years has brought ~1-1.5Ghz A15's into the mix - though most of those cars aren't even on the market yet)

    12. Re:Upside Down? by Anonymous Coward · · Score: 0

      Practically all image processing ASIC in ARM SoCs has a latency of tens to hundreds of milliseconds (long pipelines), you tend to end up with similarly large latencies w/ an FPGA unless you want to dedicate the ENTIRE FPGA to 'just' rotating images (since you trade space for latency just like the ASIC does).

      Tens of milliseconds is 'sometimes' acceptable depending on your application, however hundreds rarely is in computer vision cases - especially in automotive when they're being used for things like collision avoidance, lane departure, and driver fatigue management.

    13. Re:Upside Down? by Anonymous Coward · · Score: 0

      Thank you. So how is performance defined in this field? Your comment makes it appear that memory is more important than processing time. I at first thought it would be some ratio of accuracy/time but now I am doubting that.

    14. Re:Upside Down? by Anonymous Coward · · Score: 0

      >> Finally figuring out who that gymnast was from that circ-du-soleil screenshot?

      Easy, just ask child protective services. They are all under 12 anyway you perv.

    15. Re:Upside Down? by mcrbids · · Score: 2

      There's lots that you are missing.

      The issue isn't the input data, it's the processing method. The processing method mentioned here as "revolutionary" is just about exactly the method that Raymond Kurzweil posited: a hierarchy of "nodules" that pattern match on a cascading network of pattern matches....

      We're living with a modern-day Turing. Do we give him ample credit?

      --
      I have no problem with your religion until you decide it's reason to deprive others of the truth.
    16. Re:Upside Down? by Anonymous Coward · · Score: 1

      Finally! We can bring the benefits of surveillance to southern hemisphere countries...

    17. Re:Upside Down? by Anonymous Coward · · Score: 3, Informative

      'Performance' is indeed an ambiguous term, it can refer to accuracy (RMS error of the detection results and false positive/negative rates in most cases) and it can also refer to speed (which I'm biased to thinking of as a programmer).

      I've never seen both meanings used in some combined metric, from an algorithmic perspective you tend to only care about accuracy as the 'performance' metric - and from a production perspective you (typically) care about 'speed' as the performance metric.

      On most ARM systems, you're correct - memory is almost always the bottleneck (ARMv7 processors are actually quite fast, IF you can keep them processing instructions every cycle, which is very hard if not impossible depending on the algorithm). Memory allocations take tens to hundreds of microseconds (scales up to milliseconds sometimes for large allocations, depending on the memory configuration and how the SoC's memory controller is designed), and loads from DDR (not from cache) take hundreds of cycles or more, and if they're an immediate dependency of the code (Eg: you issue a load into a register, which is used a few cycles ahead) - you're stalling your entire core for however long the memory controller takes to bring it through the MMU (into cache) and finally into your register.

      This is compared to a typical desktop/laptop with DDR frequencies typically over double that of LPDDR, and L2 caches that are large enough to run entire applications in (without ever touching DDR) in some cases... and when all else fails, gigantic x86 CISC cores who don't have to stall the entire pipeline when waiting on a DDR load and can opportunistically 'continue' processing code further down the road while it waits for memory.

      Meanwhile, if the core wasn't stalled from a load - hundreds of cycles can typically 'process' (various algorithms fit into this footprint) hundreds of pixels using NEON instructions against 8bit (or dozens of 32bit) pixels - so hopefully that puts it into perspective (a single memory stall can cost you the time it takes to process 10-100 pixels, very roughly) - and most algorithms do 1+ loads (that may stall depending on how things are written/prefetched/etc) per N pixels in NEON code.

      I know we internally make our researchers very much aware of the pros/cons of various algorithmic approaches (they're vaguely aware that gather/scatter memory operations are hard/impossible to optimise - so things like doing too many histograms are avoided if possible, they're aware of alignment considerations, they're aware memory loads/stores/allocations are extremely costly, and most of them even know a bit of SIMD, though most don't care enough to understand cycle counts of instructions / cache considerations / how prefetching works / why branching isn't ideal in some micro-archs / etc) - but from their perspective, they still 'just' care about accuracy - not performance (they'll generall design for performance, and make trade offs for performance if it's significant - but generally they're aiming for accuracy).

      When their research code hits our (programmer) desks, we tend to care about speed - while holding true to the original algorithm.

      Side note: You may want to forgive your phone OS when it feels slow next time, it's got apps trying to run 'with' an OS (or worse, java vm) constantly clobbering the L1/L2 data caches - we have a hard enough time in the automotive industry running baremetal code or very lean RTOS'.

    18. Re:Upside Down? by Loconut1389 · · Score: 1

      I'm not sure I see why you couldn't do a rotate of an image in one clock cycle since it's a precomputed 1:1 mapping of source address to destination address with no math involved (eg not like doing keystone correction or other manipulations). I can't imagine that taking tens of milliseconds?

    19. Re:Upside Down? by Anonymous Coward · · Score: 0

      Slight amendment, by 'speed' we typically measure in instructions-per-cycle (which is almost always less than 1.0 unless you can literally keep your CPU churning 'and' can keep 'both' the ALU (integer) core and VFP (floating point/NEON) coprocessor processing instructions in parallel - though that's very much a 'perfect world' scenario that doesn't fit many algorithms).

      Alternatively, milliseconds is also used when producing numbers for higher-ups and non-technical thirdparties.

    20. Re:Upside Down? by Loconut1389 · · Score: 1

      following up to myself- I was thinking of 180 degree or 90 degree fixed rotations (summary talked about being upside down), but it looks like these types of systems use varying rotations which makes sense. eg: http://citeseerx.ist.psu.edu/v...

    21. Re:Upside Down? by Anonymous Coward · · Score: 0

      (not the same AC you replied to) When memory is the bottleneck, performance is generally measured in terms of bandwidth... the number of bytes per second processed. Accuracy is a separate dimension that you don't want as part of your performance measure. Some algorithms are able to trade accuracy for performance or vice versa.

      It's simple to say "just rotate every image" but that's at least 4x more work (not even counting the actual rotation). And why stop at 90 degree rotations? For that matter, why stop with just rotations? What about shears or fish-eye distortions or why not tweak the brightness or contrast or whatever, and process those as well? That's just a brute-force approach. All your doing is massively multiplying the amount of work to do per image. If you try enough transforms, you can find a way to transform an image to match some reference image, but that's not going to be a useful approach. Instead the vision system needs to be be able to judge when to "derotate" or "deskew" an image and only do it then.

    22. Re:Upside Down? by Anonymous Coward · · Score: 0

      What about just reading the image in different order, and not rotate it?

    23. Re:Upside Down? by Anonymous Coward · · Score: 0

      Image rotation with an arbitrary angle is a linear transform that can be implemented in hardware by having an addressing mode with separate fractional x and y offsets that are stepped at a fixed amount (per frame) per pixel.
      It costs something in the line of ten logic gates per address bit to implement in hardware. Depending on your CPU you might be able to skip the FPGA part and get the same function by having a memory attached with the lower address signals from the CPU left unconnected.

    24. Re:Upside Down? by Anonymous Coward · · Score: 0

      don't be silly. Leave the picture alone. just rotate the algorithm.

    25. Re:Upside Down? by sergueyz · · Score: 1

      Divide your image into blocks of 16x16 and all of sudden (local) transposition is much faster.

    26. Re:Upside Down? by hawkfish · · Score: 1

      It takes practically zero performance to rotate an image.

      You must be a web programmer...

      --
      You will not drink with us, but you would taste our steel? - Walter Matthau, The Pirates
    27. Re:Upside Down? by Anonymous Coward · · Score: 0

      I heard Kurzweil invented the smartphone. It turns out the Singularity will actually be caused by the cumulative effect of billions of soccer moms playing the latest version of Candy Crush, creating a hole in space-time which swallows the planet.

    28. Re:Upside Down? by Anonymous Coward · · Score: 0

      I'm guessing that what they mean is that the algorithm can detect faces in any orientation (or a variety of orientations), but it performs best when the faces are upside down.

      This does leave me wondering though. Surely most pictures of faces are at least somewhat the right way up. Surely it's better to turn the algorithm upside-down and have it detect right-way-up faces more easily, because that's probably more useful. Most algorithms are fairly robust and will not fail when mounted in unusual orientations. Just make sure all the loops are secured in place properly from the outset, and they're very unlikely to fall off, even after enduring the vibrations of many iterations.

    29. Re: Upside Down? by Threni · · Score: 1

      Uh..you might not know it's upside down, smart arse. So you'd have to try it in both rotations. These people are probably smarter than even you; why not sit down, shut up and learn something?

    30. Re:Upside Down? by Anonymous Coward · · Score: 0

      haha

    31. Re:Upside Down? by duhjim · · Score: 1

      "What's more, their algorithm is significantly better at spotting faces when upside down, something other approaches haven't perfected."

      Add this step: Rotate the image and run the algorithm each x degrees. What am I missing?

      That this is also true for all of us humans when we exit the womb?

    32. Re:Upside Down? by Anonymous Coward · · Score: 0

      Thank You. I did not mean to not respond but such is the way.

    33. Re: Upside Down? by Anonymous Coward · · Score: 0

      I have studied this to sone extent and think it is likely a result of information difference. Human faces are moving objects that have a lot of depth/color information discrepancy between the eyes. Babies learn to associate the sound of their mother's voice with the complex depth/color information of the face. We just anthropomorphize their behavior.

    34. Re:Upside Down? by Anonymous Coward · · Score: 0

      You're basically telling that he's "dead wrong" because doing 360/x time the same operation is not that longer than doing it 1 time, and then you argument by explaining that in the ideal case the rotating algorithm, which is another thing you must run 360/x time, is fast.

  2. so breakthrough by Fwipp · · Score: 1

    "Breakthrough in face recognition software"
    "The idea is to train a many-layered neural network using a vast database of annotated examples"

    How novel.

    1. Re:so breakthrough by Tablizer · · Score: 1

      It begs the question: why were they using few layers and skipping annotation in the past? The hardware couldn't handle it? They were too lazy to implement such? They needed a Flux Capacitor to make them work together? The boss didn't like the "look and feel" of the diagrams? It crashed Windows XP?

    2. Re:so breakthrough by kylemonger · · Score: 1

      The annotations were probably more useful features such as distance to the subject, angle of head tilt, or principal lighting angle, lens focal length. Train a net to recognize the shape of heads tilted at various angles and you've gone a long way toward recognizing faces tilted at those angles. Now you can train separate networks to recognize faces at each specific angle or small range of angles. The same for dealing with varied distances and lens focal lengths.

    3. Re:so breakthrough by ceoyoyo · · Score: 2

      There wasn't a good algorithm for training general deep ANNs until 2006, although convolutional neural networks were an exception to that. It's likely nobody tried it before because computers weren't fast enough and the discovery of layer-wise unsupervised training hadn't made deep networks popular yet.

    4. Re:so breakthrough by tmosley · · Score: 4, Informative

      It seems to me, as I have been following the progress of the technology over the last year or so, that it was only recently that scientists either had the idea to layer networks on top of one another, or gained the ability to. This started with the algo that would analyze pictures for content and tag them, ie a picture of a girl playing with a dog was tagged as such. It was approaching primate-level "cognition" in that specific context a few months ago, but now I have read that it has reached or surpassed peak human level, where rather than labeling the dog as a dog, it labeled it as its specific breed, or labeled a flower as its specific type that I had never heard of. Combining that with this new data point, it would seem that visual perception in machines has exploded into post-human territory. Shit is getting real.

    5. Re:so breakthrough by hughperkins · · Score: 4, Interesting

      They're using a standard technique. Convolutional networks started to become big with LeCun's 1998 paper on learning to recognize hand-written digits http://yann.lecun.com/exdb/pub... . His lenet-5 network could identify the digit accurately 99% of the time.

      Convolutional networks are starting to become used to play Go, eg 'Move evaluation in Go using Deep Convolutional Neural Networks', by Maddison Huang, Sutskever and Silver, http://arxiv.org/pdf/1412.6564... Maddison et al used a 12-layer convolutional network to predict where an expect would move next with 50% accuracy :-)

      Progress on convolutional networks moves forward all the time, in an incremental way. If we had one article per day about one increment it would quickly lose mass appeal though :-) The article is about one increment along the way, but does symbolize the massive progress that is being made.

      Convolutional networks work well partly because they can take advantage of the massive computional capacity made available in GPU hardware.

    6. Re:so breakthrough by Anonymous Coward · · Score: 0

      It begs the question: why were they using few layers and skipping annotation in the past? The hardware couldn't handle it? They were too lazy to implement such? They needed a Flux Capacitor to make them work together? The boss didn't like the "look and feel" of the diagrams? It crashed Windows XP?

      If you don't immediately know it was ''The boss didn't like the "look and feel" of the diagrams.', you have never worked in the corporate world.

      If you do work in the corporate world and still remain that blissfully ignorant, thank the stars, send your boss much deserved flowers and thank them for taking the soul hits for prioritizing useless board of director pleasing executive ego boosting over stated goals of said executives then distilling that into an actual business case so you don't have to.

      Citation: fickle - just like all executives I've encountered.
      http://blog.wcgworld.com/wp-content/uploads/2013/09/Dilbert.jpg

    7. Re:so breakthrough by Anonymous Coward · · Score: 0

      Show diagram to superiors, build something entirely different.
      (No one will know anyway!)

      Bosses are happy, the software works. Everyone wins.

      Is lying bad, if it enables everyone to gain?

    8. Re:so breakthrough by Anonymous Coward · · Score: 1

      Attention technologists: quit inventing stuff that enables corporations and governments to spy on people!!!

  3. This is supposed to be a good thing? by Snotnose · · Score: 4, Insightful

    For every "terrorist" they track through the mall, how many ordinary Joes like me who like their privacy are also tracked and stored in huge databases for all time?

    1. Re:This is supposed to be a good thing? by Scorpinox · · Score: 2

      Yeah, I was surprised there was no mention of the huge privacy implications this has. But hey, maybe this'll reduce the number of IDs and RFID cards you have to carry around since it'll be so easy to identify and track you when you're just walking around.

    2. Re:This is supposed to be a good thing? by RoknrolZombie · · Score: 4, Insightful

      All of them.

    3. Re:This is supposed to be a good thing? by Anonymous Coward · · Score: 4, Insightful

      I think it's pretty well understood that there *are* terrorists...

      Yes.

      ... and a lot of them ...

      By almost every measure: No.

      ...and they're walking among us.

      For virtually every useful North American or Western European definition of 'us': No.

    4. Re:This is supposed to be a good thing? by Jack+Griffin · · Score: 5, Insightful

      I think it's pretty well understood that there *are* terrorists and a lot of them and they're walking among us.

      I disagree with this statement. If there were even a handful of real terrorists amongst us, there'd be blood in the streets. Seriously, if you really are hell bent on murdering infidels, it's not hard to drive a bus into a pack of school children, or carry a tin of petrol and a lighter into your nearest train station. That's the nature of terrorism, it is so trivial to execute that the threat is equally trivial to measure. See the history of the IRA for real world examples.

    5. Re:This is supposed to be a good thing? by retroworks · · Score: 3, Informative
      "For every "terrorist" they track through the mall, how many ordinary Joes like me who like their privacy are also tracked and stored in huge databases for all time?"

      Indeed, all of them.

      Have you noticed you can go into Best Buy or Staples, pick up a camera or look at a printer you never searched for online, and you find ads for the device on Facebook? Didn't notice? Give it a try. It's far beyond this 2013 (minority) report http://www.businessinsider.com...

      --
      Gently reply
    6. Re:This is supposed to be a good thing? by gstoddart · · Score: 1

      how many ordinary Joes like me

      Why, all of them, of course.

      And should you ever commit a crime we will be able to retroactively find the evidence for your trial. If you really piss us off we'll edit the video record and call it parallel reconstruction.

      In a few years, the pre-cog program will come online, but the surveillance is here to stay.

      Now stop picking your nose, citizen.

      --
      Lost at C:>. Found at C.
    7. Re:This is supposed to be a good thing? by viperidaenz · · Score: 2

      It's recognition, not identification.
      As in a yes/no if an image contains a face. No who is in the image.

    8. Re:This is supposed to be a good thing? by Jeremi · · Score: 1

      It's kind of beside the point whether it's a good thing or a bad thing. No doubt it will have some combination of good and bad effects, but regardless of what the effects are, the cat is out of the bag -- the algorithm is invented and it's not going to go away. And if these guys hadn't invented it, somebody else would have. The only question that remains is how society ought to react to its existence.

      --


      I don't care if it's 90,000 hectares. That lake was not my doing.
    9. Re:This is supposed to be a good thing? by mtm_king · · Score: 1

      I wonder how this got 3+ mod points.

      --
      world was created 5 seconds before this post as it is.
    10. Re:This is supposed to be a good thing? by Anonymous Coward · · Score: 0

      Probably because anyone not as deluded as yourself knows it to be true?

    11. Re:This is supposed to be a good thing? by Anonymous Coward · · Score: 0

      Terrorists don't frequent malls except for a photo-op. They aren't the ones getting tracked, they're the ones tracking.

    12. Re:This is supposed to be a good thing? by Anonymous Coward · · Score: 0

      I don't get the requirement for software to tackle upside down images better. If it's designed for detecting terrorists, and they're "walking" around on their hands to avoid detection, this system seems needlessly complex.

    13. Re: This is supposed to be a good thing? by Anonymous Coward · · Score: 0

      In most of Europe carrying your ID with you is mandatory. And yes, they live better than in the US. What's with this childish refusal to carry around a tiny piece of plastic?

    14. Re:This is supposed to be a good thing? by Anonymous Coward · · Score: 0

      Yeah, I was surprised there was no mention of the huge privacy implications this has.

      That is probably because that is the entire point of this field of research. It's like pointing out that weapon research can lead to more efficient killing of people.

      What I'm worried about is that this technology gets so good that the number of false positives becomes statistically insignificant.
      It sucks to be that one in a million when "Our records show beyond reasonable doubt that you were running away from the place of the murder." happens.

      Even worse to be a terrorist lookalike, if the system shows that a known terrorist have been spotted near a day care center you might be shot before someone figures out that you only were a false positive.

    15. Re:This is supposed to be a good thing? by JaredOfEuropa · · Score: 1

      It's just the first step in defeating anti-surveillance measures taken by terrorists.

      --
      If construction was anything like programming, an incorrectly fitted lock would bring down the entire building...
    16. Re:This is supposed to be a good thing? by Bing+Tsher+E · · Score: 1

      The question is whether we should allow government to scale to be big enough for it to be a powerful tool.

      We can clip some wings by not allowing ubiquitous cameras, or by limiting how big powerful global organizations can use the tech.

      It isn't inevitable due to the existence of the technology. The technology exists for mass low cost execution of people. We don't allow large overreaching organizations to execute people freely. It remains a rarely used technique. Restrictions on the scaling of face recognition technology can be imposed, too. The use of the tech can be limited, the network of data can be reserved for use in finding only really bad guys.

    17. Re:This is supposed to be a good thing? by drinkypoo · · Score: 1

      No, for that I'd have to go into a Best Buy or Staples, and then use Facebook.

      I kid, a bit, because I have actually been into a Staples recently, but since they were nowhere near having what I wanted or prices I would pay, I don't think I'll repeat that. I just needed one final reminder that it's a waste of my time.

      --
      "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
    18. Re:This is supposed to be a good thing? by Anonymous Coward · · Score: 0

      OR for real world real time examples see ISIS.

    19. Re:This is supposed to be a good thing? by Anonymous Coward · · Score: 0

      You're not my supervisor !

    20. Re:This is supposed to be a good thing? by JohnFen · · Score: 1

      Indeed. I am so torn over this. On the one hand, the technology is very cool. On the other hand, the inevitability of abuse seems to outweigh the benefits.

    21. Re:This is supposed to be a good thing? by JohnFen · · Score: 1

      Well, putting 'terrorist' in quotes isn't helpful.

      Considering what qualifies for the label "terrorist" these days, putting it in quotes isn't unreasonable.

      I think it's pretty well understood that there *are* terrorists and a lot of them and they're walking among us.

      While terrorists certainly exist, I don't believe for a moment that there are a lot of them walking among us. I think there's a very tiny number of them.

      It's the storing and processing that bothers me.

      I agree.

      If the government is just watching the crowd and identifying people because they're searching for them then I'm okay with that.

      This entirely depends on how they do it and what the false positive rate is.

      If they start building a database that tracks me over a lifetime then I have a problem.

      Then you have a problem, because that database exists and is tracking you for your entire life. It has existed for years now.

    22. Re:This is supposed to be a good thing? by penguinoid · · Score: 1

      I think it's pretty well understood that there *are* terrorists and a lot of them and they're walking among us.

      Indeed. In fact, in America, about half of all politicians thrive of terrorizing the public with threats of bodily harm, albeit indirectly because of drugs/criminals/pedophiles/illegal aliens/evil muslims/death panel obamacare/"they"/etc, arguing that you will only be safe once you give up your freedoms and start a new war. The other half of politicians thrive on terrorizing the public in a slightly different manner, arguing that you will only be safe once you give up your money. And the entire news media thrives on terrorizing everyone by greatly overplaying the significance of various violent and unfortunate events.

      Since terrorism is defined as

      noun: terrorism
              the use of violence and intimidation in the pursuit of political aims.

      it's pretty clear that all the above are terrorists and must be stopped. Most politicians use fear to convince people to vote for them, and most news media picks a political side and thrives on fear and sensationalization.

      --
      Don't waste your vote! Vote for whoever you want, unless you live in a swing state it won't matter anyways
    23. Re:This is supposed to be a good thing? by Anonymous Coward · · Score: 0

      There "are" terrorist. True. They all work in DC.

      Known terror cells. NSA, CIA, FBI, ATF, DEA DHS

  4. Spike boots by Tablizer · · Score: 5, Funny

    What's more, their algorithm is significantly better at spotting faces when upside down

    Rats, there goes my ceiling-walking bank-robbery plans.

    1. Re:Spike boots by BarbaraHudson · · Score: 2

      If you wore a mask that made your face not look like a face, it will ignore you.

      --
      "Transparent" is a shit show that trades on every stereotype going. A man in drag is NOT a transsexual.
    2. Re:Spike boots by Anonymous Coward · · Score: 0

      Anonymous mask power engage. Oh no. Guy Fawkes mask look like a face. What do. Script kiddie need instruction badly.

    3. Re:Spike boots by Jack+Griffin · · Score: 2

      Or a mask with someone else's face on it, Or a T-shirt with a few faces on it, or a baseball cap, or a burqha...

    4. Re:Spike boots by tmosley · · Score: 1

      The next one will recognize your gait.

      Crime is about o become completely impossible without the assistance of a specially trained AI assistant.

    5. Re:Spike boots by BarbaraHudson · · Score: 1

      The next one will recognize your gait.

      Crime is about o become completely impossible without the assistance of a specially trained AI assistant.

      So put a small stone in one of your shoes and watch your gait change without you trying to "walk differently." Problem solved.

      --
      "Transparent" is a shit show that trades on every stereotype going. A man in drag is NOT a transsexual.
    6. Re:Spike boots by Anonymous Coward · · Score: 0

      Q: How do you slip past TSA without being searched.
      A: Wear a burqa; they actively avoid profiling.

    7. Re:Spike boots by Anonymous Coward · · Score: 1

      Actually, in this well-documented case of ceiling-walking bank robbery, wearing a rubber glove on one's head to look like a chicken was a very effective disguise.

    8. Re:Spike boots by tmosley · · Score: 1

      One more layer of neural net will see right through it.

      The problem is that in the not to distant future, it will start anticipating such ideas, and train itself to prevent confounding. Heaven is terrifying.

    9. Re:Spike boots by hughperkins · · Score: 3, Informative

      Yes, check this out 'High Confidence Predictions for Unrecognizable Images', by Nguyen, Yosinkski and Clune, http://arxiv.org/abs/1412.1897 . It's a paper that shows an image that the net is 99.99% sure is an electric guitar, but looks nothing like :-)

      For the technically minded, the paper's authors propose that the reason is that the network is using a discriminative model, rather than a generative model. That means that the network learns a mathematical boundary that separates the images that it sees, in some kind of high-dimensional transformed space. It doesn't learn how to generate such new images, ie, you cant ask it 'draw me an electric guitar' :-) Maybe in a few years :-)

      The authors don't compare the network too much with the human brain though, ie, are they saying that the human brain is using a generative model? Is that why the human brain doesn't see a white noise picture, and claim it's a horse?

    10. Re:Spike boots by Tablizer · · Score: 1

      You try working spike-boots upside-down in a mask, bub

    11. Re:Spike boots by BarbaraHudson · · Score: 1

      Try just the mask, right-side up.

      --
      "Transparent" is a shit show that trades on every stereotype going. A man in drag is NOT a transsexual.
    12. Re:Spike boots by ceoyoyo · · Score: 2

      There are two popular types of deep ANN at the moment: restricted Boltzmann machines and auto-encoders. RBMs are generative. Autoencoders can also be generative if you train them in a particular way, which works much better so most people train them that way anyway. So you can take an ANN and ask it to draw you a picture of a guitar.

      I disagree with the authors of that paper. It seems more likely to me that they've cherry picked particular examples that fool their particular ANN. That's pretty easy to do for humans too - Google "optical illusion." As you point out, there's also the white noise trick. Show a group of people an image of white noise and they'll find all sorts of things in it. Particularly if you ask "you guys don't see the dragon?"

    13. Re:Spike boots by Tablizer · · Score: 1

      But I've spent a lot of money on the spike-boots. In fact, I have to rob a bank to pay for them.

    14. Re:Spike boots by JohnFen · · Score: 1

      The authors don't compare the network too much with the human brain though, ie, are they saying that the human brain is using a generative model?

      I don't think so, because saying something like that is not supported by evidence. The human brain doesn't actually work like neural networks do. Neural networks are only loosely inspired by one very, very narrow and specific aspect of the mechanics of the brain.

      Is that why the human brain doesn't see a white noise picture, and claim it's a horse?

      The human brain does this sort of thing all the time. You can see shapes in static, of course, but white noise doesn't elicit the strongest rate of this sort of error. People are constantly misidentifying things that are seen in a natural noisy environments (such as in bushes, for instance) when it's dark. Including seeing large animals that simply aren't there.

    15. Re:Spike boots by Agent0013 · · Score: 1

      That's right out of Wallace & Gromit's "The Wrong Trousers".

      --

      -- ssoorrrryy,, dduupplleexx sswwiittcchh oonn.. -Quote found on actual fortune cookie.
  5. Sigh not a breakthrough... by CajunArson · · Score: 0

    "using a vast database of annotated examples"

    Oh Rlly? You have a massively perfect training set and things just magically work better? I'm shocked.

    It reminds me of the paper I read about a "breakthrough" in text processing that mysteriously used the exact same algorithms already known in the field. When you went through the finer details of the paper you found that they had the grad-student slave manually go through all the training pairs and select the "correct" training data. Shockingly enough the hand-tuned results worked better when applied to an artificially narrowed test set....

    --
    AntiFA: An abbreviation for Anti First Amendment.
  6. And you can't opt out by number17 · · Score: 2

    The grocery store or ATM, with cameras all over the place, could do it by simply having a sign at the front of the store that says CCTV. They could record your picture at the register and associate it with a bank card or credit card. After 5 transactions they could guarantee that the person using that card has your face and is likely the owner. They could then flag how many times somebody else uses your card. They could track you throughout the store, like they do now but associated with an individual. Stores would have cameras at the entrances and exits. They would know how many people are currently in the store and who they are. They can't track though, I use cash, right?

    The grocery store subscribes to a third party a face recognition aggregator.

    At the beginning you'll have a shadow profile (#34950892). All it takes it one pump at a gas station, or taking cash out at the ATM to associate your face. About the only thing you could do is wear a disguise, but a different one each time.

    1. Re:And you can't opt out by Narcocide · · Score: 2

      The disguises and cash wouldn't be worth much in the way of anonymity if you were still carrying your cellphone.

    2. Re:And you can't opt out by LessThanObvious · · Score: 1

      Fortunately at least for the time being most public cameras are such bad quality images it isn't yet effective. How many times have you seen a robbery on the news and the guys face is not clear enough to get an ID? How many times does the parking lot have cameras, but you can't read the license plate? We have a limited window where we really aren't identified every minute of the day, but that will soon change. Even if a person doesn't participate in social media enough of our friends do that we are still unlikely to remain anonymous. I don't have an issue with cameras at ATMs because I'm already identifying myself and through passports and DMV the government already knows what I look like. I do have a problem with the likely future we are marching towards where every moment of public life logs your location and identity. I really value the ability to get away with shit and generally go through life unnoticed, I will feel much less free if that is lost.

    3. Re:And you can't opt out by Dr+J.+keeps+the+nerd · · Score: 1

      Secretly, for years, store employees have used advanced evolutionary facial recognition algorithms to identify customers. Where has the public outcry been?

    4. Re:And you can't opt out by viperidaenz · · Score: 1

      ... All it takes is a facebook profile. They already do facial identification in the background.
      http://www.extremetech.com/ext...

    5. Re:And you can't opt out by viperidaenz · · Score: 1

      Walmart already tracks your purchases and can figure out someone if a woman is pregnant base on buying patterns.

      Do you think they would say no to installing high res cameras in their stores to track what isles people walk down, what other products they stare at and for how long while deciding what to buy and associating that with a purchase?

      I can see them wanting to know what people look at and don't buy, so they can market specials on those products to them (mixed in with random specials, because people freak out otherwise).

    6. Re:And you can't opt out by Anonymous Coward · · Score: 0

      Even if you have someone who will obsessively track your spending habits at a store you can avoid that store, The things that achieve creepy total surveillance systems are not increases in collection but the storage and integration of data previously restricted to singe forgetful individuals.

      Most people dealing with hundreds of customers per day do not remember them all, only the few most "interesting" and only when they notice them, they also forget more over time. The same also applies to people you meet in a city street. Most people even when spreading customer specific gossip do not give enough information to recognise a customer, and they do not send it to every store of the same brand and all the people who buy data off them and the government too...

      But it is all totally the same, right....

    7. Re:And you can't opt out by Anonymous Coward · · Score: 0

      No, it's Target that MASSIVELY data mines everyone who enters the store. Every moment you're in range of their cameras software is trying to figure out what you're doing. After you pay, they grab your identification and label all the gathered data with it.

      Walmart probably does some of that now too, but it was Target in the news over pregnancy tracking.

    8. Re:And you can't opt out by JohnFen · · Score: 1

      If the store employees were somehow transferring their visual memory into a massive database then the outcry would be exactly the same.

    9. Re:And you can't opt out by LessThanObvious · · Score: 1

      The in store tracking can often be stopped by shutting off WiFi on your smart phone. Camera's can be involved there too, but they generally don't know who you are or link to previous visits without the WiFi bit. The purchases often are linked to using a rewards card or some such thing that gives them a way to link your purchases, not that every store doesn't have your credit card purchase history, but hopefully only for that store. I'd be curious if anyone has info on how much the credit card companies know about our specific purchases and how much detail they share.

  7. Copyright! by Anonymous Coward · · Score: 0

    What if I copyright my face and charge every time someone stores an image of my face??? Cha-Ching!!!!!!!!

  8. Weren't deep convolutional nets debunked? by Theovon · · Score: 1

    http://arxiv.org/pdf/1412.1897v2.pdf

    1. Re:Weren't deep convolutional nets debunked? by godrik · · Score: 1

      I don't see the practical relevance of this? You can not walk through an airport with a scrambled face. So the images the camera will get are "regular" imaegs. Sure you can generate ridiculous images that triggers false positive. But these images will probably not be fed to an actual system.

    2. Re:Weren't deep convolutional nets debunked? by serviscope_minor · · Score: 4, Informative

      Debunked?

      They're a machine learning algorithm. All such algorithms do is place a fancy decision boundary in a high dimensional space. DnNs do a decent job for certain classes of problem. Far away from the training data, the boundary is not useful, but that's the same with all algorithms pretty much.

      So no. They haven't been debunked.

      --
      SJW n. One who posts facts.
  9. Facial recognition is still very much imperfect by Anonymous Coward · · Score: 4, Interesting

    Very much anecdotal, but here goes anyway - a little while back, I found a recipe for cow tongue that seemed intriguing. If I had eaten it before I couldn't recall, at least I hadn't prepared it myself. So off to the butcher's I was, as this is not found in every shop. The tongues they had on display there seemed very tiny (in retrospect, they must have been veal tongues), so I said "give me the largest tongue you have". As the saying goes, "you should be careful what you wish for" - what I ended up with was a monster, something like over 1.3kg (nearly three pounds). I really didn't need that much, but all I could do was to say thanks and go home with my prey.

    As I laid it on my cutting board, pretty much filling it entirely, it looked at the same time so awesome and gruesome that I had to take a photo of it (not a food blogger, or a blogger of any kind, I just had to document it). And to share the experience, I sent it to a friend via Hangouts. Now, as she uses Hangouts from the GMail web interface, the images are not visible inline but are Google+ links. So she clicks the link.

    ...and G+ helpfully asks her "Is this xxxxx?" (xxxxx == her name) While people are, rightfully, concerned whether companies such as Google know too much about their lives, at least when it comes to Google and facial recognition, they have a long way to go.

    1. Re:Facial recognition is still very much imperfect by viperidaenz · · Score: 1

      Perhaps she has a face that looks like a cow tongue?

    2. Re:Facial recognition is still very much imperfect by Anonymous Coward · · Score: 0

      ya right, nobody uses g+ schill

    3. Re:Facial recognition is still very much imperfect by JohnFen · · Score: 1

      This is one of the big reasons why I don't use G+ (or Facebook, etc.)

  10. Face it by Tablizer · · Score: 2

    When there is a competition to test solutions, do they call it a "face off" or a "face face off"?

  11. "Breakthrough" by Anonymous Coward · · Score: 0

    Hurray!
    Even less privacy. :(

  12. The Bad News ... by TrollstonButterbeans · · Score: 1, Funny

    The facial recognition software thinks all Asians are the same guy.

    --
    Priest: "Universe from nothing, no laws of physics, sped up time"+ huge discrepancies. Creationism? No. Big Bang Theory
  13. and nuclear weapons by Anonymous Coward · · Score: 0

    The top technology I'd like to undiscover is nuclear fission, for its military applications. I am aware there are civilian uses, but the military downside is greater. I want facial recognition to remain undeveloped. I wonder what sort of police state the computer technology of 2015 has made possible.

  14. Finally by Anonymous Coward · · Score: 0

    Finally the wast number of upside-down portrait photography in my hard drive will be recognized, instead of just identifying power outlets as faces. Some of you will definitely know what I'm talking about.

    1. Re: Finally by Anonymous Coward · · Score: 0

      Who gives a f*** really? I was more interested in secure logins. This article is akin to "hey, I figured out how to use a computer."
      all this bullshit about every f****** a****** having a database of some bunch of crap I'm so sick of it f*** all you f******

  15. So... by jtownatpunk.net · · Score: 4, Funny

    Can I finally automatically tag the performers in my porn collection? I'm asking for a friend.

    1. Re:So... by Anonymous Coward · · Score: 0

      Why does your friend need ths done to your porn collection rather than his own collection?

    2. Re:So... by Anonymous Coward · · Score: 0

      Of course! That's why they improved the upside down part of the algorithm.

    3. Re:So... by Anonymous Coward · · Score: 1

      nope, this only does face recognition

    4. Re:So... by Anonymous Coward · · Score: 0

      That's a fairly strange way to go about trying to make a friend. Just sayin'.

  16. Is this revolutionary? by Anonymous Coward · · Score: 0

    It seems that they've increased the data size, and that's about it. How about having a paper that shows the false positives that might happen? There's a paper out there with noise based images that fool the convolution nets with a random set of noise. Or remember the one with the back end of a duck that fooled haar classifiers?

      What are the false positive rates on these?

  17. LET ME KNOW by Anonymous Coward · · Score: 0

    When they figure out the IR LED vs camera problem. ;)

  18. Face detection, perhaps? by Torp · · Score: 3, Interesting

    I didn't read the article, of course, but the summary sounds like they're doing face *detection* not recognition.
    Detection: find which portions of an image are faces.
    Recognition: compare to a database of faces and find out whose face it is.
    First is way easier than the other.

    --
    I apologize for the lack of a signature.
    1. Re:Face detection, perhaps? by Anonymous Coward · · Score: 0

      I didn't read it either, but I did click on the link and see the headline clearly says "Detection". They're just finding faces that are upside down or turned away from us, not figuring out who they are.

      dom

  19. Break through Schmreak through by Anonymous Coward · · Score: 0

    The most important numbers are suspiciously missing. The old best performance, and the gains by the new algorithms. Instead a lot of hoopla about "how much better it is" and what it's doing differently. Maybe it's a serious break-through, but the summary certainly hasn't convinced me of diddly squat other than a bunch of kids tried some new things, and they think they're hot shit because they picked some data-sets that lent well to their algorithm. Please. I was a grad student once too.

  20. I wish... by Anonymous Coward · · Score: 1

    I wish that interesting developments in algorithms such as this could be discussed without resorting to cynicism (as in, how they'll be used by the NSA to breach our privacy and etc). Yes they're valid concerns but my God, what point is there in enjoying advancements in technology if you're going to see the downsides in everything? I long for a simpler time when we didn't need to worry about such BS.

    1. Re:I wish... by JohnFen · · Score: 1

      I long for a simpler time when we didn't need to worry about such BS.

      One of the main reasons we have so many problems with privacy and security these days is precisely because of those simpler times when nobody really worried about the implications of various technologies. We're much better off being cynical.

  21. Ethnicity? by Anonymous Coward · · Score: 0

    Facial recognition implementations based on Viola-Jones tend to have much better results for certain ethnic groups, specifically Caucasians. How does this new algorithm fare in an increasingly racially diverse population?

    1. Re: Ethnicity? by Anonymous Coward · · Score: 0

      I'm confident that the government already has a final solution worked out.

    2. Re:Ethnicity? by funkymonkjay · · Score: 1

      Easy. All black guys need to be flagged for threat and all asian guys can be safely ignored unless he looks like Kim Jong Un. Indian guys are tough cause they all look like a jihadist. JK!!!

  22. this is ripe for abuse and WILL be abused by Anonymous Coward · · Score: 0

    This is frankly beyond disturbing. While the technical aspects are "Gosh! Wow! Amazing!" the fact is this technology will most assuredly be horribly abused.

    This is a hugely invasive technology...and while the hue and cry will be "...because TERRORISTS!!" this has little to do with low probability external threats (external in the sense that someone from outside the culture/society infiltrates the populace) and everything to do with those who have established themselves in power exerting control over the population.

    And to the apologists that want to trot out the "you cant expect privacy in public" and the "if you haven't done anything wrong you have nothing to hide" arguments...they are both fallacy's.

    You can, and its not about hiding anything, respectively.

  23. No Breakthroughs At All by Anonymous Coward · · Score: 0

    Adding another 5 million images to your training database to get a better recognition rate over the previous guy isn't a breakthrough. There's nothing new to this. It's applying a deep neural net to a large training set. Maybe they've sped up the training rate, but that advancement would apply to all deep neural nets, not face recognition specifically.

  24. How long until by Anonymous Coward · · Score: 0

    Masks like http://www.thatsmyface.com/vmchk/3D-Portraits-and-Masks/View-all-products.html become necessary for even a modicum of privacy? Perhaps we should open-source a generic set of faces.

  25. Upside Down? by Anonymous Coward · · Score: 1

    The faintest grasp on machine vision. That goes for your 5 moderators, too.

  26. Do not want by MrL0G1C · · Score: 2

    Facial recognition mostly gets used for all of the wrong reasons, Facebook tracking, illegal police tracking etc.

    'photos of innocent people have been retained in contempt of an explicit order from the court to remove them' - 18million by police

    Facebook's new face recognition policy astonishes German privacy regulator

    And what about people who don't have Facebook accounts, does Facebook allow 'tagging' of their faces?, I'm already annoyed by Facebooks obvious data collection on me as shown by the fact I get email from them telling me who my friends are and inviting me to join.

    --
    Waterfox - a Firefox fork with legacy extension support, security updates and better privacy by default.
  27. aimbots by funkymonkjay · · Score: 1

    This plus drones with missiles = aimbots in RL

  28. "Algorithm"? by ilsaloving · · Score: 1

    Have I missed something?

    I've always believed algorithms and neural networks to be essentially opposites to each other.

    Algorithms are blocks of code that handles a predefined task. Classic example: quicksort vs bubblesort

    Neural networks are a black box of systems that are trained with input until they produce the output you want. Further, even when it is working, you won't truly know what is happening internally, and you're only hope of knowing that it works is throwing a ridiculous amount of inputs at it and seeing how it responds.

    1. Re:"Algorithm"? by Anonymous Coward · · Score: 0

      An algorithm is a step by step operation for doing things.
      A Neural Network is composed of some type of graph data structure. There are steps for adding new data, which will update the graph accordingly, to train it. The algorithm then is also use to produce the appropriate output once trained.
      Your comment suggests that NNs are non-deterministic somehow and therefore not algorithms. However, an algorithm is not simply a "black box" that mysteriously arrives at an answer. If you have the steps of the algorithm as well as the current state of the graph (i.e., the data) you can easily determine what the result will be. This will of course, require some time and effort.

      It's simply not true that you won't know what is happening internally. You can quite easily (with sufficient time, of course) trace through and see exactly how it is behaving. There is really nothing that differentiates a neural network from any other data structure/algorithm on a fundamental level such that it would no longer be an algorithm.

    2. Re:"Algorithm"? by JohnFen · · Score: 1

      I've always believed algorithms and neural networks to be essentially opposites to each other.

      I think you're mixing up two different levels of abstraction.

      Algorithms are blocks of code that handles a predefined task.

      Indeed, and the NN algorithms describe a predefined task that can be summarized as "train and operate a neural network". That's one level of abstraction. Once trained and operating according to the algorithm, then the NN proceeds to do the tasks it is meant for. There is no algorithm that the NN follows at this level of abstraction -- there is only the algorithm for how the NN itself operates, not for the specific task that NN is being used for.

  29. That was literally the best post I've read today by Anonymous Coward · · Score: 0

    Is it even possible for one to figuratively work on face detection/tracking software on low power ARMv7/8 CPUs?

  30. Upside down! by Toshito · · Score: 1

    What's more, their algorithm is significantly better at spotting faces when upside down, something other approaches haven't perfected.

    Very usefull if you want your system to work in Australia!

    --
    Try it! Library of Babel
  31. Oblig "learn to recognise" WTF by lars_stefan_axelsson · · Score: 1

    OTOH, what these networks have actually learned can be eye opening.

    --
    Stefan Axelsson
  32. Adequate CPU by Anonymous Coward · · Score: 0

    "Add this step: Rotate the image and run the algorithm each x degrees. What am I missing?"

    The title answers your question.

  33. I donno what the problem is by Toad-san · · Score: 1

    Don't those guys on the NCIS TV show do this all the time?

  34. All your algorithms are belong to workarounds by Anonymous Coward · · Score: 0

    Everything we need to know to defeat these we learned in Army tradecraft.

    Back in WW II.

    Keep trying, n00b2.