Slashdot Mirror


US Intelligence Wants To Radically Advance Facial Recognition Software

coondoggie writes "Identifying people from video streams or boatloads of images can be a daunting task for humans and computers. But a 4-year development program set to start in April 2014 known as Janus aims to develop software and algorithms that erase those problems and could radically alter the facial recognition world as we know it. Funded by the Office of the Director of National Intelligence's 'high-risk, high-payoff research' group, Intelligence Advanced Research Projects Activity (IARPA) Janus 'seeks to improve face recognition performance using representations developed from real-world video and images instead of from calibrated and constrained collections.'"

40 of 178 comments (clear)

  1. It's like by Anonymous Coward · · Score: 5, Insightful

    absolutely nothing happened these past five months.

    1. Re:It's like by SomeoneFromBelgium · · Score: 2

      ...that situation when you shake hands with that guy from sales ... what's his name... well some face recognition sofware in my google glass that would wisper his name as a kind of soufleur could really come in handy.

    2. Re:It's like by Anonymous Coward · · Score: 3, Insightful

      Or perhaps the more logical conclusion (assuming at least half a brain exists) is that no one actually gives a shit.

      Everyone's still getting paid and laid, so no, no one gives a shit. Anyone who isn't getting paid or laid is a terrorist.

    3. Re:It's like by FlyHelicopters · · Score: 4, Insightful
      Nothing much did happen, other than a minor government holiday, Obamacare launched to a mess...

      oh yea...

      Snowden told us all something that we already knew, so nothing changed there.

      Those of us who care, already knew. Those who didn't know, didn't care, or didn't want to know, or are too busy watching American Idol or Honey Boo Boo or whatever.

    4. Re:It's like by duke_cheetah2003 · · Score: 5, Insightful

      Snowden told us all something that we already knew, so nothing changed there.

      Just to be clear, Snowden told us something we all suspected, perhaps even strongly suspected as in almost accepted truth. But Snowden revealed these things we suspected. Concrete and clear, no doubts left.

    5. Re:It's like by Anonymous Coward · · Score: 2, Insightful

      Snowden told us all something that we already knew, so nothing changed there.

      Just to be clear, Snowden told us something we all suspected, perhaps even strongly suspected as in almost accepted truth. But Snowden revealed these things we suspected. Concrete and clear, no doubts left.

      Snowden told _all_ something _some_of_us_ suspected (with high probability). Before, mass surveillance was topic of only few and masses were ignoring us or calling us nuts. Now, masses are aware.

    6. Re:It's like by g0bshiTe · · Score: 2

      Until someone who just happened to glance as you shook whats his names hand and you got flagged as a potential terrorist for having shook his hand as he was on some watch list.

      --
      I am Bennett Haselton! I am Bennett Haselton!
    7. Re:It's like by g0bshiTe · · Score: 2

      And yet still don't care.

      How does that happen?

      --
      I am Bennett Haselton! I am Bennett Haselton!
    8. Re:It's like by kilfarsnar · · Score: 2

      Nothing much did happen, other than a minor government holiday, Obamacare launched to a mess...

      oh yea...

      Snowden told us all something that we already knew, so nothing changed there.

      Those of us who care, already knew. Those who didn't know, didn't care, or didn't want to know, or are too busy watching American Idol or Honey Boo Boo or whatever.

      When I used to suggest that we were all being spied on, I was called paranoid or a conspiracy theorist. Nowadays I'm not. So that's changed, and frankly I appreciate it.

      --
      "What the American public doesn't know is what makes them the American public." -Ray Zalinsky (Tommy Boy)
    9. Re:It's like by Anonymous Coward · · Score: 2, Interesting

      Hey, who are those thugs on those motorcycles over there that just pulled up to the playground?
      Nevermind, just ignore them and hope that they go away or don't bother us.
      I'm still having fun building this sand castle.
      Hey, they started taking pictures.
      Don't look at them and maybe they will go away.
      Besides, they haven't beat anyone up yet.

    10. Re:It's like by MrKaos · · Score: 4, Insightful

      absolutely nothing happened these past five months.

      For those who cared about western society it proves is freedom is an illusion and democracy is a lie because when we gave up on diplomacy and waterboarded the first insurgent it proved our ideals weren't as strong as our military. This justifies the transition from covert to overt intelligence.

      That's the nature of a Police State who has nothing to fear from the people.

      --
      My ism, it's full of beliefs.
  2. In other news... by Anonymous Coward · · Score: 5, Insightful

    The sale of masks, hoodies and other feature obscuring items rose 1000%.

    US Gov seeks to introduce a ban on all such items ASAP.
    A spokesperson said basically, 'Think of all the children that can be saved from nasty people who hide their faces and scare the poor dears'.

    A Patriot Act order closing to a website that identified the exact location of every facial recognition camera in the country was issued today

    The Terrorist group 'Anonymous' started attacking the cameras themselves causing every picture that they sent to be changed into members of Congress, the house and senior Whitehouse staffers.

    And so the war on freedom continues.
    Is that a SWAT team I hear pulling up outside? Time to go...

    1. Re:In other news... by Anonymous Coward · · Score: 5, Funny

      Good reason to adopt the Muslim religion... You get to wear a burka!

  3. Re:As expected by Anonymous Coward · · Score: 4, Insightful

    Having better facials recognition seems like a great idea

    The technology may be impressive, but the government must be stopped from using it to further violate people's privacy.

    and i'ts not even usefull.

    The ability to harass practically anyone will likely prove quite useful to the government.

  4. Not much need to worry by Anonymous Coward · · Score: 2, Interesting

    I've worked with current facial recognition systems and they're absolutely junk. They can match mug shots with perfect lighting but that's about all. It's a very long way to being able to pick people out of some crappy live video stream.
    Mind, I worked with whatever's publicly available; maybe the various big brother agencies have better stuff; i wouldn't bet on it though.

    1. Re:Not much need to worry by Anonymous Coward · · Score: 4, Interesting

      Every picture on Facebook is scanned by Interpol by facial recognition software. Yes even the guy in the background that didn't know you took the picture. Interpol you say? Yep, that's why this whole fake outrage over the NSA is all bunk. They all work together, and have been for decades, spying on each other then sharing the information to bypass privacy laws in each country.

    2. Re:Not much need to worry by sifi · · Score: 4, Interesting

      Absolutely true. Even when they are 'accurate' they are of limited usefulness.

      Assume that it's 99.9% accurate for a given success rate (wildly optimistic) That is for every 1000 faces you show it 1 is incorrectly flagged as matching.

      Suppose that you have a list of 100 people you are 'interested' in. If the system is in an airport with 200,000 people per day - you are going to get 20,000 incorrect matches a day.

      --
      Sig (appended to the end of comments you post, 120 chars)
    3. Re:Not much need to worry by InsightfulPlusTwo · · Score: 2

      Your math appears to be correct for one camera. But what if the cameras are everywhere, and the same people are passing in front of the cameras, and they correlate the results? They can increase their certainty and filter out many of the false positives. In addition, for airports, since they have a known list of travelers, they can use this information to reduce the false positives still more. Finally, they can introduce secondary technology such as a 3-D body scan like a Kinect to reduce error still more. With multiple sources of information and technologies, the system becomes viable.

      --
      I felt bad for the man who had no signature, until I met a man who had no comment.
    4. Re:Not much need to worry by djmurdoch · · Score: 3, Insightful

      That's 200 false matches to each of the 100 targets. 200*100 = 20000.

    5. Re:Not much need to worry by Znork · · Score: 3, Insightful

      With multiple sources of information and technologies, the system becomes lucrative.

      You will, however, get even more false positives. Which doesn't matter as long as the account balance for the scammers selling useless junk to gullible officials gets real positive.

  5. Inevitable by Tim12s · · Score: 5, Insightful

    This is inevitable.

    You need to continually track people's localized movements to reduce the total search space while obtaining multiple images of each person while they move; merging multiple images to get higher resolution images, over time (wind, rain, lipstic, changed hat, etc) all affect confidence, and then eventually match that to a known database of people.

    Eventually, correlating time to location, credit card purchases, and cell phone, you'll have a perfect match. Your phone linked to email addresses will link your online identity and bam you get a full picture.

    Of course, everyone who is not matched by this is a suspicious character since you're not in the database. Even sudden changes in appearance would signal suspicous behavior... why did you just put on a wig. Biggest trouble this database will have will be girls going to hair salons.

    As someone from the US, you should eventually be in the database from birth. Anyone new, travelling from overseas will be suspicious. That doesnt mean its local to the US. With credit card databases, a few outsourced security firms and security cams globally monitored, you'll be tracked everywhere.

    Who you meet for coffee, etc. Actually, that is the objective. Find who you meet for coffee.

    Its going to happen because I can think about how to do this, so its possible.

  6. Will not work. Period. by fluch · · Score: 5, Informative

    For similar reasons as described in https://www.schneier.com/blog/archives/2012/05/criminal_intent.html it will not be usefull.

    1. Re:Will not work. Period. by physicsphairy · · Score: 4, Insightful

      Schneier's point can only be applied for cases in which the cost of a false positive is non-negligible compared to the benefit of a correct classification. E.g., if your test to identify a person infected with a lethal disease identifies all infected with a 100% success rate, but misidentifies 1% non-infected, and the treatment has a 2% chance of being lethal itself, this is a very bad test because you do not want to kill off 2% of the healthy population to treat a handful of sick people. If, however, the treatment is entirely innocuous, then you might consider the test to be a great one because it lets you cure everyone who is infected while not unduly burdening the larger healthy population. Or consider that you might have a very expensive secondary test which yields almost no false positives. If the first test is fast and cheap, then together you have an almost ideal system.

      The federal government is largely chasing specters already -- how often do the TSA actually catch a terrorist? I doubt they mind too much about false-positives unless that number is totally extreme. Likely, they are interested in correlating this to other data. So, being flagged by itself is not a huge deal, although it might earn you a 'random screening'. But being flagged by facial recognition as someone on a watchlist, and being on a flight to Washington D.C., and having had someone in your hometown recently lookup terms related to assassination at a public library, and having a facebook profile with language indicating emotional stress could all wind up tied together by the government's surveillance program.

      A good facial recognition system would be at least as useful as saying someone is 'wanted' on the evening news. But, as usual, the major question is whether we are going to tolerate the increasing formation of a big brother style government in order to reap these meager profits. (And, also as usual, the answer is probably yes.)

  7. Isn't going to help I expect, but.. by rusty0101 · · Score: 4, Interesting

    Get Poser, or something similar, and start replacing the face picks of all your contacts with pics of poser models asses selected for a best match to the contact's ass. Remember to find an appropriate image for companies and agencies. I'm thinking a Hydra would be appropriate for the NSA, Medusa for the FBI, Mantis for the CIA, etc.

    Bonus points for doing r/g stereo of the images, or 3d if the phone supports that directly.

    --
    You never know...
    1. Re:Isn't going to help I expect, but.. by wonkey_monkey · · Score: 2

      So every time I call someone, my ass is on the line?

      --
      systemd is Roko's Basilisk.
  8. Re: And in other news... by tysonedwards · · Score: 3, Informative

    Dehydrated water isn't anything.

    --
    Thirty four characters live here.
  9. Re:And why ... by cheekyjohnson · · Score: 2

    Is this a bad thing?

    I don't think the technology itself is bad, but I also believe anyone with a brain knows it's going to be misused, and that's probably what people are afraid of.

    --
    Filthy, filthy copyrapists!
  10. Re:As expected by Anonymous Coward · · Score: 2, Interesting

    and i'ts not even usefull.

    The ability to harass practically anyone will likely prove quite useful to the government.

    Wow. And here I thought they had enough shit online tracking us today, along with the manipulative control to harass citizens (you won a free tax audit based on your party affiliation!) at the Federal level. What the hell was I thinking. Clearly the NSA budget is lacking. Yes, we need more of that. I'm sure that's the answer.

    What's that? The average citizen unknowingly commits three felonies a day you say? And the government wants even more visibility into that? What could possibly go wrong?

  11. Re:Americans by FlyHelicopters · · Score: 3, Insightful
    We no longer have the option to revolt and take our leaders out back and hang them, the way it would have been done in the past.

    The only real way to remove our current government would be if the military did it.

    Which wouldn't be so bad, so long as they don't try to run it. Throw all the current leaders out, call for new elections in 6 months, it would be a start anyway.

  12. Re: And why ... by cheekyjohnson · · Score: 4, Insightful

    You could say the same thing about a fork

    Perhaps you should try to understand what I'm saying before you spew forth such things. A fork is wildly different from technology that will, in all likelihood, be used to aid in the violation of people's rights; history tells me it's an inevitability.

    I also did not suggest a ban on the technology itself. I would not mind severely limiting the government's use of it, though.

    We shouldn't fear potential abuse

    I think that's an absolutely absurd statement. When talking about whether a government should have a certain power or not, I think it is very important to take into account how likely it is to abuse that power, how easy it is to abuse it, and how much it could be used to infringe upon people's liberties.

    We should fear a lack of moderation and oversight.

    We've all already seen how the government's oversight works; it simply doesn't.

    --
    Filthy, filthy copyrapists!
  13. Here's where they got the udea by Anonymous Coward · · Score: 2, Funny

    I think they saw this picture last week, and a little light bulb popped up in their little heads.
    http://www.businessinsider.com/crazy-photo-appears-to-show-60-security-cameras-on-one-intersection-in-china-2013-11

    NSA Man 1: "Did you see those 60 CCTV cameras on a Chinese junction?"
    NSA Man 2: "What would happen if we could intercept all those IP CCTV camera feeds and stuck facial recognition on them. Then we could monitor all 300 million potential terrorists!"
    NSA Man 1: "Wow that is so constitutional, I'm glad we are the good guys"

  14. Transitioning from academic to real world ... by perpenso · · Score: 4, Informative

    I've worked with current facial recognition systems and they're absolutely junk. They can match mug shots with perfect lighting but that's about all. It's a very long way to being able to pick people out of some crappy live video stream. Mind, I worked with whatever's publicly available; maybe the various big brother agencies have better stuff; i wouldn't bet on it though.

    A while ago I did a little research in computer vision. From the summary it seems like nothing more than moving a project from an academic project to a real world project.

    In the academic world it is perfectly acceptable to use carefully selected or crafted inputs (facial images in this case) to develop and evaluate your algorithms. You may have separate date sets for development and evaluation, however careful selection or crafting is OK to simplify the project and avoid issues/variables outside of the project's scope. In your particular mugshot example this would be using images of good resolution and good/predictable lighting. Dealing with low resolution and bad lighting would be an issue left to the next thesis or research grant or for commercialization.

    Working with mugshots may be a fluke, the inputs happen to be carefully crafted like one might do in academic research. So it was relatively simple to transition to this niche real world application.

    Moving to a general real world solution using images and video of questionable quality is an enormous jump in the level of difficulty. Perhaps too difficult. It may not be possible to recognize an individual. It may only be possible to offer a somewhat generalized characterization that a person my fit into. At least with the haphazardly placed cameras typically found on the streets and in shops today. Some places use very good and carefully positioned cameras to get decent images for automated facial recognition. For example Las Vegas casinos.

    1. Re:Transitioning from academic to real world ... by aeranvar · · Score: 3, Interesting

      In the academic world it is perfectly acceptable to use carefully selected or crafted inputs (facial images in this case) to develop and evaluate your algorithms. You may have separate date sets for development and evaluation, however careful selection or crafting is OK to simplify the project and avoid issues/variables outside of the project's scope.

      As a CompSci academic, I am consistently shocked by the fact that we don't really consider the ethics our research. Some of the research, like the folks that are still interested in Chess playing algorithms, is pretty benign. Other research, like facial recognition, data mining, etc.... not so much. Case and point, there's a great Ted Talk by a researcher from Carnegie Mellon in which he demos an iPhone app (paired with some server-side software) his team wrote for using facial recognition to predict social security numbers in seconds. For those with experience on the academic side, how often have you or your colleagues stopped to consider that your research may be used unethically? Unless you're working in security, I suspect that it's probably infrequently despite the fact that advances in just about every major CS research area could be misused.

      To be fair, I don't really know what to do about this problem. Someone is going to do the research. If it isn't me, or you, it'll be someone working in a government research facility... perhaps working for a government that isn't so friendly. All I suppose I'm really saying is that we really need to start thinking about the fact that there's a digital arms race going on... and we're the ones making the weapons.

      It'd be nice if we could have advice from some of the researchers from the dawn of the last arms race, like Oppenheimer. This time, the race isn't about becoming omnipotent, it's about becoming omniscient.

  15. They do by Taco+Cowboy · · Score: 3, Insightful

    It's like absolutely no one can figure out how the hell we got here

    While you may not be able to figure out what had happened, they sure do.

    They had that planned all along, and they have greased all the palms that needed to be greased - from the politicians (from both sides of the aisle) to the corporate CEOs - that is how they got their PRISM (among all their many other_It's like absolutely no one can figure out how the hell we got here) schemes launched without anyone beating an eyelid.

    Had it not because of a courageous squeeky wheel, ~ Edward Snowden, ~ they could have accomplished EVEN MORE !

    --
    Muchas Gracias, Señor Edward Snowden !
    1. Re:They do by Anonymous Coward · · Score: 2, Insightful

      I really hope they don't murder president Elizabeth Warren, like they murdered JFK and Lincoln.

  16. Where this is headed by korbulon · · Score: 4, Insightful

    The false positive problem is going to become a real nightmare for some unfortunate individuals accused of crimes based on incorrect identification by this system, especially if it gains enough traction in courts of law and enough precedent is established. You could also envision a scenario where certain unsavory types end up gaming the system to frame others for their crimes.

    On one hand it's just a tool which can be used for good or ill. Unfortunately for the average citizen, law enforcement has a tendency to use all of the tools at its disposal against you in a court of law.

    1. Re:Where this is headed by korbulon · · Score: 4, Insightful

      Of course they will look at the images. The problem arises because of the scale of the system: it can potentially sweep through tens of thousands of faces and do some cross-referencing of names and locations and oh look here it looks like someone who looks like so-and-so was at these places at these times and gee that's pretty compelling evidence because otherwise statistically it would be one hell of a coincidence that they weren't somehow involved in the crime, so likely they are guilty, when in fact it was nothing more than a coincidence. People have been convicted on much less. But, hell, in this society people seem to be OK with sending innocent people to jail as long as we get most of the bad ones (and as long as it isn't them).

      You seem to underestimate the mercenary nature of US law enforcement. If they have you in their sights, they can and will use everything they have against you, both within and without a court of law. Just ask Aaron Swartz.

    2. Re:Where this is headed by BlueStrat · · Score: 4, Insightful

      The false positive problem is going to become a real nightmare for some unfortunate individuals accused of crimes based on incorrect identification by this system...

      Actually, the larger problem will be non-false positives. Laws are designed, written, and passed based on an understanding that there are certain practical limits to enforcement due to the limited ability of the State to detect law breaking and to readily identify, track, and apprehend law breakers.

      A great many laws which at current enforcement levels nobody has a problem with, suddenly become draconian, abusive, unrealistic, and arbitrary when enforcement nears 100%. Of course, with a system like this, selective enforcement for political/ideological/personal reasons is a certainty, particularly in light of all the recent revelations of current government abuses and criminal behavior surrounding the abuse of government power and the tools it has available.

      A tool such as this is the wet-dream of a police state.

      Strat

      --
      Progressivism (aka US 'Liberalism'): Ideas so good they need a police/surveillance-state to enforce.
  17. The problem with most geeks by korbulon · · Score: 4, Insightful

    Is that when it comes to their work, they are essentially amoral. The likely use of a technology is secondary to the intellectual challenges posed by a scientific or engineering problem. The main thing is that a problem is "neat". Throw in a little bit of competition to get hearts racing and all managers have to do is sit back and wait for results. Thus we get crossbows, machine guns, nerve gas, nuclear warheads, smart bombs, mortgage-backed securities and surveillance systems. How many of the people who built these clevilish devices ever stopped to ask themselves: should I be doing this?. Maybe quite a few, but it still didn't stop most of them.

    Sadly, I think this situation is unavoidable, for you always encounter the argument: "better that we build it before somebody else does". Which I suppose is a valid point: in this world it's either fuck or be fucked, and morality don't enter into it. If only I hadn't been raised on a steady diet of moral platitudes and stories of good triumphing over evil, I could be more at peace with this reality.

    1. Re:The problem with most geeks by bill_mcgonigle · · Score: 3, Informative

      The main thing is that a problem is "neat".

      And also money. I know some people who have gone to work for the MIC when they might have gone to work for something non-destructive except for the funding problems.

      Sadly, I think this situation is unavoidable, for you always encounter the argument: "better that we build it before somebody else does". Which I suppose is a valid point

      It's not. The 'arms race' towards ever more deadly weapons only serves offensive purposes. If you want to have a peaceful nation you need a massively distributed low-level capability, not a highly centralized high-level capability.

      If only I hadn't been raised on a steady diet of moral platitudes

      Perhaps more people need to be. The current ones here are OK with the government taking trillions of dollars from them and their progeny every year and funneling it to the war machine. Imagine if that money went instead to solving hunger, clean water, or clean energy problems. But, as long as you have psychopaths with unconquerable libido dominandi running things, that's not going to happen.

      --
      My God, it's Full of Source!
      OUTSIDE_IP=$(dig +short my.ip @outsideip.net)