Slashdot Mirror


Researchers Develop Surveillance System That Can Watch & Predict

hypnosec writes "Carnegie Mellon university researchers have developed a surveillance system that can not only recognize human activities but can also predict what might happen next. Scientists, through the Army-funded research dubbed Mind's Eye, have created intelligent software that recognizes human activities in video and can predict what might just happen next; sounding an alarm if it detects anomalous behavior. "

28 of 106 comments (clear)

  1. Next up.... by CimmerianX · · Score: 4, Insightful

    Thought Police Alpha Version .501 right here. Arrest him!!!! Our system assumed he would shoot somebody.

    1. Re:Next up.... by durrr · · Score: 3, Insightful

      This system will be hilariously judging when someone with ataxia or just a plain limp sounds the system every damn time he walks past. Or some poor person with social anxiety that is constantly harrassed until he refuses to go out anymore.

    2. Re:Next up.... by betterunixthanunix · · Score: 5, Insightful

      I suspect this system will see more subtle use. I suspect that this system will be deployed within corporations, and used to detect employees who are not satisfied with their treatment. Those employees will either be fired or promoted (to divide them from their peers and prevent them from organizing people). The purpose of a system like this is to enforce the social order, to prevent change, and to ensure those who are in power will remain in power.

      --
      Palm trees and 8
    3. Re:Next up.... by BeanThere · · Score: 2

      This system was developed by the military, not by businesses ... that should give at least some clue as to who is developing this and what their initial intentions probably are, for whatever that's worth .. from the paper:

      This research was sponsored by the Army Research Laboratory
      and was accomplished under Cooperative Agreement
      Number W911NF-10-2-0061. The views and conclusions contained
      in this document are those of the authors and should
      not be interpreted as representing the official policies, either
      expressed or implied, of the Army Research Laboratory or
      the U.S. Government.

      Regardless, systems like this are coming, and they are going to be ubiquitous, from governments to massive corporations to malls to schools to roadways etc. ... we need to think sensibly about how to deal with and implement these things in a moral way, while not just allowing our rights to be roughshodden by ruling sociopaths.

      I wonder how long until it is until "automated activity prediction" is claimed to be "probable cause" to violate the 4th Amendment.

    4. Re:Next up.... by Jeremiah+Cornelius · · Score: 2

      "It's the cops. Just stay calm, and act normal."

      Soon, Americans will treat the boys in blue, just like they did the red coats.

      --
      "Flyin' in just a sweet place,
      Never been known to fail..."
    5. Re:Next up.... by Jeremiah+Cornelius · · Score: 4, Insightful

      You're Eight Times More Likely to be Killed by a Police Officer than a Terrorist
      http://www.cato-at-liberty.org/youre-eight-times-more-likely-to-be-killed-by-a-police-officer-than-a-terrorist/print/

      --
      "Flyin' in just a sweet place,
      Never been known to fail..."
  2. Uh oh by p0p0 · · Score: 2

    Camera monitoring hallway:
    Subject 1: "You, citizen. Pick up that can."
    Subject 2: "..."
    Camera: "Oh shi-"

  3. Will it be as intelligent as Siri? by elrous0 · · Score: 4, Funny

    I said "The corner of VINE" not "PINE," you dumb bitch!

    --
    SJW: Someone who has run out of real oppression, and has to fake it.
  4. Re:Profiling? by VAElynx · · Score: 3, Interesting

    Uh... if it works, then so what?
    Unless you assert that racial profiling would be wrong regardless of whether it works, in which case you have abandoned science and went over to the territory of ideology.

  5. Too late by fustakrakich · · Score: 2

    Step out of the vehicle. Or I will tase you!

    It's already a too common occurrence..

    --
    “He’s not deformed, he’s just drunk!”
  6. Anomalous Behavior by betterunixthanunix · · Score: 3, Insightful

    IOW this system will fight social change. If you belong to a group that has the short end of the stick when this system is deployed, you will be flagged for not accepting that treatment like everyone else.

    --
    Palm trees and 8
  7. Pure BS! by bogaboga · · Score: 3, Informative

    Scientists, through the Army-funded research dubbed Mind's Eye, have created intelligent software that recognizes human activities in video and can predict what might just happen next; sounding an alarm if it detects anomalous behavior.

    To use the words, "might just happen next", is just code for "might not happen next".

    In short, it's just a loophole for scientists to get more funding, while emphasizing that their software does exactly what they said it would do.

    We have better thing to do or worry about, right?

  8. Here we go. by vikingpower · · Score: 4, Insightful

    In my native Europe as much as in your great & free US: More surveillance state. More police state. More security craze. Where is this going to stop ? When are ordinary, yet intelligent people going to refuse to live in and contribute to such a state ?

    --
    Religous speak to God. Insane are spoken to by God. When all shut up, one can finally hear Shostakovich in peace
    1. Re:Here we go. by betterunixthanunix · · Score: 2

      When are ordinary, yet intelligent people going to refuse to live in and contribute to such a state ?

      Never, because:

      1. Most people are busy drinking and watching sports, or gossiping on Facebook
      2. Surveillance systems will be used to find those who are not, and that information will be used to prevent them from achieving any real change.
      --
      Palm trees and 8
    2. Re:Here we go. by aaaaaaargh! · · Score: 2

      That's a rather bold statement. Throughout history revolutions were triggered both from the outside and inside, often a combination of both, sometimes just one of them. Often they dissolve when the dictator dies. The Franco and Salazar regimes in Europe are perfect examples. Luckily it seems that extremely despotic systems based on terror don't last long, see e.g. Cambodia during the Khmer regime or the 3rd Reich. Less oppressive regimes seem to take longer, about 2-3 generations, until they disintegrate. I'm not saying that events from the outside play no role, but they are often overrated, e.g. the Soviet Union did not collapse just because of a economic problems or pressure from the outside, a huge factor in its collapse were Gorbatchev's voluntary reforms und a certain amount of support for them in the progressive wing of the communist party.

  9. It's vaporware by Animats · · Score: 5, Insightful

    No, they haven't "developed a surveillance system". The paper is two psychologists blithering about the potential architecture of one. It reminds me of the awful papers that came from the "expert systems" community in the 1980s. There's been some progress; it mentions Bayesian statistics. But it's fundamentally an approach based on parsing visual data into something that looks like predicate calculus and grinding on that. There's a long history of that not working.

    It's an idea in the right direction, though. A key component of intelligence is prediction. Knowing what is likely to happen is a basic component of common sense, an area in which AI systems have historically been weak. With prediction comes the ability to ask "what if" questions, essential to deciding what to do next without doing something stupid.

    There's been real progress in that area, but not from the expert systems people. Adobe Photoshop's content-aware fill is an example of a successful system which has a form of "common sense" - it fills in plausible-looking areas to replace sections deleted from photos. Related technologies exist for videos, and are used for motion compression and 2D to fake 3D conversion. Systems which look at video and guess "what happens next" may be the next step.

    1. Re:It's vaporware by MangoCats · · Score: 2

      Hello, this it Target calling, did you know your teenage daughter is pregnant?

  10. fairly predicatable by andrew_d_allen · · Score: 5, Insightful

    With most surveillance footage it's pretty easy to spot what's going to happen next: the customer will pay for their items, receive change, and walk out of the store. Unless you're watching it on the internet. Then, a car will drive into the storefront or a botched hold-up will occur.

  11. Hah! Finally! by ibsteve2u · · Score: 3, Funny

    A camera that can tell me if I'm about to be asked "Do I look fat in this dress?"

    --
    Orwell: "In a Time of Universal Deceit, telling the Truth is a Revolutionary Act"
  12. Needs mass spook-spamming by heretic108 · · Score: 4, Insightful

    I'm thinking along the lines of the emacs "spook" function, amongst other things. You just need enough a large enough group of participants working together.

    The system can be trained in weird ways. For instance, if enough people in enough places scratch their noses with their left hands, then break out in a mock fight, the system will learn to sound the alarm every time someone scratches their nose with their left hand.

    Or, for something more socially useful - have people pull out a cellphone, talk for a few seconds, then pull out a mock gun and pretend to mug others. Then, the system will freak out every time some annoying jerk pulls out a cellphone in public. Along that same theme, train the system to send in the troops whenever someone adjusts their underwear in public, or picks their nose, or farts loudly...

    --
    -- In the beginning was the WORD, and the WORD was UNSIGNED, and the main(){} was without form and void...
  13. Re:Profiling? by ShanghaiBill · · Score: 2

    Unless you assert that racial profiling would be wrong regardless of whether it works

    It does work, and it is wrong. Blacks are more likely to commit a violent crime than a white person. That is a fact. So what? They still have a right to be treated as individuals and to have equal rights before the law. In the list of priorities of a free society, "efficient law enforcement" does not come before "equal justice for all".

  14. Re:Are there any reasons to wait for the crime? by Let's+All+Be+Chinese · · Score: 2

    what reasons would be there to wait for the crime to happen?

    The freedom to act must include the freedom to fuck up. (Though it does not imply immunity from consequences.)

    So it depends highly on just what consequences you're proposing to attach to "detected pre-crime". If all you do is to "just happen" to appear on the scene, and in case of private property ask people to leave, then you can.

    If you are proposing to impose sanctions on not-yet-commited "crimes", or even "merely" build tracking databases, then that means you've reduced freedom some more, in fact you've stooped to thought police. It means that the country in which this is deployed is no longer free.

    On the other hand, stopping a crime that wouldn't have happened anyway has no negative repercussions for this person.

    Does it not? I think that's terribly naïve for a regular reader here, in fact for anyone with an internet connection.

    Plus, there is the issue that such systems do effect changes in behaviour; you're effectively making people the string puppets of the technology. I think that's putting the cart before the horse, so this is a class of things we simply really ought not want. In fact, we ought to not want these things.

  15. Re:Profiling? by Jessified · · Score: 2, Interesting

    I certainly agree with your assertion of equality, but I will correct you by saying, "more likely to be arrested and convicted of a crime."

    A better question is why are certain races more likely to end up in jail?

    That is a big distinction. Plenty of white people commit crimes every day and see leniency from police, judges and juries that blacks in similar circumstances do not. Look at police recommendation for charges as well as sentencing for evidence. Furthermore, black people are more likely to be living in poverty, and poverty is obviously associated with higher crime rates.

    Not that you said this, but many feel that there is something inherently different about black people that leads them to be arrested more frequently than white people. If white people were the "subdominant race" in America, we would see the same trends in reverse.

  16. Re:Hah! Finally! by ibsteve2u · · Score: 2

    Not really an innovation; It doesn't take an intelligent camera to know what comes next.

    Oh, I know that there is no safe way to answer it. But if said camera can warn me that the question is about to be asked, I can evade the situation entirely. That might offer me the opportunity to again develop/cultivate a worthwhile "significant other".

    As it stands, I've found that my penchant for honesty is entirely too intrusive.

    --
    Orwell: "In a Time of Universal Deceit, telling the Truth is a Revolutionary Act"
  17. Re:Profiling? by ShanghaiBill · · Score: 3, Interesting

    poverty is obviously associated with higher crime rates.

    The world has some very poor societies that are relatively crime free. The correlation between crime and poverty is complicated, and is certainly not "obvious".

    If white people were the "subdominant race" in America, we would see the same trends in reverse.

    You mean like in Haiti? Or Nigeria?

    If your assertion that white dominance causes black crime was really true, then black crime would be higher in areas where they are a smaller minority, and diminish as they became more dominant. That is the exact opposite of what actually happens. I live in San Jose, California, and our black population is about 3%. We have one of the lowest crime rates of any big city in America, and blacks in particular are less likely to commit crimes. If you look at black majority cities, like East St Louis, Illinois (95% black) it has one of the highest rates of crime (nearly all black-on-black). I don't see how you can blame that on "white dominance".

  18. Bogus Research...FTA by globaljustin · · Score: 4, Informative

    I looked through the full text of the research (http://stids.c4i.gmu.edu/papers/STIDSPapers/STIDS2012_T02_OltramariLebiere_CognitiveGroundedSystem.pdf)

    It is bogus. Wouldn't get published. They say the system *predicts behavior* using a systematic behavior ontology. When it describes their theory of the ontology it lists three factors in the system.

    "Causal Selectivity" #3 is the one that links **cause and effect** its the part of the equation where your action (reaching in pocket) is either interpreted as something threatening (trigger bomb) or non-threatening (scratch balls discretely in public).

    Guess what...all they do is say "Will be addressed in further research"...!!!

    The whole basis for their claim...'prediction' is explicitly not part of this research. They do not even address the link of one behavior to another, yet it is the whole premise of their claim!

    From page two (emphasis added)

    Ontology pattern matching - comparing events on the basis of the similarity between their respective pattern components: e.g., a person’s burying an object and a person’s digging a hole are similar because they both include some basic body movements as well as the act of removing the soil;

    Conceptual packaging - eliciting the conceptual structure of actions in a scene through the identication of the roles played by the detected objects and trajectories: e.g. if you watch McCutchen hitting an homerun, the Pittsburgh Pirates’ player number 22 is the ‘agent’, the ball is the patient, the baseball bat is the ‘instrument’, toward the tribune is the ‘direction’, etc.).

    Causal selectivity: attentional mechanisms drive the visual system in picking the causal aspects of a scene, i.e. selecting the most distinctive actions and discarding collateral or accidental events (e.g., in the above mentioned homerun scenario, focusing on the movements of the rst baseman is likely to be superuous). In the next section we describe how the Cognitive Engine realizes the rst two functionalites by means of combining the architectural features of ACT-R with ontological knowledge, while **Causal selectivity will be addressed in future work.**

    --
    Thank you Dave Raggett
  19. anyone can predict... by mschaffer · · Score: 2

    Anyone can predict. Let me know when it can see the future.

  20. Scary ass article until,,. by Trax3001BBS · · Score: 2

    You scan the PDF's and find it's for what path (walking) a person would take.