Slashdot Mirror


London's Crime Hot Spots Predicted Using Mobile Phone Data

KentuckyFC (1144503) writes A growing number of police forces around the world are using data on past crimes to predict the likelihood of crimes in the future. These predictions can be made more accurate by combining crime data with local demographic data about the local population. However, this data is time consuming and expensive to collect and so only updated rarely. Now a team of data experts have shown how combing crime data with data collected from mobile phones can make the prediction of future crimes even more accurate. The team used an anonymised dataset of O2 mobile phone users in the London metropolitan area during December 2012 and January 2013. They then used a small portion of the data to train a machine learning algorithm to find correlations between this and local crime statistics in the same period. Finally, they used the trained algorithm to predict future crime rates in the same areas. Without the mobile phone data, the predictions have an accuracy of 62 per cent. But the phone data increases this accuracy significantly to almost 70 per cent. What's more, the data is cheap to collect and can be gathered in more or less real time. Whether the general population would want their data used in this way is less clear but either way Minority Report-style policing is looking less far-fetched than when the film appeared in 2002.

64 comments

  1. Price of safety by Jonifico · · Score: 1

    Crime reduction is certainly a worthy reward, but as the article says, lots of people might not be too happy with having their information shared this way. Let's hope it is truly anonymous (which I doubt) and see how it goes.

    1. Re:Price of safety by CanHasDIY · · Score: 4, Insightful

      Crime reduction is certainly a worthy reward, but as the article says, lots of people might not be too happy with having their information shared this way.

      Especially considering that said "information sharing" leads to a mere 8% increase in accuracy.

      Let's hope it is truly anonymous (which I doubt) and see how it goes.

      Let's assume that it's not, and see how it's used nefariously. That's not cynicism, that's realism.

      --
      An enigma, wrapped in a riddle, shrouded in bacon and cheese
    2. Re:Price of safety by edawstwin · · Score: 1

      The real question is "Is it worth invading privacy for any increase?" And, to be fair, it's an 8 percentage-point increase, or a 13% increase in accuracy.

      --
      I don't want to achieve immortality through my work. I want to achieve it by not dying. - Woody Allen
    3. Re:Price of safety by PPH · · Score: 1

      Let's hope it is truly anonymous

      Some interesting data could still be collected. If the same phone repeatedly appears near the scene of a crime, one could deduce that crimes will occur in the future in its proximity.

      From TFA:

      Their analysis shows that some mobile phone data is more important than others. For example, the data relating to whether or not the phone owner was at home, was particularly strongly correlated with crime patterns.

      Not so anonymous, IMO.

      --
      Have gnu, will travel.
    4. Re: Price of safety by CanHasDIY · · Score: 2

      Yes, it is. Your "privacy" is not worth a human life. And no, you don't get to have any say in the matter.

      Sayeth the Anonymous Coward.

      Why not include your name, address, and contact info on every post? after all, your "privacy" is not worth the chance that you might someday take a human life, right jackass?

      --
      An enigma, wrapped in a riddle, shrouded in bacon and cheese
    5. Re: Price of safety by Anonymous Coward · · Score: 0

      I say we lock every person up in an individual cage with precisely enough food and water to ensure they're protected from attack by anyone else. Tie them down, too, in case they go mad and try to self-harm.

      "Freedom" is not worth a human life. And no, you don't get to have any say in the matter.

    6. Re: Price of safety by edawstwin · · Score: 1

      Your "privacy" is not worth a human life.

      Right. Because every crime takes a human life.

      --
      I don't want to achieve immortality through my work. I want to achieve it by not dying. - Woody Allen
    7. Re:Price of safety by Paradise+Pete · · Score: 2

      Especially considering that said "information sharing" leads to a mere 8% increase in accuracy.

      Speaking of accuracy, it went from 62% to 70%. While indeed that is eight percentage points, it's a nearly 13% improvement.

    8. Re: Price of safety by Githaron · · Score: 3, Interesting

      News to me considering the founders of the United States fought a war partially over this. Ever hear of the Bill of Rights?

    9. Re:Price of safety by Anonymous Coward · · Score: 0

      I can think of a couple of other ways to apply this:

      1. If a phone that spends 90% of its time in Compton suddenly shows up in Bel Air...
      2. If a phone regularly transitions between towers at 100mph...
      3. If a phone that spends 90% of its time in Bel Air makes a 5-minute stop in Compton every once in a while...

    10. Re:Price of safety by CanHasDIY · · Score: 1

      Point being, my privacy is worth more than 13%.

      --
      An enigma, wrapped in a riddle, shrouded in bacon and cheese
    11. Re:Price of safety by Anonymous Coward · · Score: 0

      Let's assume that it's not, and see how it's used nefariously. That's not cynicism, that's realism.

      That's... not realism at all. In reality, people give up their security and privacy all the time for the most trivial of things, like cat videos.

    12. Re:Price of safety by Actually,+I+do+RTFA · · Score: 1

      Especially considering that said "information sharing" leads to a mere 8% increase in accuracy.

      Well, closer to 22%. While it's true that 8% of the predictions are more accurate, what is important is that ~22% of the predictions that used to be wrong are no longer. In much the same way as if it went to 100% accurate, you don't get to bitch about it being only a 38% increase in accuracy. You get to talk about whether it's worth the cost, and how we can get something only 62% as accurate without the cost.

      --
      Your ad here. Ask me how!
    13. Re: Price of safety by escetic7659 · · Score: 1

      A life isn't sacred in and of itself, just because it is a life. If you devalue life to the point where the government owns your privacy, essentially owning you, it's worth less than a life of freedom. Fundamental freedom cannot be separated from privacy or even anonymity. Who has privacy and anonymity is more free than who does not. Now, if you can't be said to, by right, legal or otherwise, own your own information about yourself, and you have no control over that information, and governments or corporations are using it to control or influence the decisions you make, or control what you do or don't do, especially if you're not aware of it, then you are not free in any meaningful sense, not even if you're an American and the government is the US. The minute people started to be documented was the minute they started losing freedoms. Likewise when the government reserved the right to be less transparent than you.

    14. Re:Price of safety by wgoodman · · Score: 1

      62% to "nearly 70%"
      That could easily be 66% and optimism.

    15. Re:Price of safety by pnutjam · · Score: 1

      Not even an 8% increase, that press release (article) says almost 70%. It is certainly not 70% or they would be saying almost 75%.

    16. Re: Price of safety by davester666 · · Score: 1

      Everyone's privacy must be ignored because doing so might save a life somewhere, sometime.

      --
      Sleep your way to a whiter smile...date a dentist!
    17. Re: Price of safety by CanHasDIY · · Score: 1

      Meh. I see that argument used frequently on /.

      ... and you've done nothing to prove the aforementioned argument wrong. Good job.

      --
      An enigma, wrapped in a riddle, shrouded in bacon and cheese
  2. Cannot stop the crime by Anonymous Coward · · Score: 0

    of spamming with unreadable links.

  3. Here's the algorithm by badzilla · · Score: 3, Insightful

    More phones in an area = more people. More people = more crime.

    --
    "Don't belong. Never join. Think for yourself. Peace." V.Stone, Microsoft Corporation
  4. A self-defensive mobile? by Anonymous Coward · · Score: 0

    If your mobile detects you are going into an area where it is likely to be stolen, does it start to vibrate nervously, or bleep as warning? Maybe we just need an app that automatically sounds an alarm "help I'm going to be stolen any minute now", presumably followed by "no no aaaaargh" and "that's another fine mess you've gotten me into" before self-destructing.

    Slight danger is the user putting the sensitivity too high, but that's all good for people selling replacements...

    1. Re:A self-defensive mobile? by grahamm · · Score: 1

      Which would just be a notification to the would be thieves that you have a phone worth stealing!

  5. NSA Propaganda by Anonymous Coward · · Score: 0

    Right in Slashdot !

  6. Sorry, but no. by Anonymous Coward · · Score: 1

    "Let's hope" increasingly is not good enough. There is a point where just going forward without applying what we learned or even learning from what happened before in similar situations (your "hope" here) becomes criminal negligence. If we're not past that point for everybody yet, and apparently not past it for those who should be paying attention to this sort of thing, we're certainly past it for those who do pay attention to what happens in this space.

  7. Re:obCorrelation/Causation by Anonymous Coward · · Score: 1

    This has nothing to do with caucasions.

  8. 8pts? by Lawrence_Bird · · Score: 1

    fuck them. Almost 2/3 prediction from existing crime stats. Gee I know a lot of cops aren't the brightest but really? Thats not enough of a leg up?

  9. Milk by pr0t0 · · Score: 2

    The "machine learning algorithm" is a euphemism for three hairless teenagers floating in pools of milk.

    Watch out for the spiders.

    --
    I'm sorry, but your opinion seems to be wrong.
    1. Re:Milk by Anonymous Coward · · Score: 0

      Citation or you're a liar!

  10. Doubtful by Anonymous Coward · · Score: 4, Interesting

    62% to 70% isn't exactly groundbreaking for something that varies greatly. This increase looks suspiciously like selecting results for passing a statistical test instead of using a statistical test to verify the significance of a given result. Relevant xkcd: Significant.

    Also, there is no such thing as anonymised phone data.

    1. Re:Doubtful by Anonymous Coward · · Score: 0

      Too many variables, too many degrees of freedom.

  11. Criminal's phones by Spamalope · · Score: 2

    This just in: If you track the location of criminal's cell phones you can predict areas at higher risk for crime.

    1. Re:Criminal's phones by stephanruby · · Score: 1

      Or as an alternative: If you track the location of cop's cell phones you can predict areas at higher risk for crimes, after they've been called in.

  12. Typical statistics by s.petry · · Score: 2

    Expounding on your statistics point as I agree that there is no significant increase in accuracy, notice the key phrase in the article.

    The team used an anonymised dataset of O2 mobile phone users in the London metropolitan area during December 2012 and January 2013. They then used a small portion of the data to train a machine learning algorithm to find correlations between this and local crime statistics in the same period.

    In other words, they took everything they gathered and pulled a subset that matched criteria that would back the claim that they could detect future crimes.

    Computers can surely show what law enforcement already knows. E.G. That area is a known crime area. Computers don't make tea leaf reading possible, which is the claim that both Governments and Tech companies peddling software claim. Even worse, this type of technology does absolutely nothing to address the problems that actually cause most criminal activities. It exacerbates those problems because the economy this generates does not transfer down to desperate and impoverished people.

    --

    -The wise argue that there are few absolutes, the fool argues that there are no probabilities.

    1. Re:Typical statistics by Actually,+I+do+RTFA · · Score: 2

      In other words, they took everything they gathered and pulled a subset that matched criteria that would back the claim that they could detect future crimes.

      While it's possible that they did in fact pull a biased sample, this methodology is what I was taught in academia as a legit way to test machine learning. If you have one sample set, first split it into two. Use one set, usually much smaller, to train the neural network. That data set, because it's tuned to find those specific correlations, obviously produced really good predictions. So you use the second data set to test whether the inputs correctly predict the outputs.

      --
      Your ad here. Ask me how!
    2. Re:Typical statistics by s.petry · · Score: 1

      They did not submit a smaller sample as academia would teach, they submitted a small set of "select" data (their words, not mine).

      If you are only teaching a bias only a bias will be understood.

      --

      -The wise argue that there are few absolutes, the fool argues that there are no probabilities.

    3. Re:Typical statistics by Actually,+I+do+RTFA · · Score: 1

      I read "select" as meaning specific fields (as in, select types of data), not deliberately selected subsets of data... got a quote that helps clarify things?

      --
      Your ad here. Ask me how!
    4. Re:Typical statistics by s.petry · · Score: 1

      Nope, I don't have anything not provided in TFA. I always trust that the language used is intentional. If they meant something other that what was stated they could and should have used different language.

      --

      -The wise argue that there are few absolutes, the fool argues that there are no probabilities.

    5. Re:Typical statistics by pnutjam · · Score: 1

      To be fair, that press release (article) had alot of weasel words.

  13. Percent. . .Percent. . . PERCENT! by Paco103 · · Score: 1

    Any article citing statistics is invalid when they don't understand the difference between percent and per cent. Getting 62 things right per US penny is a VERY cost effective system, probably regardless of what information we want to get right.

    Unfortunately, all this says is that if we place our population under total surveillance with trackers, we can increase anticipation of crime by 8% (accuracy of 62 to ALMOST 70%). This says nothing about preventing those crimes or what type of crimes it prevents. Actually if you read the article, it only increased accuracy to 68%, so a 6% gain. Way to glorify the stats in the media. They should have said "just over 60% to almost 70%". This would have made this 6% increase look like a 10% increase.

    1. Re:Percent. . .Percent. . . PERCENT! by Neil+Boekend · · Score: 1

      I expect it's protection against invasion of privacy is limited.

      --
      Well, I might have a way, but it only works on a semi spherical planet in a vacuum.
    2. Re:Percent. . .Percent. . . PERCENT! by Mr.+Slippery · · Score: 1

      Any article citing statistics is invalid when they don't understand the difference between percent and per cent.

      FYI: "The one-word percent is standard in American English. Percent is not absent from other varieties of English, but most publications still prefer the two-word per cent. The older forms per-cent, per cent. (per cent followed by a period), and the original per centum have mostly disappeared from the language (although the latter sometimes appears in legal writing).

      "There is no difference between percent and per cent. Choosing between them is simply a matter of preference." -- http://grammarist.com/spelling/percent-per-cent/

      --
      Tom Swiss | the infamous tms | my blog
      You cannot wash away blood with blood
    3. Re:Percent. . .Percent. . . PERCENT! by Paco103 · · Score: 1

      Well, I will consider myself schooled! Thank you for educating me. That has always been a huge annoyance of mine and many others I know, but I guess it actually does make more sense when considering the origin of the word. I am saddened that one of my huge pet peeves is apparently unjustified, but in time I will adjust.

      On the other hand, I still love finding unnecessary quotes in public!

  14. I see you.... by zmaragdus · · Score: 1

    Big Brother is watching you. Again. Even when they say they're not.

    --
    (((dB)))
  15. Minority Report?? by Anonymous Coward · · Score: 0

    Are we in the future yet?

  16. We KNOW who commits the most crime... by Anonymous Coward · · Score: 1

    ... in London... and in which parts...

    But we're not allowed to say...

    1. Re:We KNOW who commits the most crime... by Anonymous Coward · · Score: 0

      Parliament?

  17. Doubtful by Anonymous Coward · · Score: 0

    In what way does it more closely resemble "selecting results" than real results?

  18. The act of detecting changes your results by dkman · · Score: 1

    If I determine that this area is more likely to have a crime and increase police presence, then the crime doesn't happen because there's too much "heat" then haven't I skewed my results?

    Or do you intend to have the cops lay low so they can "catch them in the act" or at least catch them quicker "after the fact"?

    --
    I refuse to sign
    1. Re:The act of detecting changes your results by dkman · · Score: 2

      As far as the 8% being insignificant, if the 8% is cheap to gain then I view that as significant.

      As for public data being collectively aggregated without permission - that's another story.

      Hell, they should be handing out cell phones for free they use your data for so much nowadays.

      --
      I refuse to sign
    2. Re:The act of detecting changes your results by Anonymous Coward · · Score: 0

      If I determine that this area is more likely to have a crime and increase police presence, then the crime doesn't happen because there's too much "heat" then haven't I skewed my results?
       

      This is what happened with cameras: Introduce a camera to an area with a high occurrence of vandalism, staff an officer to monitor the camera, send a squad car as soon as some one starts to spray paint a wall. Eventually, the criminals figure out that they are getting caught because of a camera, and they move to an area with no camera. Put a camera there, repeat, except the officer has to monitor 2 cameras.

      Eventually you get 10,000 camera's, 30 squad cars that can respond, and one officer to monitor the whole thing, and vandalism is back to the levels where it was before because they know that there is very little chance that the over worked officer will catch them in the act.

      Same thing with this system. It'll work as long as you have resources to send a physical presence to the area. As soon as the criminals understand the basis of the system, you'll be back to "normal" crime levels as there are to many "hot spots" and not enough police to respond (which, IMO is how it should be)

    3. Re:The act of detecting changes your results by AHuxley · · Score: 1

      The GCHQ was very aware of this in the 1960's on and did all it could to ensure people saw radomes and satellite dishes as been for tracking Soviet movements deep into Eastern Europe.
      ie not a gov ground station getting domestic calls.
      UK law enforcement and political parties where more interested in phone calls, later cell phone tracking, rapid decryption of consumer grade computer encryption and getting legally safe convictions in closed courts.
      Government Technical Assistance Centre (GCHQ Technical Assistance Centre), National Technical Assistance Centre and other units where set up to try and hide the GCHQ role in tracking and helping with crime from courts.
      The problem the GCHQ had was that such details about such efforts would make it to the press, lawyers, the public and the people been tracked or court cases been worked on.
      Smart people in the press, legal system and police forces quickly saw the new tasks and the interesting people changed methods away from easy signals intelligence just as the GCHQ had always predicted. All the UK police could do is try and find out who leaked but details about that leak hunt went public too.
      Contrast with the US views around keeping all domestic call data and using it in court as a talking point.
      The easy days of voice prints, "catch them in the act" or at least catch them quicker "after the fact" dont last if people dont need the the phone or computer.
      The other option is to place or turn an informant but that has always been more interesting.

      --
      Domestic spying is now "Benign Information Gathering"
  19. Bad Analogy by Baby+Duck · · Score: 2

    This is not like Minority Report at all. It predicts which locations at which times have a higher probability of a crime committing. It does not predict the particular crime, transgressor, or victim. It won't actually stop any crime from happening. The best it can do is allow a police force to more intelligently deploy their forces. They will be more able to rapidly respond to crimes after they happen, since statistically, they will more often have officers already dispatched to the nearby crime area.

    --

    "Love heals scars love left." -- Henry Rollins

    1. Re:Bad Analogy by Anonymous Coward · · Score: 0

      Worse than that, it's only 62% accurate. I could do the same thing without using their "machine learning algorithm". Pick a neighborhood with a lot of crime (aka a lot of criminals), use location data to see what times of the day people typically congragate and where, call it minority report.

      More people in a given area = more criminals in a given area = more crime. That's likely to give me 62%. I could probably trade in the location data for basic observation.

    2. Re:Bad Analogy by phoenix321 · · Score: 1

      If you have a small enough town with a small enough cell size, it should be blindingly obvious which handset IMSI numbers where usually in the area when a crime was committed.

      With enough data, you can simply map out the handset IMSI of the most probable perpetrators. There were 5 instances of a street robbery, at night, and the only common denominator is IMSI xyz that has been in the vicinity and moving around the time of all 5 robberies. It either is a totally unlucky individual or the most likely suspect.

      Follow that IMSI with a drone for a few nights, record evidence and then lock these people away.

      Note that I don't mind any and all police activity directed against common street thugs, as long as they have reliable evidence against them. (not dealers, not pimps, not smugglers, maybe not even thieves - but violent criminals that assault and rob innocent people or even invade their homes deserve absolutely no mercy.)

  20. Sigh. by ledow · · Score: 1

    "significantly"

    I do not think that word means what you think it means.

  21. Re:obCorrelation/Causation by nospam007 · · Score: 1

    "In other words, they found where the poor people live by looking at phone data."

    No they found out that crime happens where the criminals are.
    Groundbreaking.

  22. phone app auto tracks, health, academics, behavior by bd580slashdot · · Score: 1

    New Dartmouth smartphone app reveals users' mental health, performance, behavior

    Dartmouth researchers and their colleagues have built the first smartphone app that automatically reveals students' mental health, academic performance and behavioral trends. In other words, your smartphone knows your state of mind -- even if you don't -- and how that affects you.

    The StudentLife app, which compares students' happiness, stress, depression and loneliness to their academic performance, also may be used in the general population – for example, to monitor mental health, trigger intervention and improve productivity in workplace employees.

    "The StudentLife app is able to continuously make mental health assessment 24/7, opening the way for a new form of assessment," says computer science Professor Andrew Campbell, the study's senior author. "This is a very important and exciting breakthrough."

    The researchers presented their findings on Wednesday at the ACM International Joint Conference on Pervasive and Ubiquitous Computing. The paper has been nominated for best paper at UbiComp, the top conference mobile computing. A PDF of the paper and a summary of the findings are available on request. They also released an anonymized version of the dataset in the hope that other social and behavioral scientists will use it in further studies.

    The researchers built an Android app that monitored readings from smartphone sensors carried by 48 Dartmouth students during a 10-week term to assess their mental health (depression, loneliness, stress), academic performance (grades across all their classes, term GPA and cumulative GPA) and behavioral trends (how stress, sleep, visits to the gym, etc., change in response to college workload -- assignments, midterms, finals -- as the term progresses).

    They used computational method and machine learning algorithms on the phone to assess sensor data and make higher level inferences (i.e., sleep, sociability, activity, etc.) The app that ran on students phones automatically measured the following behaviors 24/7 without any user interaction: sleep duration, the number and duration of conversations per day, physical activity (walking, sitting, running, standing), where they were located and how long they stayed there (i.e., dorm, class, party, gym), stress level, how good they felt about themselves, eating habits and more. The researchers used a number of well known pre- and post-mental health surveys and spring and cumulative GPAs for evaluation of mental health and academic performance, respectively.

    The results show that passive and automatic sensor data from the Android phones significantly correlated with the students' mental health and their academic performance over the term.

    Some specific findings: Students who sleep more or have more conversations are less likely to be depressed; students who are more physically active are less likely to feel lonely; students who are around other students are less likely to be depressed. Also, surprisingly, there was no correlation between students' academic performance and their class attendance; students who are more social (had more conversations) have a better GPA; students who have higher GPAs tend to be less physically active, have lower indoor mobility at night and are around more people.

    The results open the door to the following breakthroughs for the first time:

    your phone automatically knows if you are depressed, stressed or lonely
    the phone sensor data can predict student GPA
    coupled with intervention software, students can track their mental health and academic performance indicators with the goal of improving both
    the app (and its methods) are applicable to non-student groups, such as workplace employees, with the goal of improving productivity or radically reducing stress -- your phone will know how productive you are on a daily basis.

    "Under similar condit

  23. How many false positives though by Mister+Liberty · · Score: 1

    TL;DR

  24. Re ...Crime location updated rarely" - WRONG! by ashore_tick · · Score: 1

    Ummm, re " ... this [crime] data is time consuming and expensive to collect and so only updated rarely....": Wrong! Not at all so. Most CAD's - Computer-Aided-Dispatch - including our own free, Open Source contribution at www.ticketscad.org - do exactly that. It's inherent to the task of dispatch management. AS

  25. Algorithms are not hindered by wishful thinking by phoenix321 · · Score: 1

    We know that people that commit crimes are much more often from certain social and cultural backgrounds. There are untold numbers of "anecdotal evidence" around, but we don't want that to be true. So we tell ourselves white lies, blame victims, discount hundreds of incidents as "anecdotal evidence", pinpoint the few cases outside the norm and fabricate elaborate excuses about why such and such were practically forced to commit crime. We are constantly telling ourselves how we are to blame for not paying enough welfare, not enough education, not giving enough leeway while conveniently ignoring millions of people of other social and cultural backgrounds that simply don't commit any more crime than everyone else, being good people despite being poor and uneducated.

    Choices of cellphone contracts and handset make and models are similar along cultural and social bonds. An algorithm will never know about that but detect the significance.

    But anyway, even among the groups with the highest part in crime, only a few select individuals are responsible for a large percentage of crime.

    Algorithms will find that when IMSI xyz is in the general area, people will get robbed. It will also find that when expensive handsets with IMSI abc where in the area when a phone robbery happened, they will probably be around the next crime area as well, since the thief will either have it now or sold it to a pawn shop in the high crime area.

  26. Re:phone app auto tracks, health, academics, behav by CanHasDIY · · Score: 1

    I don't buy it - an app that monitors every sensor, plus apparently monitoring abstract stuff like "stress level" somehow, 24/7?

    Wouldn't that pretty much lock up and drain the battery of almost every phone on the market today? Hey, maybe that's how they determined stress level - using the accelerometer to determine how hard the student threw the phone against the wall when it froze up on them for the last time.

    --
    An enigma, wrapped in a riddle, shrouded in bacon and cheese