Slashdot Mirror


Wisconsin's Prison-Sentencing Algorithm Challenged in Court (engadget.com)

"Do you want a computer to help decide a convict's fate?" asks Engadget, telling the story of a Wisconsin convict who "claims that the justice system relied too heavily on its COMPAS algorithm to determine the likelihood of repeat offenses and sentenced him to six years in prison." Sentencing algorithms have apparently been in use for 10 years. His attorneys claim that the code is "full of holes," including secret criteria and generic decisions that aren't as individually tailored as they have to be. For instance, they'll skew predictions based on your gender or age -- how does that reflect the actual offender...?

[T]he court challenge could force Wisconsin and other states to think about the weight they give to algorithms. While they do hold the promise of both preventing repeat offenses and avoiding excessive sentences for low-threat criminals, the American Civil Liberties Union is worried that they can amplify biases or make mistakes based on imperfect law enforcement data.

The biggest issue seems to be a lack of transparency, which makes it impossible to determine whether convicts actually are receiving fair sentences.

15 of 228 comments (clear)

  1. Yes please by penguinoid · · Score: 5, Insightful

    If you think a computer is biased and unfair and makes decisions using secret criteria, wait till you meet a human!

    --
    Don't waste your vote! Vote for whoever you want, unless you live in a swing state it won't matter anyways
    1. Re:Yes please by Archfeld · · Score: 5, Insightful

      There is no AI involved, just some code written by humans. A computer cannot express compassion. IMHO Compassion is the highest virtue, and the first to be discarded. Hope can be rekindled, faith restored, love reunited but compassion once lost is rarely seen again. Even the guilty deserve compassion, it is that which elevates man from beast. We do that which is necessary but it should NOT stop us from being sorry it has to come to that.

      --
      errr....umm...*whooosh* *whoosh* Is this thing on ?
    2. Re:Yes please by Actually,+I+do+RTFA · · Score: 3, Insightful

      People are complaining because the computer is biased, and unfair, and uses secret criteria and it disagrees with human intuition.

      But algorithmic bias is worse than human bias, because people know other humans are biased, but give a pass to computers.

      --
      Your ad here. Ask me how!
    3. Re:Yes please by JoeMerchant · · Score: 5, Insightful

      The advantage of a computer algorithm is that it can be analyzed, refined, improved, and relied upon to function more or less as well as it did in the past (assuming the new inputs aren't radically different from the previous ones.)

      Now, judges - they come to their position through politics and lawyering, two selection criteria that would seem to get you the last people you would want to determine what is fair or reasonable for "the people at large." Even 200+ years ago this was recognized and is the basis for "trial by jury of peers" laws, and everyone knows that amounts to a random lottery style decision, but it's still better than leaving it up to a judge.

    4. Re:Yes please by taustin · · Score: 3, Insightful

      The advantage of a computer algorithm is that it can be analyzed, refined, improved, and relied upon to function more or less as well as it did in the past (assuming the new inputs aren't radically different from the previous ones.)

      Not when the entire process is kept secret. Which is the complaint here.

    5. Re:Yes please by Anonymous Coward · · Score: 4, Insightful

      Most of the algo's used are "privately developed", and thus not released because that would involve revealing "business critical information" (which obviously trumps the interests of the person being sentenced on the basis of it). Because the primary aim is to provide private entities with contracts/work/govt money.

    6. Re:Yes please by Anonymous Coward · · Score: 0, Insightful

      There's basically zero room for compassion in the justice system.

      Justice is blind for more than one reason.

    7. Re:Yes please by JoeMerchant · · Score: 3, Insightful

      If the algorithm is secret, then it's worse than trusting a judge who can be removed from the bench any number of ways.

      Judges are supposed to follow the law, which is public knowledge. If we're algorithmically systematizing sentencing, that algorithm needs to be public too - before the evidence comes out in the algorithm's output.

  2. Re:And this is different how? by PopeRatzo · · Score: 2, Insightful

    don't see Brock Turner complaining much.

    Actually, Brock Turner's dad absolutely did complain that 6 months was too severe of a sentence for his special snowflake rapist son.

    --
    You are welcome on my lawn.
  3. The real issue is lack of transparency by cowtamer · · Score: 5, Insightful

    While the idea of using an algorithm to sentence a human being is bone-chilling, you might be able to justify this as a "formula" for sentencing -- which, of course, merits its own debate.

    What is unconscionable about this is the fact that it's a SECRET algorithm. As in closed source. Essentially a secret law.

    This has no place in democracy.

    (Also, any algorithm which ingests statistical and demographic data is bound to come up with unpalatable and/or spurious demographic correlations (since there is a causal link between poverty and crime and a historic link between race and poverty) which I wold rather have society refrain from codifying -- in law or in actual computer code).

  4. Statistics by Hognoxious · · Score: 4, Insightful

    For instance, they'll skew predictions based on your gender or age -- how does that reflect the actual offender...?

    It doesn't and it's not intended to.

    It's statistics and probabilities, just like how insurance premiums work.

    --
    Confucius say, "Find worm in apple - bad. Find half a worm - worse."
    1. Re:Statistics by NotInHere · · Score: 4, Insightful

      like how insurance premiums work.

      That *is* skewing predictions based on gender and age.

      If a computer program deduces from the fact that you are male that you will live a shorter time, and this makes women receiving lower payments due to them being more likely to live longer.

      As this discriminated against women, this practice was swiftly forbidden by the EU. It probably wouldn't have been forbidden if it discriminated against men, but that's another issue. It was actual gender based discrimination.

      If you let a computer program take factors like skin color or religion into account, that computer program will arrive at similar conclusions that humans arrived:

      * blacks do more crimes per thousand people than white people
      * highly educated people do less crimes than less educated people
      * More muslims commit terrorist attacks than non-muslims

      This doesn't mean that black people are ape-like, or that less educated people are automatically criminals. It usually just is a correlation, which doesn't imply causation. If you took a black person, and remove them from all the racist and discriminatory influences, AND the lower social status (that has been caused by lots of discrimination before), then won't end up with a higher crime likeliness than if you took a "normal" white person. Its probably even more caused by the social status than discrimination.

      As for muslims, its simply caused because there is no powerful christian group that radicalizes christians to commit terror attacks. If you take the radicals out, the average muslim is as peace-loving as the average christian or jew.

      Denying the existence of these correlations to protect from discrimination is wrong. This is just fuel for people who claim that the existence is denied because people want to "cover up" something, or because people are too dumb, usual criticism by people like trump. It is also wrong though to do actual discrimination, like israel does it, or trump proposes.

  5. Re:And this is different how? by Anonymous Coward · · Score: 1, Insightful

    It wasn't rape under California law. He wasn't convicted of rape. Now, the state legislature will look at standardizing the definition of rape with that of the federal government. A conviction of rape would likely have been harsher.

  6. Re:The 'real' software by Firethorn · · Score: 4, Insightful

    Why don't they use the fundamentals used in developing the algorithm to identify and eliminate the root causes of crime (through rehabilitation/counseling) and thus reduce crime in highly prone areas?

    Honestly enough they should, there are pushes to do so, it's just that funding is an issue, as always. Funny thing is, though, it's supposed to actually save money!

    Okay, up here in Alaska low oil prices have resulted in a government crisis - the government's income has dropped drastically. One of the reforms being put in place, finally, is 'community corrections', which has been shown to save money by actually preventing repeat criminal occurrences. As they mentioned, locking people up for long periods actually increases the chance they'll reoffend, especially if you don't provide support after they get out.

    So rather than locking somebody up for 12 years, you lock them up for, say, 4. You take the money for the next 4 years of prison and put it into rehabilitating the criminal, which is enough to cover extended services in prison, as well as at least 4 years outside, because, surprise, it's cheaper than keeping them in prison. The last 4 years of prison sentence avoided is pure savings, though they mentioned that they're putting half the money into what you mentioned - addressing the core situations causing criminality in the first place.

    As for the op -

    His attorneys claim that the code is "full of holes," including secret criteria and generic decisions that aren't as individually tailored as they have to be. For instance, they'll skew predictions based on your gender or age -- how does that reflect the actual offender...?

    Secret criteria is a problem, but gender and age have clear differences on how likely you are to re-offend. If you're a first time offender at 40 odds are something very strange happened, and if you fix that problem the person is unlikely to offend again, while being a first time offender at 15 is a bad sign that it might become a habit.

    --
    I don't read AC A human right
  7. Algorithmic sentencing is a terrible idea by sjbe · · Score: 3, Insightful

    Y'all ever been to Texas?

    Not only have I been there I have family that lives there. Outside of Austin they should ask for a passport for most of the state to go there. I make no apologies when I say many Texans have some seriously messed up ideas about what constitutes "justice".

    Algorithmic sentencing is one way to move toward a more consistent system, less subject to the vagaries of individual jurisdictions.

    Consistency isn't necessarily as valuable as you might be implying. The entire point of having a judge is, you know, to judge things and come to a reasoned opinion about how the law should apply to a particular case. I could see an algorithm being useful as an aid to advise a judge on possible options but there are WAY too many corner cases for it to be a good idea to put it front and center. Are judges imperfect? Yep! That's why we have appeals systems. But you literally cannot come up with an algorithm that will properly address all the corner cases. You are merely turning the programmer and lawmakers into the de-facto judge which is a terrible idea. See three strikes laws if you need an example of how stupid algorithmic sentencing can be.

    Judgements still have to be made based on something, and credit scores (and, more specifically, the underlying data from which they are computed) are one of the strongest windows into personality and prediction of future behavior we have in today's society.

    I reject your framing of the issue. You are presuming that credit scores have any meaningful relationship to criminality without presenting any actual evidence that such an assertion is backed by facts. You are extrapolating purchasing and financial management behavior to have some relationship to criminality without any basis. Even a correlation isn't adequate because there are all sorts of ridiculous correlations between completely unrelated things. You have to PROVE a causal relationship between an individual person's credit score and their likelihood to commit future crimes for your argument to have any basis at all. Good luck with that.