Slashdot Mirror


New York City Moves To Create Accountability For Algorithms (propublica.org)

The algorithms that play increasingly central roles in our lives often emanate from Silicon Valley, but the effort to hold them accountable may have another epicenter: New York City. From a report: Last week, the New York City Council unanimously passed a bill to tackle algorithmic discrimination -- the first measure of its kind in the country. The algorithmic accountability bill, waiting to be signed into law by Mayor Bill de Blasio, establishes a task force that will study how city agencies use algorithms to make decisions that affect New Yorkers' lives, and whether any of the systems appear to discriminate against people based on age, race, religion, gender, sexual orientation or citizenship status. The task force's report will also explore how to make these decision-making processes understandable to the public. The bill's sponsor, Council Member James Vacca, said he was inspired by ProPublica's investigation into racially biased algorithms used to assess the criminal risk of defendants. "My ambition here is transparency, as well as accountability," Vacca said.

9 of 183 comments (clear)

  1. Re:Now hold Trump accountable for TREASON by HornWumpus · · Score: 3, Insightful

    Republican!

    These people are obviously just fakes, making Democrats look unhinged.

    But it's believable because the Ds _have_ lost control of their loonies. Unless the Ds check their lunatic fringe, Trump is good for two terms.

    --
    John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
  2. More idiocy by alvinrod · · Score: 4, Insightful

    Algorithms don't discriminate if you remove the kind of data (race, age, etc.) that would allow them to make categorizations or judgments based on that data. But if you examine the results after the fact and reapply those labels and find some difference in outcomes, its because there is some difference in input, not a category identifier. If you find your algorithm thinks African Americans are a worse lending risk, it's likely because they're categorically less well off financially than other demographic groups, not because its racist against black people.

    This kind of idiotic approach is just ignoring the actual underlying problems or differences in favor of trying to slap a band-aid on top of it to assuage guilty feelings. Worse yet, it prevents confronting the actual issues head on and is doomed to failure.

    1. Re:More idiocy by Baron_Yam · · Score: 1, Insightful

      If you're dealing with medicine, noting ethnic differences is important. Doctors understand probabilities and knowing when certain probabilities are elevated can significantly alter diagnostics and treatment to the benefit of the patient.

      Unfortunately, when you're dealing with most other things... you get discrimination. Maybe - to use your example - your algorithm thinks African Americans are a worse lending risk. That's a problem all on its own because that result will be used not to be more cautious financially with the group over all, but to discriminate against individuals and deny them loans based on skin colour.

      And yes, that's actually a problem with the people (mis)using the algorithms, but that's not an excuse for failing to take preventative measures against such misuse.

    2. Re:More idiocy by Anonymous Coward · · Score: 2, Insightful

      The more we learn about science, the more we are going to want to bury our head in the sand and ignore it.

      Yes, in medicine there are statistical differences between the races.

      What if, just maybe, beyond skin color, there are genetic differences between the races in how people value life, truth, and their propensity to violence. This is where people want to bury their heads in the sand. It's time we get honest and accept these truths.

    3. Re:More idiocy by CanHasDIY · · Score: 3, Insightful

      If you're dealing with medicine, noting ethnic differences is important. Doctors understand probabilities and knowing when certain probabilities are elevated can significantly alter diagnostics and treatment to the benefit of the patient.

      And yet, I guarantee some non-doctors out there will claim it's racist to only test black people for sickle-cell anemia. This is why we can't have nice things - we allow the ignorant people to have an equal voice to the knowledgeable.

      --
      An enigma, wrapped in a riddle, shrouded in bacon and cheese
  3. Re:Now hold Trump accountable for TREASON by Hal_Porter · · Score: 1, Insightful

    Yeah, it was outrageous when Trump was caught on an open mike promising Medvedev 'more flexibility' after the election. Collusion and treason!

    Oh wait, that was Obama

    --
    echo -e 'global _start\n _start:\n mov eax, 2\n int 80h\n jmp _start' > a.asm; nasm a.asm -f elf; ld a.o -o a;
  4. Re:Mirror by cayenne8 · · Score: 3, Insightful
    Hmm.....so, if these councils reviewing these algorithms that are finding actual bonafide trends, that happen to break along racial, sexual, [insert special interest here]...and that don't happen to fit the politically correct meme of the day, that they will insist these be thrown out?

    So, facts....if inconvenient....are not to be used or trusted?

    Hmm...isn't that kinda deleting the purpose?

    --
    Light travels faster than sound. This is why some people appear bright until you hear them speak.........
  5. Re:Mirror by CanHasDIY · · Score: 4, Insightful

    Right.

    Because apparently, in 2017, math became racist.

    --
    An enigma, wrapped in a riddle, shrouded in bacon and cheese
  6. Re:Now hold Trump accountable for TREASON by phantomfive · · Score: 3, Insightful

    I don't care if Trump goes to jail, but as an American, I don't consider Russia our enemy. From a practical standpoint, we stand to gain more by working with Russia than working against them.

    --
    "First they came for the slanderers and i said nothing."