We Hold People With Power To Account. Why Not Algorithms? (theguardian.com)

An anonymous reader shares a report: All around us, algorithms provide a kind of convenient source of authority: an easy way to delegate responsibility, a short cut we take without thinking. Who is really going to click through to the second page of Google results every time and think critically about the information that has been served up? Or go to every airline to check if a comparison site is listing the cheapest deals? Or get out a ruler and a road map to confirm that their GPS is offering the shortest route? But already in our hospitals, our schools, our shops, our courtrooms and our police stations, artificial intelligence is silently working behind the scenes, feeding on our data and making decisions on our behalf. Sure, this technology has the capacity for enormous social good -- it can help us diagnose breast cancer, catch serial killers, avoid plane crashes and, as the health secretary, Matt Hancock, has proposed, potentially save lives using NHS data and genomics. Unless we know when to trust our own instincts over the output of a piece of software, however, it also brings the potential for disruption, injustice and unfairness.

If we permit flawed machines to make life-changing decisions on our behalf -- by allowing them to pinpoint a murder suspect, to diagnose a condition or take over the wheel of a car -- we have to think carefully about what happens when things go wrong.

Comments

Ultimately, a human should be held accountable

[Anonymous Coward]

If a prosecutor or judge uses an algorithm to set sentencing or determine parole, the individual prosecutor or judge should still be held accountable if he was in error.

This applies if the algorithm is a "paper and pencil" fill-out-a-worksheet algorithm or if it's a complex computational algorithm that the judge or prosecutor can't understand. In the latter case, if the judge or prosecutor can't understand the tools he is using, perhaps he should use less sophisticated tools that he does understand.

Re:Ultimately, a human should be held accountable

[jellomizer]

This is sometime I keep on trying to state at work.
This program will help you find things easier. However I cannot program judgement and years of experience, even a learning algorithm may not have data because some things are not recorded.
Customer X has been a good customer for years, however this month he is behind, this customer actually called the company and let them know that. The computer algorithm will see the late payment, and perhaps send it collection, it doesn't care about the long term relationship.
An algorithm should be allowed to run, however a human is ultimately responsible to but a stop to an action.

Since when?

[pablo_max]

Seriously, the "powerful" have not been help accountable for fuck-all in the US since after the 50's.

Maybe you should rather start with that before you starting picking on maths.

Re:Since when?

[Luthair]

I think you're optimistic, the only time in human history when people in power are held to account is when they were lynched by a mob.

Re:Since when?

[lgw]

They were accountable before the 50s?

The only thing that ever held those in power accountable was competition from others with power. For most of the medieval period, for example, church and state each limited the excess of the other. Local Baron get to evil with his serfs? Local clergy would call him out on his immorality, even if they were total hypocrites, in order for the church to gain power at the expense of the secular authorities (and vice versa). When the balance of power tilted too far towards the church in the late medieval/early renaissance, we got the Inquisition, as there just wasn't enough secular power to challenge that.

You can see similar balances of power throughout history, usually between religious and secular authorities.

Right now we have an entirely fictitious "competition" for power between government and large corporations. But that's all a fraud to deceive voters: they together form the Establishment, all pro-mega-corp all the the time. Voters get a false choice between "more regulation" and "freer market", but that's all bullshit because there are only foxes guarding all the hen-houses.

Re:Since when?

[MachineShedFred]

I was going to say the same thing. I don't accept the premise of the headline, due to absolutely nobody of consequence being held accountable for anything of consequence for the financial meltdown / subprime mortgage fiasco. Once we actually start holding people accountable for things, we can then worry about evil bits being set in registers.

We hold powerful people to account?!

[Bugler412]

That's news to me

Re:We hold powerful people to account?!

[ooloorie]

It should be. If you exercise your power within the bounds of law and contract, there is nothing to hold you to account for.

a "report"?

[cascadingstylesheet]

This is an editorial.

First, we do not

[gweihir]

Be powerful enough and you can commit almost any crime and get away with it. Second, you cannot hold an abstract concept accountable.

We do?

[Anonymous Coward]

When was the last bankster to go to prison?