Slashdot Mirror


Machine Logic: Our Lives Are Ruled By Big Tech's 'Decisions By Data' (theguardian.com)

With the advent of artificial intelligence and machine learning, we are increasingly moving to a world where many decisions around us are shaped by calculations rather than traditional human judgement. The Guardian, citing many industry experts, reminds us that these technologies filter who and what counts, including "who is released from jail, and what kind of treatment you will get in hospital." A digital media professor said, these digital companies allow us to act, but in a very fine-grained, datafied, algorithm-ready way. "They put life to work, by rendering life in Taylorist data points that can be counted and measured" From the report (edited and condensed): Jose van Dijck, president of the Dutch Royal Academy and the conference's keynote speaker, expands further. Datification is the core logic of what she calls "the platform society," in which companies bypass traditional institutions, norms and codes by promising something better and more efficient -- appealing deceptively to public values, while obscuring private gain. Van Dijck and peers have nascent, urgent ideas. They commence with a pressing agenda for strong interdisciplinary research -- something Kate Crawford is spearheading at Microsoft Research, as are many other institutions, including the new Leverhulme Centre for the Future of Intelligence. There's the old theory to confront, that this is a conscious move on the part of consumers and, if so, there's always a theoretical opt-out. Yet even digital activists plot by Gmail, concedes Fieke Jansen of the Berlin-based advocacy organisation Tactical Tech. The Big Five tech companies, as well as the extremely concentrated sources of finance behind them, are at the vanguard of "a society of centralized power and wealth. "How did we let it get this far?" she asks. Crawford says there are very practical reasons why tech companies have become so powerful. "We're trying to put so much responsibility on to individuals to step away from the 'evil platforms,' whereas in reality, there are so many reasons why people can't. The opportunity costs to employment, to their friends, to their families, are so high" she says.

31 of 64 comments (clear)

  1. The problem is not-- by Geoffrey.landis · · Score: 1

    The problem is not that decisions are being made by machines with little human input. The problem is that humans are getting very little insight into how the decisions are being made, and thus very little input into the decision making processes, and even less ability to find and correct errors.

    Machines making decisions can be a very good thing. Machines making decisions for reasons that humans are not given enough information to follow is likely to be not.

    --
    http://www.geoffreylandis.com
    1. Re:The problem is not-- by plopez · · Score: 1

      And of course GIGO. Decisions made on incomplete and questionable data. Once a data stream is polluted there is no going back. Which is why non-ACID compliance enrages me.

      --
      putting the 'B' in LGBTQ+
    2. Re:The problem is not-- by Anonymous Coward · · Score: 1

      Even if there are zero errors by the computer storing the data, there will always be problems with people inputting the data. Many people game whatever systems they're using to achieve whatever outcome they want, on an individual level. The easiest example I can think of is health care billing. The doctors, nurses, whoever might input a worse diagnosis than the patient actually has in order to get insurance to pay for it. If you go looking for real information on diseases or whatever, you're wading through a pile of complete crap.

  2. "How did we let it get this far?" she asks? by fustakrakich · · Score: 2

    Simple - *Give Me Convenience or Give Me Death*

    --
    “He’s not deformed, he’s just drunk!”
    1. Re:"How did we let it get this far?" she asks? by thinkwaitfast · · Score: 1

      I doubt much of my life is ruled by big tech's data decisions. Reap what you sow blah blah blah,

  3. Bring On The AI by brunes69 · · Score: 2, Insightful

    Indeed, the biggest problem with this article is that it starts out from a base assumption that is flawed - that for some unknown reason, human "moral judgement" is superior to that of an algorithm based on big data, without giving any logical reason WHY we should trust humans more.

    However, given the way humans act around the world globally - on average I would take a machine's judgement over a human's judgement any day of the weekm

    1. Re:Bring On The AI by Empiric · · Score: 2

      The problem is that what to "solve for" is something the machine can't self-determine. It's not a function of the data or the computer, it will always be specified by humans.

      The data itself can support "optimize for broadest human compassionate benefit" or "optimize for greatest profit"--which is better as an objective, is a value judgment. Guess which one developers are going to be told by corporate management to code for?

      --
      ~ Whence do you come, slayer of men, or where are you going, conqueror of space?
    2. Re:Bring On The AI by sjames · · Score: 2

      Here's a hint. HUMANS wrote the software. However, unlike the flawed humans making the decision openly where they might be vaguely accountable and where some may be willing to do the right thing, the bad human thinking that writes the software gets to hide behind the machine and never even has to see the consequences of it's flaws.

    3. Re:Bring On The AI by drinkypoo · · Score: 1

      The AI says your projected lifetime earnings are too small to pay off your projected lifetime debt. You die now.

      That's how it works now, except that instead of an AI, we pay a human to decide you should die. That's why I laughed and laughed and laughed at the spectacular morons who cried about ACA 'death panels'. We have death panels already and they operate without oversight.

      --
      "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
    4. Re: Bring On The AI by brunes69 · · Score: 1

      It's not a corporations job to optimize anything for human benefit. That is the job of government, or it is SUPPOSED to be, unfortunately what you have in the United States is a horribly broken system that is no longer democracy.

    5. Re: Bring On The AI by Empiric · · Score: 1

      Yes, as you suggest, here it will make little difference, because the government will outsource it.

      Elsewhere, they probably will as well, but if they don't, the government and those humans optimizing for the government's benefit will do no better.

      Neither profit not politics will provide the "objective right thing according to the data".

      --
      ~ Whence do you come, slayer of men, or where are you going, conqueror of space?
    6. Re:Bring On The AI by Anonymous Coward · · Score: 1

      The biggest problem with your comment is that it starts out from a base assumption that is flawed - that for some unknown reason, an algorithm based on big data is superior to that of human "moral judgement", without giving any logical reason WHY we should trust algorithms more.

      However, given the way algorithms act around the world globally - on average I would take a human's judgement over an algorithm's judgement any day of the weekm

    7. Re: Bring On The AI by Anonymous Coward · · Score: 1

      If corporations do not benefit humanity, why should they exist? Government cannot save you if corporations become more powerful and you demolish "the State".

    8. Re:Bring On The AI by akozakie · · Score: 2

      You use the words "algorithm based in big data" as if they had intrinsic value. They don't, period. The data - a great foundation, but the algorithm is human-made.

      Afraid of machines? Not really. We're not really making any progress towards machines having any sort of free will. I'm afraid of generation gap.

      At the moment we have a certain view of the world. This shapes our goals and interpretations. That shapes the algorithms we create. Goal functions. Criteria. Queries.

      Now, bugs aside, those algorithms will do exactly what they were designed to do. The point is, we're not nearly infallible. The goals we set now are our best current guesses about what matters. If we're short-term satisfied with the results of passing the responsibility for something to computers, we're going to just let them do it and never look back.

      Now, the world of the next generation (not really, could be 5 years apart) includes goals of the previous one implemented as core services, as the ground truth. Any mistakes of the previous one become hard to fix - you'd have to deactivate something that by now is a crucial service and rebuild it from scratch, with new goals. Not likely, there are layers and layers of useful utilities built on this, revenue streams, etc.

      In short - passing decisions to algorithms working on big data restricts our future flexibility. The algorithms are there as decision support, that's how it should be. Do not automate strategic decision making. Humans can realize they are wrong, algorithms can't, because, really, they're not - they do what they were designed to do, period. With our tendency to build new technology, processes, etc. on existing solutions if they seem to work well, that creates future dependencies which make error correction very difficult and costly.

      The science-fiction scenarios about humans as slaves to machines are likely pure fantasy. Slaves to ancient ideas of how things should be, enforced by machines... now that's much more realistic.

    9. Re:Bring On The AI by pnutjam · · Score: 1

      Current AI is really statistics (one of the big lies). It's designed with a bias, someone is making those decisions and hiding behind "AI".

  4. Insurance is cancelled by Okian+Warrior · · Score: 3, Insightful

    The AI says your projected lifetime earnings are too small to pay off your projected lifetime debt. You die now.

    Your lifetime total health insurance premiums won't cover the remaining medical costs from your car accident, your policy is hereby cancelled.

    1. Re:Insurance is cancelled by DaHat · · Score: 1

      I knew we shouldn't have given our robot overlords the ability to reproduce via creating cyborgs that do their bidding.

    2. Re:Insurance is cancelled by NotInHere · · Score: 2

      Sorry, but I think right now machines are not the thing one should fear. Its still humans. Maybe they will use machines to express their power, and then those machines will surely be scary, but I doubt that AI will enslave humans without actually having some root ssh terminal or similar to an actual human controlling it. At least not in this stage of our civilisation.

  5. IEEE Code of Ethics by Anonymous Coward · · Score: 1

    Software engineers should read the IEEE Code of Ethics, especially the part about "avoid injuring others, their property, reputation, or employment by false or malicious action."

    1. Re:IEEE Code of Ethics by plopez · · Score: 1

      Software engineers will never be true engineers.

      --
      putting the 'B' in LGBTQ+
    2. Re:IEEE Code of Ethics by drinkypoo · · Score: 1

      Software engineers will never be true engineers.

      There is or at least has been some real engineering done for the space program. Code designed to a purpose, debugged by many, many hands and then in some cases even proven. The majority of software engineers are not really doing true engineering, but that doesn't mean none of them are.

      --
      "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
    3. Re:IEEE Code of Ethics by gweihir · · Score: 1

      Some of them already are. The problem is that most are not and many currently educated will not be.

      --
      Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
    4. Re:IEEE Code of Ethics by Malcolm+Chan · · Score: 1

      Hm. How would this affect IEEE engineers who develop weapons systems?

      --

      /MC

    5. Re:IEEE Code of Ethics by Anonymous Coward · · Score: 1

      Or maybe they already are:
      https://www.youtube.com/watch?v=NP9AIUT9nos

  6. Bean counters have always existed by HalAtWork · · Score: 1

    And their numbers have always been abstracted. The numbers "big data" has come from somewhere, studies, manual input, algorithms written by humans to turn analog input into digital output, all are prone to error, as they have been in the past. When all these numbers are compiled and they are presented in a particular context by an interested party, a human decision / consultation will probably ensue, also not infallible.

    I don't really see what changes here...

  7. The Grauniad by ooloorie · · Score: 1

    I suspect a lot more lives have been ruined by the incompetent hacks at The Grauniad than by Big Data.

  8. Duh by allquixotic · · Score: 1

    I first realized something to this effect way back in 2002, when a company called Ctrax offered a download-based DRM music service for college students for a small fee (or was it free?). This was absolutely revolutionary in 2002, when Spotify, etc. didn't exist, so if you wanted to obtain large quantities of licensed music for free, this was basically one of the best ways to do it. I guess Ctrax came so early at the beginning of the "de-DRMing" of the music industry because college students were among the most egregious music pirates, so getting money out of the university and/or the students is better than getting $0 out of them. ... But you couldn't transfer the files between machines; you couldn't convert them to MP3s; you couldn't listen to them in other media players; you couldn't apply pitch shifting (and the EQ sucked); you couldn't transfer them to a mobile device; you couldn't back them up; and you'd lose access to them when your subscription to Ctrax expired.

    In other words, the company didn't trust its users, so they imposed arbitrary restrictions on users, and used your own computer hardware against you to enforce those restrictions.

    And I complained - loudly - about this in philosophical discussions in Computer Science courses. But of course everyone laughed at me for being silly about restricted music downloads because it's only a minor inconvenience, and I should be happy to have access to that much music anyway.

    Well, we gave them an inch, and now they've taken every mile of the surface of the Earth. Good job, guys.

  9. The Guardian is not a reliable source by Ferocitus · · Score: 1

    "The Guardian, citing many industry experts, reminds us that these technologies filter who and what counts..."

    The Guardian has been an unreliable rag since GCHQ made them smash up their hard-drives after the Snowden disclosures.
    https://en.wikipedia.org/wiki/...

    Any worthwhile filter would have excluded crap written by Luke Harding and Polly Toynbee.

    --
    USB, USB, USB!
  10. Re:I, for one by thinkwaitfast · · Score: 1

    Science doesn't have facts. That is for mathematicians and philosophers. Science has data, or evidence.

  11. Re:Why the fuck are you outsourcing JUDGEMENT anyw by Anonymous Coward · · Score: 1

    Because humans are notoriously inaccurate and biased when it comes to making judgments. If we could rely on people to make perfect, rational decisions constantly, there would be no:

    The problem isn't humans making bad judgments it is the runaway aggregation of power and people choosing to maximally leveraging their position by using technology against others in ways that asymmetrically alter the rules of the game in their favor.

    - Market bubbles and crashes;

    This is rank nonsense. Computers will do what they are instructed to do. They will not ever be programmed to act in ways which interfere with the objective function of their owners. Players don't give a shit about bubbles and crashes they only care about making money. There are numerous well known examples of computers causing market crashes.

    - Racism; Sexism; Most other nasty prejudiced and bigoted behavior;

    Did you even RTFA?

    https://www.theguardian.com/co...

    - negligence;

    This is a word game. Computers can't be negligent and more than a brick can be negligent.

    People are emotional, irrational, and panicky, and make decisions that they *think* are rational all the time, but which actually turn out to be irrational, sub-optimal decisions. Study after study has found that "actuarial" judgement (e.g., classification and decision making based on statistical models) routinely outperforms "clinical" judgement (e.g., expert interpretation of the facts resulting in a decision about how to proceed).

    That said, though, it's not a very controversial statement to say that statistical models are, generally, better at making decisions than "experts." Even REALLY EXPERT experts.

    And that's why the fuck you would outsource judgement.

    The true objective function is rarely obvious in the real world. Computers have a proven track record of being suckered by bad data and getting stuck in locally optimal ruts. The proper use of DSS is context dependent. Your sweeping generalizations are in fact worthless.

  12. AI by fluffernutter · · Score: 1

    With the advent of artificial intelligence and machine learning, we are increasingly moving to a world where many decisions around us are shaped by calculations rather than traditional human judgement.

    Isn't the point of AI to be indiscernible from traditional human judgement? When it's not, can we please stop calling that AI? It's just a decision made by a computer with a certain set of inputs.

    --
    Laws are rules for the court, but merely a bottom bar to hit for life. Think beyond laws in your actions always.