Slashdot Mirror


Google's Selfish Ledger is an Unsettling Vision of Silicon Valley Social Engineering (theverge.com)

An anonymous reader shares a report: Google has built a multibillion-dollar business out of knowing everything about its users. Now, a video produced within Google and obtained by The Verge offers a stunningly ambitious and unsettling look at how some at the company envision using that information in the future. The video was made in late 2016 by Nick Foster, the head of design at X (formerly Google X), and shared internally within Google. It imagines a future of total data collection, where Google helps nudge users into alignment with their goals, custom-prints personalized devices to collect more data, and even guides the behavior of entire populations to solve global problems like poverty and disease.

23 of 254 comments (clear)

  1. Fermi's paradox by olsmeister · · Score: 3, Insightful

    I believe we've found the answer.

  2. If the method works... by LordHighExecutioner · · Score: 3, Interesting

    ...why they do not use it to drive Google's development itself ?!?

    1. Re:If the method works... by Barny · · Score: 4, Informative

      Probably because this was a thought experiment. This was a video that the source reports was released internally with the intention of showing unsettling things they do not plan on doing.

      Slashdot just loves them some controversial headlines and stories, so they conveniently left that out with their blurb.

      Another non-story.

      --
      ...
      /me sighs
    2. Re:If the method works... by jenningsthecat · · Score: 3, Insightful

      Probably because this was a thought experiment.

      That's irrelevant. The idea has been conceived and disseminated. The initial dissemination was among people with the power and the resources to make it a real-world experiment. Do you really Google doesn't have the arrogance, the hubris, and the power-lust to start implementing this?

      This was a video that the source reports was released internally with the intention of showing unsettling things they do not plan on doing.

      They may "not plan on doing", but do they "plan on not doing"? Besides, to hear Google tell it, they planned to not be evil - and look at them now.

      Another non-story.

      Google has a history of at least trying out the wild shit their people dream up. And I'm pretty sure the insularity of Silly Valley's denizens renders many of them immune to the consideration that using the rest of as lab rats is in any way immoral or inappropriate. Even at that, this would be a non-story only if Google wasn't already fully capable of rolling out such a scheme in a short time frame.

      --
      'The Economy' is a giant Ponzi scheme whose most pitiable suckers are the youngest among us and the yet-unborn.
    3. Re:If the method works... by hawguy · · Score: 3, Insightful

      Probably because this was a thought experiment.

      That's irrelevant. The idea has been conceived and disseminated. The initial dissemination was among people with the power and the resources to make it a real-world experiment. Do you really Google doesn't have the arrogance, the hubris, and the power-lust to start implementing this?

      They have pretty much all the data they need to do this for some people. They have your search history, your email history, your SMS history, your phone calls and voicemails (google voice), your detailed location history, your purchase history, (google wallet) every photo you've taken in the past N years, all of your files in Google Drive, and more.

      They know more about you than Facebook.

  3. 1984 by Train0987 · · Score: 4, Insightful

    George Orwell was a visionary.

    1. Re:1984 by houghi · · Score: 4, Interesting

      People forget that in 1984 the power was given to Big Brother. It was not taken.
      How we give so freely what others have fought for so hard.

      --
      Don't fight for your country, if your country does not fight for you.
    2. Re:1984 by Riceballsan · · Score: 4, Interesting

      Orwell's books were typically set in place long after everything was concrete and unchangable. As far as I know he didn't write a whole lot on how we got there, just where we wound up. Propoganda usually starts out subtle and slowly builds its way up to in your face you can't miss it unless you've never lived away from it.

    3. Re:1984 by RobinH · · Score: 4, Interesting

      1984 was about absolute and total control through fear, whilst Brave New World was all about social engineering. In 1984 there's also some controlling of what people thought too, but Brave New World is much closer.

      --
      "I have never let my schooling interfere with my education." - Mark Twain
  4. Isn't that pretty much the story of things? by argStyopa · · Score: 4, Insightful

    Start with "don't be evil"
    ends up with a terrifying Big Brother-y quasi police state* 'managing' everyone's behavior "for the public good, of course Mr Smith"

    *you might say that Google is merely gathering data and at most 'nudging' behavior. I'd say that when Google can concatenate & save forever EVERYTHING YOU DO to a degree that would make FB and Cambridge Analytica (you know, the guys being publicly lynched for doing exactly this?) blush, and use that data against you in ways ranging from subtle to blatant including simply handing your data over to authorities, then yeah, I'm going to call that a quasi-police state whose 'public/private' partnership borders on Fascism.

    --
    -Styopa
    1. Re:Isn't that pretty much the story of things? by anegg · · Score: 3, Interesting

      Only significant differences I can think of are that they were much smaller, didn't actually collect the data themselves and analyzed the data just for external clients rather than their own gain.

      You forgot about the part where they data was used to the possible benefit of conservative politicians instead of for liberal objectives. I'm not sure that that wasn't what goaded some folks into being really upset.

    2. Re:Isn't that pretty much the story of things? by alexo · · Score: 4, Insightful

      If it's objectionable when the Russians do it, it should be equally objectionable when Google does it.

  5. Insidious and evil by Okian+Warrior · · Score: 4, Insightful

    There's an old saying about democracy being "two wolves and a sheep voting on what to have for lunch".

    The point being, the republic was set up to aspire to higher goals than can be achieved by pure democracy alone. We have people in power who are not bound by the will of the people, they can vote their conscience based on what they think is right. We take guidance from a bunch of enlightened people 250 years ago who set up basic guidelines to do this.

    The idea of a bunch of like-minded people getting together and trying to "nudge users into alignment with their goals" is the same thing, it's "two wolves and a sheep" writ large.

    We're seeing this today with the changes in user policy. YouTube used to be a bastion of free speech, everything that wasn't explicitly illegal was allowed... until that changed, and you can no longer talk about guns, or have conservative views, or cast aspersions on certain races or religions. (But it's OK when those races or religions cast aspersions back.)

    Their goals are well-meaning today so that people will get behind the efforts and help, tomorrow their goals may be different.

    Even when you agree with their goals, not everyone agrees with their proposed solutions - and yet they still try to influence public debate. Climate change is one of these issues, where a lot of people would agree that it's a problem and something should be done, if only the solutions weren't politically motivated.

    What they are proposing is control over social thought. Unlike PACs or advertising, it's done without oversight or transparency. We complain about PACs not having enough transparency, and not knowing who pays for political ads - are we going to allow Google to be similarly opaque?

    Next election it won't be "Russians hacked the election", it'll be "Google hacked the election".

    Nudging behaviour like this is insidious and evil.

    1. Re:Insidious and evil by TheRaven64 · · Score: 4, Interesting

      There's an old saying about democracy being "two wolves and a sheep voting on what to have for lunch".

      The old saying is from someone who doesn't understand game theory. The outcome of such a vote would be that the stronger wolf would be eaten. The weaker wolf knows that it would be dinner tomorrow if it eats the sheep, the sheep knows that it has a better chance of running away from just the weaker wolf than from either both wolves today or the stronger wolf tomorrow.

      --
      I am TheRaven on Soylent News
  6. Psychohistory? by Edweirdo · · Score: 5, Insightful

    Is Hari Seldon running Google now?

    --
    Life is too short and too important to { take seriously | use windows }.
  7. Re:BINGO by Gilgaron · · Score: 3, Insightful

    Why would the superwealthy want to implement communism or soviets? The current plutocracy is the safer bet.

  8. Re:Yeah, Capitalism by Anonymous Coward · · Score: 3, Insightful

    Back in the 1970s they said that the United States of America would combine information and capitalism to create a paradise.

    In fact they built a brutish hellhole.

  9. Re:Really ? by Anonymous Coward · · Score: 4, Insightful

    Poor white guys. The centuries of constant oppression they have faced must be unbearable.

    Spotted the racist.

  10. Somehow reminds me of "The Circle" by gotan · · Score: 3, Interesting

    It's not 1:1 but some aspects like exploiting groupthink to "do good", "nudging" people to conformity etc. are common.

    --
    "By the way if anyone here is in advertising or marketing... kill yourself." -- Bill Hicks
  11. Re:Gandalf took the Ring by spire3661 · · Score: 4, Interesting

    Tolkien's contemporary and friend C.S. Lewis said this. "Of all tyrannies, a tyranny sincerely exercised for the good of its victims may be the most oppressive. It would be better to live under robber barons than under omnipotent moral busybodies. The robber baron's cruelty may sometimes sleep, his cupidity may at some point be satiated; but those who torment us for our own good will torment us without end for they do so with the approval of their own conscience. They may be more likely to go to Heaven yet at the same time likelier to make a Hell of earth. This very kindness stings with intolerable insult. To be "cured" against one's will and cured of states which we may not regard as disease is to be put on a level of those who have not yet reached the age of reason or those who never will; to be classed with infants, imbeciles, and domestic animals.”

    --
    Good-bye
  12. Re:Possible answer by Aighearach · · Score: 4, Insightful

    The fact that you think Sweden is full of "no-go zones" (or even London, for that matter) tells me that your opinions were already manufactured by Russian troll farms.

  13. Re:Silicon Valley creepers are anti-human by Falconnan · · Score: 4, Interesting

    Here's the real problem: Utopian and Dystopian systems are going to use the same tools. The big divide between them will be motive and power. To illustrate, an app (really a giant AI in the background) providing alternative solutions that you can decide between could be Utopian. However, if the AI is programmed to consider the good of its creators above the good of its customers (individuals and the general society at large), this rapidly becomes Dystopian. The same is true if a political agenda outside of the consideration of individual/societal benefit is considered. And we have carefully avoided the notion of applying any generic rules to the development of AI.

    We are in uncharted territory here, with private entities having this kind of information capabilities. It is nearly impossible to put the genie back in the bottle here, so we need to figure out how to control the genie, rather than it controlling us. As to how, I haven't a clue.

  14. All about power by ChatHuant · · Score: 4, Insightful

    Knowledge is power. As Google knows you better and better, they have more and more power over you. This video shows they're already considering how to exercise this power. This is the obvious next step for them (and, FWIW, I had already called it: https://slashdot.org/comments....).

    Google, Facebook and the other data vampires really need to be stopped. The EU GDPR is a step in the right direction (though I, personally, would prefer both companies, and other privacy infringers, like Equifax, to be dismantled, or broken up). Unfortunately, the US government is already in Google and Facebook's pockets (it's not for nothing that Google is the largest corporate lobbyist in the USA), so I don't expect any useful legislative action.