Slashdot Mirror


Google's Selfish Ledger is an Unsettling Vision of Silicon Valley Social Engineering (theverge.com)

An anonymous reader shares a report: Google has built a multibillion-dollar business out of knowing everything about its users. Now, a video produced within Google and obtained by The Verge offers a stunningly ambitious and unsettling look at how some at the company envision using that information in the future. The video was made in late 2016 by Nick Foster, the head of design at X (formerly Google X), and shared internally within Google. It imagines a future of total data collection, where Google helps nudge users into alignment with their goals, custom-prints personalized devices to collect more data, and even guides the behavior of entire populations to solve global problems like poverty and disease.

41 of 254 comments (clear)

  1. Fermi's paradox by olsmeister · · Score: 3, Insightful

    I believe we've found the answer.

  2. If the method works... by LordHighExecutioner · · Score: 3, Interesting

    ...why they do not use it to drive Google's development itself ?!?

    1. Re:If the method works... by Barny · · Score: 4, Informative

      Probably because this was a thought experiment. This was a video that the source reports was released internally with the intention of showing unsettling things they do not plan on doing.

      Slashdot just loves them some controversial headlines and stories, so they conveniently left that out with their blurb.

      Another non-story.

      --
      ...
      /me sighs
    2. Re:If the method works... by jenningsthecat · · Score: 3, Insightful

      Probably because this was a thought experiment.

      That's irrelevant. The idea has been conceived and disseminated. The initial dissemination was among people with the power and the resources to make it a real-world experiment. Do you really Google doesn't have the arrogance, the hubris, and the power-lust to start implementing this?

      This was a video that the source reports was released internally with the intention of showing unsettling things they do not plan on doing.

      They may "not plan on doing", but do they "plan on not doing"? Besides, to hear Google tell it, they planned to not be evil - and look at them now.

      Another non-story.

      Google has a history of at least trying out the wild shit their people dream up. And I'm pretty sure the insularity of Silly Valley's denizens renders many of them immune to the consideration that using the rest of as lab rats is in any way immoral or inappropriate. Even at that, this would be a non-story only if Google wasn't already fully capable of rolling out such a scheme in a short time frame.

      --
      'The Economy' is a giant Ponzi scheme whose most pitiable suckers are the youngest among us and the yet-unborn.
    3. Re:If the method works... by Marxist+Hacker+42 · · Score: 2

      because of Seeber's Social Placebo Uncertainty Paradox: Letting the people know you are collecting data on them changes their response to the data.

      --
      SJW: a person who perceives an injustice, and while correcting it, commits a greater injustice.
    4. Re:If the method works... by houghi · · Score: 2

      They probably do. That is why they are making such a shitload of money. Oh you thought they developed prodcuts to please you as a customer?
      I have some bad news for you.

      --
      Don't fight for your country, if your country does not fight for you.
    5. Re:If the method works... by hawguy · · Score: 3, Insightful

      Probably because this was a thought experiment.

      That's irrelevant. The idea has been conceived and disseminated. The initial dissemination was among people with the power and the resources to make it a real-world experiment. Do you really Google doesn't have the arrogance, the hubris, and the power-lust to start implementing this?

      They have pretty much all the data they need to do this for some people. They have your search history, your email history, your SMS history, your phone calls and voicemails (google voice), your detailed location history, your purchase history, (google wallet) every photo you've taken in the past N years, all of your files in Google Drive, and more.

      They know more about you than Facebook.

  3. 1984 by Train0987 · · Score: 4, Insightful

    George Orwell was a visionary.

    1. Re:1984 by houghi · · Score: 4, Interesting

      People forget that in 1984 the power was given to Big Brother. It was not taken.
      How we give so freely what others have fought for so hard.

      --
      Don't fight for your country, if your country does not fight for you.
    2. Re:1984 by Riceballsan · · Score: 4, Interesting

      Orwell's books were typically set in place long after everything was concrete and unchangable. As far as I know he didn't write a whole lot on how we got there, just where we wound up. Propoganda usually starts out subtle and slowly builds its way up to in your face you can't miss it unless you've never lived away from it.

    3. Re:1984 by iMadeGhostzilla · · Score: 2

      He applied linear thinking and took it to the extreme to make a good story. But societies go through cycles. The tide turned in 2016 -- perhaps as a consequence of the 2008 crash -- where people have rejected, democratically speaking, the vision that had been offered to them, of which this is a part. Try as he might have, Schmidt couldn't help Hillary win.

    4. Re:1984 by lgw · · Score: 2

      While that's an optimistic thought, 2016 was not a rejection of totalitarianism or post modernism, merely a rejection of the most corrupt presidential candidate in a century. There's little evidence thus far that people are rejecting identity politics, which is the lever by which modern totalitarians move themselves into power.

      Orwell, an ardent socialist, saw well the dangers socialism presented for descent into totalitarianism.

      --
      Socialism: a lie told by totalitarians and believed by fools.
    5. Re:1984 by RobinH · · Score: 4, Interesting

      1984 was about absolute and total control through fear, whilst Brave New World was all about social engineering. In 1984 there's also some controlling of what people thought too, but Brave New World is much closer.

      --
      "I have never let my schooling interfere with my education." - Mark Twain
  4. Less future more present by Anonymous Coward · · Score: 2, Interesting

    Google and Youtube already "nudge users into alignment with their goals" by manipulating search results, pushing sites/producers with opinions they prefer and hiding those they disagree with.

    I suppose 2018 is the future they were thinking about in 2016.

    1. Re:Less future more present by Aighearach · · Score: 2

      Probably so. Probably also why I'm searching with bing more often now, too.

      I remember the old days when google's search interface had an actual search language, with a bunch of operators that I could use to search for what I wanted. Almost none of that exists anymore, now instead of searching for what I want, I can only search for whatever google's interests are that share half the keywords. Weak sauce. Very weak sauce.

      That they consider it an improvement just guarantees that they learn my preferences by learning which of their services I'm no longer willing to consider using.

  5. Isn't that pretty much the story of things? by argStyopa · · Score: 4, Insightful

    Start with "don't be evil"
    ends up with a terrifying Big Brother-y quasi police state* 'managing' everyone's behavior "for the public good, of course Mr Smith"

    *you might say that Google is merely gathering data and at most 'nudging' behavior. I'd say that when Google can concatenate & save forever EVERYTHING YOU DO to a degree that would make FB and Cambridge Analytica (you know, the guys being publicly lynched for doing exactly this?) blush, and use that data against you in ways ranging from subtle to blatant including simply handing your data over to authorities, then yeah, I'm going to call that a quasi-police state whose 'public/private' partnership borders on Fascism.

    --
    -Styopa
    1. Re:Isn't that pretty much the story of things? by The+Cynical+Critic · · Score: 2

      One of the things that struck me most about all the panic around Cambridge Analythica is that what they did wasn't all that different from what much bigger companies like Google, Facebook and Twitter have been doing for well over a decade and making quite a lot of money on. Only significant differences I can think of are that they were much smaller, didn't actually collect the data themselves and analyzed the data just for external clients rather than their own gain.

      Particularly Facebook behaving the way they did, acting like they're not in the exact same business, absolutely reeked of hypocrisy.

      --
      "Why should I want to make anything up? Life's bad enough as it is without wanting to invent any more of it."
    2. Re:Isn't that pretty much the story of things? by burtosis · · Score: 2

      I'd say that when Google can concatenate & save forever EVERYTHING YOU DO to a degree that would make FB and Cambridge Analytica (you know, the guys being publicly lynched for doing exactly this?) blush, and use that data against you in ways ranging from subtle to blatant including simply handing your data over to authorities, then yeah, I'm going to call that a quasi-police state whose 'public/private' partnership borders on Fascism.

      I'm actually concerned that people's data will be used against them to derive more than just a social score like China. Imagine if the Nazis had access to what religion, ethnicity, and political leanings of all within its borders who were tracked in real time - the damage that could be wrought would be far, far greater. There is the finnancial havoc you could wreak as well given the ability to effectively use this data. There needs to be more oversight and counterbalance to this because there is no putting the genie back in the bottle and if we don't push hard it will be forever consolidated into the hands of a few individuals and the idea that it will be used altruistically instead of maliciously for personal profit is fanciful . Even after Cambridge Analytica I still have difficulty getting people to understand why thier data privacy is important.

    3. Re:Isn't that pretty much the story of things? by anegg · · Score: 3, Interesting

      Only significant differences I can think of are that they were much smaller, didn't actually collect the data themselves and analyzed the data just for external clients rather than their own gain.

      You forgot about the part where they data was used to the possible benefit of conservative politicians instead of for liberal objectives. I'm not sure that that wasn't what goaded some folks into being really upset.

    4. Re:Isn't that pretty much the story of things? by alexo · · Score: 4, Insightful

      If it's objectionable when the Russians do it, it should be equally objectionable when Google does it.

    5. Re:Isn't that pretty much the story of things? by argStyopa · · Score: 2

      "Their stated goal is to use this power to solve global poverty and disease. By any measure, that is not evil."

      Nonsense. The devil is certainly in the implementation.
      If one 'solved' poverty by killing all the poor people, it would CERTAINLY be evil.
      If one 'solved' disease by eugenically breeding superhumans, it would pretty likely be evil AF.

      So no, I don't buy your initial premise, nor most of the rest of your post.

      People are MOST CERTAINLY entitled to be upset at losing agency; the premise of democracy is that everyone gets a say, not just a geniocracy run by the West-Coast intellectuals that work at google. You seem to like pure meritocracies? Should we have votes weighted by IQ? OK for you?

      Hint: by that *same* logic one could certainly argue that wealth accumulation is about as clear a measure of real-world practical smarts as any other yardstick; so anyone for plutocracy?

      --
      -Styopa
  6. Actually be evil? by sinij · · Score: 2

    So they finally switched to "Be evil?"

  7. Insidious and evil by Okian+Warrior · · Score: 4, Insightful

    There's an old saying about democracy being "two wolves and a sheep voting on what to have for lunch".

    The point being, the republic was set up to aspire to higher goals than can be achieved by pure democracy alone. We have people in power who are not bound by the will of the people, they can vote their conscience based on what they think is right. We take guidance from a bunch of enlightened people 250 years ago who set up basic guidelines to do this.

    The idea of a bunch of like-minded people getting together and trying to "nudge users into alignment with their goals" is the same thing, it's "two wolves and a sheep" writ large.

    We're seeing this today with the changes in user policy. YouTube used to be a bastion of free speech, everything that wasn't explicitly illegal was allowed... until that changed, and you can no longer talk about guns, or have conservative views, or cast aspersions on certain races or religions. (But it's OK when those races or religions cast aspersions back.)

    Their goals are well-meaning today so that people will get behind the efforts and help, tomorrow their goals may be different.

    Even when you agree with their goals, not everyone agrees with their proposed solutions - and yet they still try to influence public debate. Climate change is one of these issues, where a lot of people would agree that it's a problem and something should be done, if only the solutions weren't politically motivated.

    What they are proposing is control over social thought. Unlike PACs or advertising, it's done without oversight or transparency. We complain about PACs not having enough transparency, and not knowing who pays for political ads - are we going to allow Google to be similarly opaque?

    Next election it won't be "Russians hacked the election", it'll be "Google hacked the election".

    Nudging behaviour like this is insidious and evil.

    1. Re:Insidious and evil by prisoner-of-enigma · · Score: 2

      Their goals are well-meaning today so that people will get behind the efforts and help, tomorrow their goals may be different.

      EXACTLY! This is what the SJW's asking for more government intervention never seem to grasp. Today's noble cause is tomorrow's tool of the oppressor/tyrant. Those who want to empower the government (and/or large corps with government's help) to effect social change refuse to understand this.

      --
      In the end they will lay their freedom at our feet and say to us, Make us your slaves, but feed us. - Fyodor Dostoyevsky
    2. Re:Insidious and evil by TheRaven64 · · Score: 4, Interesting

      There's an old saying about democracy being "two wolves and a sheep voting on what to have for lunch".

      The old saying is from someone who doesn't understand game theory. The outcome of such a vote would be that the stronger wolf would be eaten. The weaker wolf knows that it would be dinner tomorrow if it eats the sheep, the sheep knows that it has a better chance of running away from just the weaker wolf than from either both wolves today or the stronger wolf tomorrow.

      --
      I am TheRaven on Soylent News
    3. Re:Insidious and evil by argStyopa · · Score: 2

      "The point being, the republic was set up to aspire to higher goals than can be achieved by pure democracy alone. We have people in power who are not bound by the will of the people, they can vote their conscience based on what they think is right. We take guidance from a bunch of enlightened people 250 years ago who set up basic guidelines to do this."

      Good post; I would only append that the FF who wrote the constitution were *very* aware of this, and (tried, at least) wrote a constitution which was in every sense designed to be a very strict fence on federal government behavior. States could do much what they pleased as long as they stayed within the basic bounds established by the federal constitution, but the federal gov't was meant to be basically a clearing house for national diplomacy, military, and a few other VERY LIMITED functions. (The thought being that people could 'vote with their feet' if a state's behavior was excessive or unpleasant.)

      And now we have a Federal gov't telling people how high their doorknobs have to be.

      We might have lost the point of the constitution long ago.

      --
      -Styopa
  8. Psychohistory? by Edweirdo · · Score: 5, Insightful

    Is Hari Seldon running Google now?

    --
    Life is too short and too important to { take seriously | use windows }.
  9. Re:BINGO by Gilgaron · · Score: 3, Insightful

    Why would the superwealthy want to implement communism or soviets? The current plutocracy is the safer bet.

  10. Re:Yeah, Capitalism by Anonymous Coward · · Score: 3, Insightful

    Back in the 1970s they said that the United States of America would combine information and capitalism to create a paradise.

    In fact they built a brutish hellhole.

  11. Super successful by DrYak · · Score: 2

    1.) Run your own little server behind your DSL Modem. Starts at $30, called Raspberry PI.

    A littlebit under powered, but still good for many non intensive use.
    (Been there, still doing that sometimes).

    2.) Store your data on your private server. Control access/encipher via SSH/SCP.

    Oh, common. It's 2018. at least use rsync.
    (Also, if you want good resilience against damage/corruption, you'd want a base with a tad bit more sata ports, and running RAID5.
    Just saying)

    3.) Run your own discussion forums.

    ...but be prepared to not have the richness of interactions currently found on the Social Networking Site du jour/whatever Zuck has bought the most recently.

    You'll basically have your mom' writing you a message, every now and then, to remind you to call her.

    4.) Run Linux on your PC instead of the Snoop-Ware of MSFT.

    But be prepared to spend time on stack exchange just to learn how to make your touch pad work* ~~~

    5.) Run your own Jabber server instead of Corporate-Controlled Whatsapp and the like.

    And you'll have exactly 1 single user registered on it :
    you.

    Because most of the people you know won't bother installing yet another client (but it's opensource) just to send messages to you, when all their friends are on Skype/FBMessenger/WhatsApp/Snapchat/whatever is popular next (hint: look at what Zuck is trying to buy next).

    ---

    * - Disclaimer: Proudly written from a Linux running laptop

    --
    "Sufficiently advanced satire is indistinguishable from reality." - [Tips: 1DrYakQDKCQ6y52z6QbnkxHXAocMZJE61o ]
  12. Re:Really ? by Anonymous Coward · · Score: 4, Insightful

    Poor white guys. The centuries of constant oppression they have faced must be unbearable.

    Spotted the racist.

  13. Possible answer by Okian+Warrior · · Score: 2, Interesting

    Bit deeper then that. I don't know what group of people are driving it but I can describe it. The more I look at especially some of the "synergies" between laws in countries that would otherwise be completely opposite, the more it becomes obvious there has been a serious push for globalization. It's to the point we don't have one, but MANY draconian laws straight out of batshit crazy countries, being passed with little to no discussion. It's like we're being prepped for habitation by the "royal families".

    I've been thinking about that, and have a possible answer.

    For context, I started thinking about this when I heard that London is now 42% foreign born. (Here's info from 2011.) England used to be predominately white and very conservative, but it's now peppered with no-go zones and full of foreign workers. Germany and Sweden are even worse, and are *still* importing refugees.

    Why is this happening in Europe?

    My best guess has to do with WWII, and the genocide of various peoples: Jews, but also Gypsies, Poles, Afro-Germans, homosexuals, Jehovas Witnesses, and others. Hitler made WWII essentially a war on other races.

    That incident (WWII) has become so abhorrent in the collective psyche that people will do anything to escape the barest hint of being associated with it. The people of Europe are killing themselves trying to prove that they aren't racist.

    We now have British police choosing not to prosecute Muslim rapists, while threatening prosecution for the fathers (of the raped girls) for Islamophobia for speaking out. We see the police suppressing reports of Muslim crime, but going after "hate speech" crimes from regular citizens.

    We're seeing a little bit of that here in the US, where putting our own citizens first is called out as racist.

    1. Re:Possible answer by Aighearach · · Score: 4, Insightful

      The fact that you think Sweden is full of "no-go zones" (or even London, for that matter) tells me that your opinions were already manufactured by Russian troll farms.

  14. Meaning by Bongo · · Score: 2

    It seems kinda scary that a big brother org could shape the environment of information so as to influence people's behaviour.

    But then I remember that humans are not so simple. To us the world is not a mere stream of information, rather, it is a world of meanings which we create and organise, where meaning is within a context which is within a context and so on. Just think of a famous piece of art, and all its parodies. Consider fashion and how it changes. The way that people's aspirations and goals, their likes and dislikes, their moods and opinions, all flow in an ever-changing, re-created anew, stream of reactions and counter-reactions. Life is change. And the "facts", the "data" which tech people are so enamoured of, is only one half of reality. The other half is inter-subjective re-creative re-authored re-organising meaning-making. Today you love X and feel it is the best person or thing in the world, tomorrow you're bored with X. Show me an AI that can cope with that, and then I'll say you've passed some kind of fancy test. An AI that understands new ironies. What a joke.

  15. Re:Predictable by Brett+Buck · · Score: 2, Insightful

    Of course. I have been modded down to oblivion whenever I have pointed it out, but this is sociopathic behavior, and we are training and indoctrinating kids with this sort of crap for decades now.

            This country was formed to prevent precisely this, and to favor individual liberty over the "collective good", precisely because at some point, someone or some group will come along and attempt to define "collective good" for everyone else - which then has to be enforced at the point of a sword.

        Liberalism/"progressivism"/socialism can only end in totaltarian behavior, it is part and parcel and the end game of any socialist activity.

  16. Somehow reminds me of "The Circle" by gotan · · Score: 3, Interesting

    It's not 1:1 but some aspects like exploiting groupthink to "do good", "nudging" people to conformity etc. are common.

    --
    "By the way if anyone here is in advertising or marketing... kill yourself." -- Bill Hicks
  17. Re:Gandalf took the Ring by spire3661 · · Score: 4, Interesting

    Tolkien's contemporary and friend C.S. Lewis said this. "Of all tyrannies, a tyranny sincerely exercised for the good of its victims may be the most oppressive. It would be better to live under robber barons than under omnipotent moral busybodies. The robber baron's cruelty may sometimes sleep, his cupidity may at some point be satiated; but those who torment us for our own good will torment us without end for they do so with the approval of their own conscience. They may be more likely to go to Heaven yet at the same time likelier to make a Hell of earth. This very kindness stings with intolerable insult. To be "cured" against one's will and cured of states which we may not regard as disease is to be put on a level of those who have not yet reached the age of reason or those who never will; to be classed with infants, imbeciles, and domestic animals.”

    --
    Good-bye
  18. Re:Predictable by BlueStrat · · Score: 2, Insightful

    Liberalism/"progressivism"/socialism can only end in totaltarian behavior, it is part and parcel and the end game of any socialist activity.

    Been saying this for a long time.

    It's even my /. sig.

    "Progressivism (aka US 'Liberalism'): Ideas so good they need a police/surveillance-state to enforce."

    Google/FB/twatter/et al provide the surveillance state, the Feds provide the police state.

    Fascism refined for the information age. It's an authoritarian's wet-dream.

    Strat

    --
    Progressivism (aka US 'Liberalism'): Ideas so good they need a police/surveillance-state to enforce.
  19. Re:Silicon Valley creepers are anti-human by Falconnan · · Score: 4, Interesting

    Here's the real problem: Utopian and Dystopian systems are going to use the same tools. The big divide between them will be motive and power. To illustrate, an app (really a giant AI in the background) providing alternative solutions that you can decide between could be Utopian. However, if the AI is programmed to consider the good of its creators above the good of its customers (individuals and the general society at large), this rapidly becomes Dystopian. The same is true if a political agenda outside of the consideration of individual/societal benefit is considered. And we have carefully avoided the notion of applying any generic rules to the development of AI.

    We are in uncharted territory here, with private entities having this kind of information capabilities. It is nearly impossible to put the genie back in the bottle here, so we need to figure out how to control the genie, rather than it controlling us. As to how, I haven't a clue.

  20. Re:Silicon Valley creepers are anti-human by Archangel+Michael · · Score: 2

    an app (really a giant AI in the background) providing alternative solutions that you can decide between could be Utopian.

    I would suggest to you that even this level of choice is going to be largely an Illusion. The AI will simply give you a choice, one that it has identified the most likely decision you will make already (95% confidence level), the choice being an illusion of control, when the reality the AI doesn't really need your input, but asks just to be "nice".

    --
    Agent K: A *person* is smart. People are dumb, stupid, panicky animals, and you know it.
  21. All about power by ChatHuant · · Score: 4, Insightful

    Knowledge is power. As Google knows you better and better, they have more and more power over you. This video shows they're already considering how to exercise this power. This is the obvious next step for them (and, FWIW, I had already called it: https://slashdot.org/comments....).

    Google, Facebook and the other data vampires really need to be stopped. The EU GDPR is a step in the right direction (though I, personally, would prefer both companies, and other privacy infringers, like Equifax, to be dismantled, or broken up). Unfortunately, the US government is already in Google and Facebook's pockets (it's not for nothing that Google is the largest corporate lobbyist in the USA), so I don't expect any useful legislative action.