Slashdot Mirror


Google Cofounder Sergey Brin Warns of AI's Dark Side (wired.com)

Google co-founder Sergey Brin has warned that the current boom in artificial intelligence has created a "technology renaissance" that contains many potential threats. In the company's annual Founders' Letter, the Alphabet president struck a note of caution. "The new spring in artificial intelligence is the most significant development in computing in my lifetime," writes Brin. "Every month, there are stunning new applications and transformative new techniques." But, he adds, "such powerful tools also bring with them new questions and responsibilities." From a report: When Google was founded in 1998, Brin writes, the machine learning technique known as artificial neural networks, invented in the 1940s and loosely inspired by studies of the brain, was "a forgotten footnote in computer science." Today the method is the engine of the recent surge in excitement and investment around artificial intelligence. The letter unspools a partial list of where Alphabet uses neural networks, for tasks such as enabling self-driving cars to recognize objects, translating languages, adding captions to YouTube videos, diagnosing eye disease, and even creating better neural networks.

Brin nods to the gains in computing power that have made this possible. He says the custom AI chip running inside some Google servers is more than a million times more powerful than the Pentium II chips in Google's first servers. In a flash of math humor, he says that Google's quantum computing chips might one day offer jumps in speed over existing computers that can be only be described with the number that gave Google its name, a googol, or a 1 followed by 100 zeroes.

As you might expect, Brin expects Alphabet and others to find more uses for AI. But he also acknowledges that the technology brings possible downsides. "Such powerful tools also bring with them new questions and responsibilities," he writes. AI tools might change the nature and number of jobs, or be used to manipulate people, Brin says -- a line that may prompt readers to think of concerns around political manipulation on Facebook. Safety worries range from "fears of sci-fi style sentience to the more near-term questions such as validating the performance of self-driving cars," Brin writes.

46 of 79 comments (clear)

  1. less of a warning by Anonymous Coward · · Score: 1

    More like a virtue signal. A warning would come with specifics of things to look out for, details about what needs to be done to prevent bad stuff within his own company, etc.

  2. He's probably betting on it by Anonymous Coward · · Score: 1

    Shifty that one.

  3. Today's AI is not magic by Anonymous Coward · · Score: 1

    " loosely inspired by studies of the brain"

    Understatement of the year. There are many programmers today (and a lot more non-programmers) who think that neural nets are "smart" or have "thought processes" or are even conscious. Most neural nets are just a cascading if-then directed acyclic-graph and a weight assigned to each. It's a deterministic feature finder. We can't figured out "thought" processes for computers, and our neurons operate in a much more complicated way than backprop neural nets.

    1. Re:Today's AI is not magic by ShanghaiBill · · Score: 1

      Most neural nets are just a cascading if-then directed acyclic-graph and a weight assigned to each.

      True. But the important point is that they learn those weights on their own, from examples, rather than being explicitly told.

    2. Re:Today's AI is not magic by jopsen · · Score: 1

      Agreed, it's closer to program synthesis... That said with transfer learning, the neural nets seem to _sometimes_ learn underlying concepts.
      So the neural net seems to be able learn some of the underlying concepts, and we don't understand the algorithm that was synthesized.

      That said, we still fully control these AIs, they don't evolve while solving a task, they can be saved to disk and restored :)

    3. Re: Today's AI is not magic by Kristoph · · Score: 1

      In many cases itâ(TM)s very much like magic, that is exactly why there are many in our industry who are raising warnings - not about what AI is today, but what it has the capacity to become with ongoing advances of technology.

      Itâ(TM)s important to recognize that the primary virtue of machine learning is that, in many knowledge domain, it can vastly outperform software hand crafted by humans.

      We may write the âinterfaceâ(TM) and we may write the training software but, in many cases we donâ(TM)t even know how the âAIâ(TM) works. We just know that hundreds or thousands of weights somehow align to yield the right answer - like magic.

    4. Re:Today's AI is not magic by superwiz · · Score: 1

      If was just a DAG, it wouldn't need more than 2 layers... ever. A chain of a bunch of multiplies matrices is just a matrix. It's the back propagation that makes it mildly interesting. And back propagation makes a full graph (with cycles and all). But it's still missing something crucial that a brain does. So crucial, in fact, that you need larger and larger scale networks just to try to simulate it. Oh, and brains... well, most of them are not that intelligent, either.

      --
      Any guest worker system is indistinguishable from indentured servitude.
    5. Re:Today's AI is not magic by ShanghaiBill · · Score: 2

      Maybe it would be better to call it automatic programming than artificial intelligence.

      A tensor of weights are data not "programming".

      Researchers have been using the term "artificial intelligence" since 1956. They shouldn't have to stop just because Hollywood later started using the term to mean something else.

      If you get confused when terms you first heard in movies are used differently in real life, perhaps you should just accept that your opinion doesn't really matter very much. Why should the research community change their terminology to accommodate you?

    6. Re: Today's AI is not magic by Bongo · · Score: 1

      My layperson notion is that humans have two main modes of doing stuff. There's reason, where we split things into objects and use logic to connect them up, and this is a very powerful intelligence, as it basically sets us apart from other animals. But as those whacky old Greek philosophers knew, there are things which are not thing-enough, so they escape logic. That's the point of Zeno's Paradoxes, I guess.

      Meanwhile, there is the rest of the brain, which constructs our perceptions, and it does that in a way which we can only perhaps describe as "intuition". Somehow, without knowing any logical rules about the thing, you interact with your environment. And maybe 99% of what we do is in this way.

      And where logic-based programming, lists of statements and rules, sort of mimics our reasoning faculty, or is a subset of it, the rest of the world has to be approached in this other way. So neural nets are impressive for being able to do some of this, but I would imagine there's a huge open question about what other non-linear processes are going on in the brain.

      If I had to guess I'd say that the "AI" thing is going to be a hit-and-miss affair, as we discover some problems can be solved using neural nets with lots of data and training, and other problems will just be totally beyond its capabilities.

      But where neural nets do succeed, it could be quite revolutionary. Imagine if they can be trained to understand economies. Perhaps it would finally put an end to all the totally-contradictory ideas about economics. Maybe with enough training, neural nets could actually model and predict economies quite well, in ways humans haven't been able to understand.

      But there are also a lot of problems where you have to be one to understand one, so for example, predicting whether a new pop song will be a hit, may be forever beyond neural nets, as they cannot understand the subjective zeitgeist of people's evolving tastes.

      So I tend to agree with one of the other replies here. The idea that AIs will become uber powerful... is a fantasy, dreamt up for hype and money.

  4. Re:Weird Al by LifesABeach · · Score: 4, Insightful

    Has anyone else noticed that the people that are touting the ills of AI are the same ones that are using AI to take your money?

  5. Re: hmmmm.... by LifesABeach · · Score: 1

    maybe one should consider an AI that caters to a single person, and that that AI is 3 Laws safe?

  6. Re: Weird Al by Anonymous Coward · · Score: 1

    It's most likely a disclaimer, so they can say when things turn to shit 'See, I told you so.'

  7. Overstating what "AI" can do by djinn6 · · Score: 4, Insightful

    It's not really artificial intelligence yet. Sure 95% of the time it can identify objects in a picture, or listen to an audio recording and transcribe the text 90% correctly, or translate from one language to another 60% of the time, or drive a car in 98% of the situations. That makes it a bit smarter than a chimp perhaps, but "intelligent"?

    As always, it's the 80% of the features that take 20% of the work. The remaining 20% is the hard part.

    1. Re:Overstating what "AI" can do by ShanghaiBill · · Score: 4, Insightful

      It's not really artificial intelligence yet.

      Yes it is. When researchers and practitioners say "AI" they don't mean human-level Hollywood AI. Machine learning is a subset of AI.

      That makes it a bit smarter than a chimp perhaps, but "intelligent"?

      State-of-the-art AI is nowhere near the intelligence of a chimp. Not even close.

    2. Re:Overstating what "AI" can do by mikael · · Score: 4, Insightful

      Its when the accuracy becomes better than a human then it becomes a problem. Some people like oncology radiologists, their job is looking at X-ray, MRI and CAT scans and identifying when a fuzzy white blob is cancer or not. There were people who made their living from creating books for the blind by reciting the words. They lost that living when smartphones and home computers could do that automatically.

      --
      Vintage computer adverts: http://www.vintageadbrowser.com/computers-and-software-ads
    3. Re:Overstating what "AI" can do by swell · · Score: 2

      The ORs have it: identify objects OR listen OR translate OR drive...

      Yes, one machine might assemble iPhones; another might navigate a vehicle; another might calculate your tax payment - but none will do ALL those things for a very long time. That requires intelligence, among other things like various appendages.

      --
      ...omphaloskepsis often...
    4. Re:Overstating what "AI" can do by KidSock · · Score: 1

      Agreed. AI used to mean a computer that could "think". At least that's what people have been lead to believe. Over the years the term "AI" has been hijacked by companies who are clearly taking advantage of the misconception with advertisements for systems that talk to people about finding viruses and "healing" networks and other such nonsense. These programs are not "thinking" like a person and I don't believe they ever will simply because they do not have human experiences. They are simply sophisticated algorithms for specific problems.

    5. Re:Overstating what "AI" can do by thinkwaitfast · · Score: 1
      I kinda like it because then I can prove that I've been writing AI software since I was eight years old.

      Hello, what is your name?"

      John

      Hello John. How are you?

    6. Re:Overstating what "AI" can do by Kjella · · Score: 1

      another might navigate a vehicle; (...) but none will do ALL those things for a very long time.

      You think a self-driving car is one AI? I'm guessing it's at a minimum two, one image-recognition AI translating sensor data to objects and one driving AI working out the route. I think both because of resource limitations and to upgrade components we will have sub-AIs that deal with their little specialty, not so different from human brain centers and how when you learn to ride a bike it's stored somewhere, you don't figure it out from scratch. Like a chef AI would have a small "fillet a fish" sub-AI and the sum is more of a collection than a unified intelligence. When that's the task at hand though you don't need "big AI", you need an expert at filleting. It's not a downside for an AI to be a one trick pony because it's software and you can fit a ton of ponies in one device.

      --
      Live today, because you never know what tomorrow brings
    7. Re:Overstating what "AI" can do by ShanghaiBill · · Score: 2

      Try to teach a chimp to translate Chinese to English...

      Try to teach a computer to peel a banana.

    8. Re:Overstating what "AI" can do by Bing+Tsher+E · · Score: 2

      Try to motivate a computer to want to peel a banana.

    9. Re:Overstating what "AI" can do by JimSadler · · Score: 1

      If you don't think computers are intelligent try some of the common chess programs. Yes, they have been around for many years and we do have the rules of chess programmed into them. But they do play uniques games that no mortal has ever played and they win. Try Lichess.org and play at level 8 against the machine. You might live long enough to win a game if you play chess endlessly. And that chess match is on a common game system. If you get into really advanced machines and programs the abilities of those chess machines make all of us look like idiots.

    10. Re:Overstating what "AI" can do by BranMan · · Score: 1

      Profit!

  8. Lead by example? by ark1 · · Score: 3, Insightful

    Brin warns of AI yet his own employees have spoken against Google's involvement in a Pentagon - Google partnership involving AI and military drones. https://gizmodo.com/thousands-...

  9. Watch what we say by wolfheart111 · · Score: 1

    everything online lasts forever.

    --
    [($)]
  10. Re: hmmmm.... by JustOK · · Score: 1

    FOUR! There were FOUR LAWS!

    --
    rewriting history since 2109
  11. Barney Google and Snuffy Smith by pipingguy · · Score: 1

    Pffft. Everybody knows that Google's name really comes from Barney Google with his goo-goo-googley eyes.
    ==========
    Who's the most important man this country ever knew?
    Do you know what politician I have reference to?
    Well, it isn't Mr. Bryan, and it isn't Mr. Hughes.
    I've got a hunch that to that bunch I'm going to introduce:
    (Again you're wrong and to this throng I'm going to Introduce:)
    Barney Google, with the goo-goo-googley eyes.
    Barney Google bet his horse would win the prize.
    When the horses ran that day, Spark Plug ran the other way.
    Barney Google, with the goo-goo-googley eyes.

    Barney Google, with the goo-goo-googley eyes.
    Barney Google had a wife three times his size.
    She stood Barney for divorce,
    Now he's living with his horse.

    Who's the greatest lover that this country ever knew?
    And who's the man that Valentino takes his hat off to?
    No, it isn't Douglas Fairbanks that the ladies rave about.
    When he arrives, who makes the wives chase all their husbands
    out?
    Why, it's Barney Google, with the goo-goo-googley eyes.
    Barney Google is the guy who never buys.
    Women take him out to dine, then he steals the waiter's dime.
    Barney Google, with the goo-goo-googley eyes.

    Barney Google, with the goo-goo-goo-ga-ly eyes.
    Barney Google is the luckiest of guys.
    If he fell in to the mud, he'd come up with a diamond stud.
    Barney Google with the goo-goo-googley eyes.

    Who's the greatest fire chief this country ever saw?
    Who's the man who loves to hear the blazing buildings roar?
    Anytime the house is burning, and the flames leap all about,
    Say, tell me do, who goes, "kerchoo!" and puts the fire out?
    Barney Google, with the goo-goo-googley eyes.
    Barney Google, thought his horse could win the prize.
    He got odds of ten to eight; Spark Plug came in three days late.
    Barney Google, with the goo-goo-googley eyes.

    Barney Google, with the goo-goo-googley eyes.
    Barney Google tried to enter paradise.
    When Saint Peter saw his face, he said, "Go to the other place".
    Barney Google, with the goo-goo-googley eyes.

    1. Re:Barney Google and Snuffy Smith by demonlapin · · Score: 1

      Fun side note: the Rice-a-Roni jingle is set to this tune.

  12. ...or a force for good by TJHook3r · · Score: 1

    Knowing how to optimise society for people might be just the job for a computer, as it sure isn't done very well by humans... of course, if the computer is owned by a mega-corporation then we have more reason to be sceptical. Hopefully someone is implementing the Three Laws.

    1. Re:...or a force for good by superwiz · · Score: 1

      So you are one of those, ha? No mass murder has ever been committed by a corporation. Many mass murders have been committed by people who hate corporations.

      --
      Any guest worker system is indistinguishable from indentured servitude.
    2. Re:...or a force for good by Bing+Tsher+E · · Score: 1

      And a number of corporations, through inaction of various forms, have caused many multiples of people using their products to die.

    3. Re: ...or a force for good by TJHook3r · · Score: 1

      Too much lead in your toys when you were little?

    4. Re:...or a force for good by RespekMyAthorati · · Score: 1

      No mass murder has ever been committed by a corporation.

      I guess you have never heard of a city in India called "Bhopal".

  13. Re:The three laws are unusable. by Shikaku · · Score: 1

    While they are interesting stories, actually putting it into practice and coding it would be nightmarishly hard. We as human beings can deal with it because we can see the metaphorical grey; an AI only sees as well as it was coded, and inputs are simplified more and more so that it knows what to do if X Y and Z is seen (a vastly simplified version of AI driving a car). I don't think AI is anywhere near human level consciousnesses but trends in AI car driving and use in math and money make it forefront to news articles and ad venues for them.

    However I think the next gold rush is AI. To what end is up to the creator but it seems to have the same circular logic as snake oil, having good AI means making good money through some intangible magical means.

  14. Re:Weird Al by Bing+Tsher+E · · Score: 1

    Said people have a lot of the AI technology all locked up in patents they own or control. If we 'slow down the research' a lot, they can sit on their portfolio and rake in the cash.

  15. The Brain is Complex by neoRUR · · Score: 1

    The brain is a lot more complex than people are giving it credit. The whole body and brain is even more complex and it is a system that works together.
    Neural networks of today are nothing like how the brain works. (They are similar to how a neuron works)

    There are a few architectures that are used to simulate how the brain works on a computer (Cognitive Architectures), but they don't cover all aspects of them.(i.e. speech, cognition, emotion, creativity, reactive planning, complex situations, being above to apply knowledge in one field to another.)

    Just by advancing the massive data gathering that is going on, is not a theory on how the brain processes it. I like to view all this deep learning today in vision as one part of the eye and brain, the part that can see something and recognize it, under certain constraints.

    But it is no where near how a human can look out and see and track and classify and think about all the 1000's of objects that you see and the tens of thousands of objects, sounds, and things you see through out your day.

    Hard AI will come, but it will take quite a few years.
    Just having new patents on deep learning algorithms is not a measure of understanding the complexity of the brain.

    Neuroscience is advancing our understanding of the brain quite a bit these days, but there is no general architecture on how it all works.

  16. AI Advanced Tecnology by viewham · · Score: 1

    excellent technology and Google become an updated search engine

  17. OHNOEZ! MY TERMINATORZ! by Chas · · Score: 1

    Seriously.

    We're already informed about the possible problems with supremely advanced AI.

    Does this mean we should just throw our wooden shoes into the gears and kick of the Butlerian Jihad now?

    Of course not.

    We still need to do as much research as possible on AI. So we can actually understand the delineation point between "Assistive software" and "Crazy, kill everything AI."

    --


    Chas - The one, the only.
    THANK GOD!!!
  18. Natural Intelligence is not magic either by mbkennel · · Score: 1

    NI has obviously substantially greater capabilities, in major qualitative areas, than AI today.

    We haven't entirely figured out "thought" processes for natural intelligence, and biological neurons are themselves much more complicated than a 'unit' in a backprop-trained multi-layer perceptron. But in the end, do we know what there is in natural intelligence that can't ever be re-implemented? Is there evidence this is so?

    To the contrary, there is increasing evidence that certain behaviors and perceptual capabilities previously thought to be exclusively the domain of natural intelligence, can now be achieved with human-level performance in restrictive domains. Statistical/neural machine translation has improved enormously, and empirical evidence shows that it creates internal semantic representations which can perform well across languages, and which, often, agree with human categorization. Unsurprisingly, since the machine is translating between human languages, but the point is that humans have ideas which can be discerned with data and algorithms which train neural networks, and no other algorithm has been able to do this with this performance.

    Next, neural networks can today induce internal semantic representations of combined text and video. In what way is this not a step to comprehension of the full sensory apparatus of an 'idea'?

    Is there reason to believe that humans don't do statistical neural linguistics? I don't see it.

    Of course, compared to computers, humans have a very strong neural prior and seem to be able to learn a given level of performance with much less input and training than large scale translation systems.

  19. Re:AI Danger: Discrimination by mbkennel · · Score: 1

    | For example, what if credit scores converted from the current complex formulas to using an AI to generate a credit score from the same input data. Once trained, how could one prove that the AI-generated score was NOT engaging in illegal discrimination based on sex, race, etc.?

    How would you prove a natural intelligence generated score was not engaging in illegal generation?

    With computed scores, one does not explicitly use such improper inputs. Next, the specific technology used for the score, and analytical explanatory statistics and algorithms derived along and the internal representations will be examined for the appropriate behavior. Only models which can be demonstrated to adhere to the regulatory constraints will be accepted.

    | How does one account for an unusual outlier AI-generated score when input data would seem to indicate the generated score should be vastly different? Did the AI see something important and the score is legit?

    It is possible to perturb the input data around the observation and see the effect on the output, and one can, if necessary, search for near neighbors in the input training data off-line. But generally the models will be regularized---mathematical penalties on effective gradients---to avoid creating outliers.

  20. Be afraid of natural intelligences! by mbkennel · · Score: 1

    Yes, that's the point.

    Not that AI-driven cyborgs will rebel against humans, but that powerful billionaire *humans*, who have known intelligence, and unlike AI, drive and will, creating cybernetic slaves who will *never* rebel. These slaves further increase their master's wealth and power to the harm of the billions of other plebeians on Earth.

    The Roman Republic and Empire had this problem---the slaveowners were so vastly richer than the average person. (Gaius Julius Caesar supported restricting slavery to help the wages of the free citizens, one reason for his murder)

    Now imagine none of the human constraints on the slaves.

  21. Re:The three laws are unusable. by another_twilight · · Score: 1

    Given that almost all the stories featuring those laws were about exceptions or problems with the laws, I got the impression that the overarching message was that simplistic expressions of morality and/or ethics is _hard_ and likely to cause more problems than it solves.

    It's been a long while since I read Asimov, so I may be adding later commentary to my recollection.

    Just as 1984 was supposed to be a warning, not a blueprint (joking) so too Asimov's laws (more seriously).

  22. Re:Weird Al by strikethree · · Score: 1

    Has anyone else noticed that the people that are touting the ills of AI are the same ones that are using AI to take your money?

    I would reword that.

    Has anyone else noticed that the people who work with AI directly have some concerns but the media blows it into full blown apocalypse which trivializes the concerns being raised?

    It is almost like the slide is being greased before we are pushed down.

    --
    "Someone needs to talk to the tree of liberty about its ghoulish drinking problem." by ohnocitizen
  23. Re:Weird Al by LifesABeach · · Score: 1

    Consider this definition of Irony: I have never considered the likes of Bill Gates, or Elon Musk, or any their friends to be anything Media. None of them are, or were reporters. And none of them could explain why one would even begin to consider how to use a Bayesian Filter. But they have figured out a way to take your money using AI, and they say that's bad.

  24. Re: hmmmm.... by LifesABeach · · Score: 1

    the Zeroth Law? Hell, it's daunting for H1B's to wrap their head around laws 1 thru 3.