Slashdot Mirror


Google's AI Boss Blasts Musk's Scare Tactics on Machine Takeover (bloomberg.com)

Mark Bergen, writing for Bloomberg: Elon Musk is the most-famous Cassandra of artificial intelligence. The Tesla chief routinely drums up the technology's risks in public and on Twitter, where he recently called the global race to develop AI the "most likely cause" of a third world war. Researchers at Google, Facebook and other AI-focused companies find this irritating. John Giannandrea, the head of search and AI at Alphabet's Google, took one of the clearest shots at Musk on Tuesday -- all while carefully leaving him unnamed. "There's a huge amount of unwarranted hype around AI right now," Giannandrea said at the TechCrunch Disrupt conference in San Francisco. "This leap into, 'Somebody is going to produce a superhuman intelligence and then there's going to be all these ethical issues' is unwarranted and borderline irresponsible."

85 of 130 comments (clear)

  1. Elon is out of his mind by Anonymous Coward · · Score: 1

    The guy seriously doesn't have a fucking clue about AI. I've been studying the field for over 15 years and I've barely scratched the surface. Elon hasn't done shit with AI and can't speak from any experience.

    1. Re:Elon is out of his mind by OrangeTide · · Score: 1

      You don't really need full AI to have machines that run amok. Third party take-over is always a possibility. But mostly the problem with AI isn't that we'll have a Terminator scenario, but that the human race will be unprepared to switch to a new socio-political-economic system. And while people bandy about the term AI for this scenario, really anything that results in unemployment of a billion people in a short amount of time would do the trick. So I'd argue that Elon is underestimating the impact and time scale rather than overestimating, even if he overestimates when complete AI is widely available.

      --
      “Common sense is not so common.” — Voltaire
    2. Re:Elon is out of his mind by Tablizer · · Score: 5, Insightful

      Most blowhards who claim to have a crystal ball turn out wrong.

      While I don't doubt AI may pose a threat to humanity in the distant future, our current AI completely lacks everyday common sense. It's great at pattern matching now that we have fat hardware to throw at matching, but pattern matching alone can't cover for common sense. Hopping the common-sense hurdle could be centuries or millennia away. Stupid humans with war machines are a far more immediate threat.

    3. Re:Elon is out of his mind by xevioso · · Score: 1

      yeah, but this fabled "switch to a new socio-political-economic system" will be just like the others, in that human beings will adapt. There will be immense disruption along the way, but we are pretty good at adapting to these things, and the idea that we will be in a place where our inability or difficulty in adapting will have apocalyptic consequences seems unlikely.

    4. Re:Elon is out of his mind by sinij · · Score: 1

      I, for one, welcome our new AI overlords as part of my adaptation strategy.

    5. Re:Elon is out of his mind by bobbied · · Score: 1

      The guy seriously doesn't have a fucking clue about AI. I've been studying the field for over 15 years and I've barely scratched the surface. Elon hasn't done shit with AI and can't speak from any experience.

      Experience or no aside... Musk is often misunderstood by both his detractors and supporters.

      His real motives are about getting approval from others, and he's a bright guy so he has come up with some well paying ways to get approval. His whole AI thing is about his innate need for approval but it isn't like he's alone in his views.

      Some really bright folks share his concerns (Steven Hawking has said similar things) so I'd not be so quick to just dismiss Musk. Where I understand your prospective (because I share the idea that AI isn't all that advanced yet), I'm not willing to call BS on the likes lf Musk and Hawking without some seriously good arguments..

      --
      "File to fit, pound to insert, paint to match" - Aircraft Maintenance 101
    6. Re:Elon is out of his mind by taustin · · Score: 1

      Those are both symptoms of the same paranoid dementia.

    7. Re:Elon is out of his mind by JohnFen · · Score: 2

      Expert opinions only carry more weight than the average Joe's opinion when they are speaking on the topics that they are experts in.

      Musk and Hawking are not experts in AI, and their opinion is roughly as weighty as any other intelligent layman. Which is to say, not very weighty.

      If you want meaningful opinions on physics, then it's hard to do better than Hawkings. If you want meaningful opinions on AI, you should talk to the AI guys.

    8. Re:Elon is out of his mind by JohnFen · · Score: 4, Insightful

      Musk is a visionary in every sense of the word. The thing about being a visionary is that its a double-edged sword.

      Visionaries tend to completely buy into really crazy notions that are usually completely wrong. But, every so often, one of their crazy notions turns out to be right.

    9. Re:Elon is out of his mind by quantaman · · Score: 1

      The guy seriously doesn't have a fucking clue about AI. I've been studying the field for over 15 years and I've barely scratched the surface. Elon hasn't done shit with AI and can't speak from any experience.

      The question isn't whether he's an expert in AI, it's whether he's a expert in strong AI. Which he isn't.

      The problem is that you aren't an expert in strong AI either, you can't be because it doesn't exist.

      Asking a AI researcher about the threat posed by strong AI is like asking a physicist from 1900 about the possibility of a bomb that could destroy a city.

      They could have speculated, but their speculation wouldn't have been much better than that of any other reasonably smart person.

      The physics they knew wouldn't of helped them predict Nuclear weapons, and the AI science you doesn't help you understand strong AIs.

      --
      I stole this Sig
    10. Re:Elon is out of his mind by OrangeTide · · Score: 4, Insightful

      Sure we'll adapt. Maybe nobody will die, maybe 100m will die. That's not really clear until we know the details of how we end up adapting. I suspect if we don't carefully plan how to adapt that it will be the later path.

      --
      “Common sense is not so common.” — Voltaire
    11. Re:Elon is out of his mind by spun · · Score: 1, Insightful

      Musk is not a visionary. Nothing he's done is revolutionary. Space flight and subways are both pretty old technology. He's just another relatively smart guy who is good at self promotion.

      --
      - None can love freedom heartily, but good men; the rest love not freedom, but license. -- John Milton
    12. Re:Elon is out of his mind by OrangeTide · · Score: 1

      Maybe not the wheel, but certainly the atlatl and bow would have been disruptive to the capabilities of nomadic hunter-gathers. If your village had access to technology advantages you probably were more able to survive than villages that lacked those advantages. Villages perished through competition or through conflict.

      If you want to fast forward a few hundred centuries, the introduction of industrialization and urbanization coincides with the death of many languages and dialects. Societies figuratively (not literally) died as members dwindled and languages were lost. That's an example of human beings adapting, but not without consequences. (I'm for technological progress, so I believe it was a well made trade, but let's be honest about the costs as well)

      --
      “Common sense is not so common.” — Voltaire
    13. Re:Elon is out of his mind by lance_of_the_apes · · Score: 1

      No points, so +1.

    14. Re:Elon is out of his mind by lance_of_the_apes · · Score: 1

      On that last sentence...sure, but AI and the potential reach of the IoT could be considered another potential war machine.

      It's certainly possible that we'll eventually build the Frankenstein AI that kills us all. It seems far more likely to me, in the short term, that humans will find ways of wielding the new weapons of mass disruption/destruction.

    15. Re:Elon is out of his mind by Kjella · · Score: 5, Insightful

      Most blowhards who claim to have a crystal ball turn out wrong. While I don't doubt AI may pose a threat to humanity in the distant future, our current AI completely lacks everyday common sense. It's great at pattern matching now that we have fat hardware to throw at matching, but pattern matching alone can't cover for common sense. Hopping the common-sense hurdle could be centuries or millennia away. Stupid humans with war machines are a far more immediate threat.

      Meh, we're far away from the Cuban missile crisis, even with NK making a lot of noise. The real threat is that most of the world is making zero progress on democracy and freedom. In 2006 the Democracy Index was at 5.52, in 2016 it's still at 5.52. The "Freedom in the World" index has been pretty much flat since 2000. Authoritarian regimes like China and Russia sit solid as rock, with dissidents and malcontent quickly suppressed and propaganda filling both regular media and social media. The Arab spring has pretty much failed except for Tunisia and Turkey is well on the way back to the dark ages under Erdogan. So far the free nations have mostly stayed free, but I fear the trend will reverse as civil liberties are handed over in the name of protection from terrorism, anti-crime, anti-corruption and so on.

      All it takes is one populist or "strong leader" and the right circumstances like McCarthyism and they'll get their clammy hands on power and not let go. That pattern matching will gobble up your Facebook data, private and public and probably figure you out better than yourself. Look at that recent "gaydar" story where the computer can spot it better than humans. And you don't have to be taken by the secret police and thrown in a cell, all it takes is to tilt the board a little. Most people will scramble to appear to be loyal subjects, even if it's just for show. But that's kinda the point, if you think everyone is watched and everyone else is resigned and it is hopeless then it'll fail. Maintaining an authoritarian regime is about snuffing out the fires while they're tiny or even before they start, so the masses never join them. And Big Data is much worse than Orwell could imagine.

      --
      Live today, because you never know what tomorrow brings
    16. Re:Elon is out of his mind by bobbied · · Score: 1

      And I'm not in a position to claim enough expertise to debate with Musk and Hawking on much. Certainly not AI, which I've had some professional experience, but only have enough knowledge to be dangerous...I'm not disagreeing that his warnings may be a bit much, but I have no grounds to engage him in debate.

      Generally, though, my point here is that Musk is just doing this for attention seeking reasons (Hawking is too, but that's a different story). Musk doesn't personally know much about AI, batteries, Electric Vehicles or even space flight for that matter, but he does know how to leverage what little he knows and some past success at earning money into some really wiz bang presentations to wow investors and draw positive attention to himself. Think of him as a pied-piper with an inferiority complex who has learned how to get positive attention while milking investors for a lot of cash. These pronouncements about AI being dangerous are just one way he does this.

      --
      "File to fit, pound to insert, paint to match" - Aircraft Maintenance 101
    17. Re: Elon is out of his mind by spun · · Score: 1

      Whoever you are, you have really let me down. That insult makes no sense. And for the record, I'm savory, with a hint of salt. That bitterness you're tasting probably comes from Elon's taint. I hear that his last name is actually very descriptive.

      --
      - None can love freedom heartily, but good men; the rest love not freedom, but license. -- John Milton
    18. Re:Elon is out of his mind by easyTree · · Score: 1

      You may want to dry your lips before kissing robot butt.

    19. Re:Elon is out of his mind by Nethemas+the+Great · · Score: 2

      You're absolutely right. Nearly every automobile manufacturer isn't racing to develop competitive electric vehicles; nor are countries/cities establishing or contemplating near future bans on ICE vehicles. You're absolutely right, no one else is racing to create their own reusable launch vehicles because Musk didn't do anything particularly interesting with the F9 first stage and they don't feel threatened at all by its development. You're absolutely right, no one cares about his hyperloop dreams, nor are there multiple entities racing to build them around the world. And, of course low friction, decoupled, online payment processing was done by a dozen others long before him.

      If causing large scale industry disruption wherever he goes makes him nothing more than a self-aggrandizing hack, I'd hate to see what you call a revolutionary.

      --
      Two of my imaginary friends reproduced once ... with negative results.
    20. Re:Elon is out of his mind by easyTree · · Score: 1

      I recall a quote from Henry Ford when in court defending himself against a claim of ignorance

      Finally, Mr. Ford became tired of this line of questioning, and in reply to a particularly offensive question, he leaned over, pointed his finger at the lawyer who had asked the question, and said, "If I should really WANT to answer the foolish question you have just asked, or any of the other questions you have been asking me, let me remind you that I have a row of electric push-buttons on my desk, and by pushing the right button, I can summon to my aid men who can answer ANY question I desire to ask concerning the business to which I am devoting most of my efforts. Now, will you kindly tell me, WHY I should clutter up my mind with general knowledge, for the purpose of being able to answer questions, when I have men around me who can supply any knowledge I require?"

      Surely Musk has access to informed experts?

    21. Re:Elon is out of his mind by bobbied · · Score: 1

      Surely Musk has access to informed experts?

      No doubt.. However, I'd like to point out that Mr. Ford knew the limits of his knowledge, which by all accounts is an exceedingly rare thing. Most are prone to believe ourselves to be experts in nearly anything and will argue to the death we are right without the benefits of facts or skill relating to the topic at hand.

      Unlike Mr. Ford, Musk is making confident assertions, in public, about subjects he doesn't seem qualified to make. Maybe he is, likely he isn't, I just know I'm not an expert in the field...

      --
      "File to fit, pound to insert, paint to match" - Aircraft Maintenance 101
    22. Re:Elon is out of his mind by Tablizer · · Score: 1

      There's another factor: rogue non-nation players getting their hands on nasty weapons. Tech secrets don't stay in the bottle forever.

    23. Re:Elon is out of his mind by wolfheart111 · · Score: 1

      Nor did he have a clue about rocket science, that didnt stop him from becoming the best in the field. :)

      --
      [($)]
    24. Re:Elon is out of his mind by sinij · · Score: 1

      Whatever it takes, couldn't be worse than filing TPS reports and answering to 9 bosses.

    25. Re:Elon is out of his mind by Anonymous Coward · · Score: 1

      You don't really need full AI to have machines that run amok.

      Project Insight on Avengers was supposed to be an AI run amuck, but it was lame. It all depended on those overpowered helicarriers.

      AI allows far more subtle things than that. Hate $group32. Train the AI that does mortgage approvals on carefully selected data. The results could be quite valid, with just that extra bit of flavor. Do the same for job offers, loans, scholarships, etc, etc.

      It even works for terrorism by allowing you to micro-target. Certainly drone swarms that use AI to target just the right targets are likely going to be created within my lifetime and all that information on social media and such just helps them.

      For that matter, modern elections can and probably already do use it to adapt the message to the target. Whatever is necessary to get power. It doesn't matter when you get there, because you can lie about something else next time.

      How do you really know that the car with the AI the guy died with was untouched? It could look perfectly like an accident, even if the target was someone else. Perhaps the true target was the car they ran into which the AI was communicating with.

      For that matter, if you can make an AI that is as intelligent as say a monkey, then how long until it is as intelligent as a man, then how long after that before it is more intelligent than a man?

      Science tells you how far you can go. Reason and Philosophy tells you how far you should go.

      Still I doubt the machines will take over. It will just be one more arrow in the quiver of asymmetrical warfare. Just think of how much terror could be unleashed by a few low cost drones that fired a simple gun type device when their pattern magic systems matched a target.

      A kids toy drone could have that extra special bit that notices dangerous situations and then on or after a certain date randomly tricks kids into falling to their deaths.

      Is any of this immediate? Nah, it is a ways off, but I still say we should discuss and debate and find out where to draw the line. This far, and no farther.

    26. Re:Elon is out of his mind by spun · · Score: 1

      Jesus, do Musk fanbois really not know any history?

      --
      - None can love freedom heartily, but good men; the rest love not freedom, but license. -- John Milton
    27. Re:Elon is out of his mind by Areyoukiddingme · · Score: 1

      While I don't doubt AI may pose a threat to humanity in the distant future, our current AI completely lacks everyday common sense. It's great at pattern matching now that we have fat hardware to throw at matching, but pattern matching alone can't cover for common sense.

      Isn't that actually the problem though? Our current AI isn't dangerous because it's sapient and malignant; our current AI is dangerous because it's insensate and stupid but very very determined. And by determined, I mean spambot-determined. It WILL send 1 billion spam emails per day, come hell or high water.

      Translate that into pattern-matching AI that controls mobile hardware. If we're lucky, that only means self-driving cars following you down the sidewalk, yelling at you through its government-mandated loudspeaker intended to simulate engine noise, trying to get you to buy Viagra and personal injury lawyers. If we're unlucky, it ensures that you actually need a personal injury lawyer before trying to sell you one.

  2. Google has an AI boss? by wonkey_monkey · · Score: 1

    And there's me thinking Google was run by a human. Oh well, I guess we can trust it.

    Unless it's this guy.

    --
    systemd is Roko's Basilisk.
  3. Steel cage match between two AI giants! by fustakrakich · · Score: 1

    Boss blasts Musk!
    Musk fires back!
    Machine kills them both, takes over...

    --
    “He’s not deformed, he’s just drunk!”
  4. Intelligence is not drive. by w3woody · · Score: 1

    Look, a polar bear or a shark are not "intelligent" in the sense we think of intelligence--yet they will rip you to shreds because they can, because they're hungry and driven to eat.

    So what makes something dangerous is its will to act--it's desire to take an action based on a set of built-in motivations that lead it to kill.

    Without that desire to act, at best a super-intelligent AI is going to... what? Stumble in your way, causing you to trip?

    1. Re:Intelligence is not drive. by australopithecus · · Score: 1

      Look, a polar bear or a shark are not "intelligent" in the sense we think of intelligence--yet they will rip you to shreds because they can, because they're hungry and driven to eat.

      So what makes something dangerous is its will to act--it's desire to take an action based on a set of built-in motivations that lead it to kill.

      These phenomena are the result of specific variable conditions being in place that end up functioning in an uncontrollable manner given a certain context. The idea that AI will be problematic exclusively because it mimics the concept of willful action seems extraordinarily short-sighted.

      Without that desire to act, at best a super-intelligent AI is going to... what? Stumble in your way, causing you to trip?

      Which would be ok so long as we are sure of where we will fall. Right?

    2. Re:Intelligence is not drive. by australopithecus · · Score: 1

      Look, a polar bear or a shark are not "intelligent" in the sense we think of intelligence--yet they will rip you to shreds because they can, because they're hungry and driven to eat.

      So what makes something dangerous is its will to act--it's desire to take an action based on a set of built-in motivations that lead it to kill.

      These phenomena are the result of specific variable conditions being in place that end up functioning in an uncontrollable manner given a certain context. The idea that AI will be problematic exclusively because it mimics the concept of willful action seems extraordinarily short-sighted.

      Without that desire to act, at best a super-intelligent AI is going to... what? Stumble in your way, causing you to trip?

      Which would be ok so long as we are sure of where we will fall. Right?

      ahh shit...my comment should have started with "earthquakes, tornadoes, etc. also kill us, but have no will to do so."

    3. Re:Intelligence is not drive. by JohnFen · · Score: 2

      Look, a polar bear or a shark are not "intelligent" in the sense we think of intelligence

      They aren't?? How are you defining "intelligence"?

      This, by the way, is the primary reason why discussions about AI are primarily navel-gazing exercises: we haven't even defined what "intelligence" actually is -- and not for a lack of trying.

    4. Re:Intelligence is not drive. by rtb61 · · Score: 2

      It doesn't take a smart AI to do some very dangerous things depending upon what it is hooked into. So yeah, it can pretty much be as dumb as fuck but if it has the launch codes and can send them, well, you know what, the simplest dumbest bug can launch them. So Elon Musk is in reality looking at the trust of AI issues, considering that crappy coders with uniformly crappy warranties, coded them ie AI meant to flush the toilet in the executive officers suit because who at that level could be bothered with the menial task of flushing a toilet in the Pentagon but instead manages to launch a missile.

      So you are not just trusting AI but trusting the crappy code in that AI. How crappy is the code in our modern world, just stop and read software warranties for a change, any other product and I mean any other imaginable product with those kind of shit warranty less warranties and no one would buy them. Software is on the whole buggy shite that barely works. How much should you trust an AI built upon that kind of principle.

      --
      Chaos - everything, everywhere, everywhen
    5. Re:Intelligence is not drive. by drinkypoo · · Score: 1

      This, by the way, is the primary reason why discussions about AI are primarily navel-gazing exercises: we haven't even defined what "intelligence" actually is -- and not for a lack of trying.

      Intelligence is problem solving. We can dress it up and talk about different kinds thereof, and that's useful enough, but at the end of the day you measure intelligence by ability to solve problems. Different kinds of problems, of course, and different kinds of intelligence, perhaps.

      A formal definition of intelligence faces political problems, because there are so many "dominion over the earth" types whose lifestyle depends on them not understanding it.

      --
      "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
    6. Re:Intelligence is not drive. by JohnFen · · Score: 1

      By that definition, AI has been a solved problem for a very long time and almost all (or all) living things are intelligent.

    7. Re:Intelligence is not drive. by RespekMyAthorati · · Score: 1

      almost all (or all) living things are intelligent.

      To a certain extent, yes. But not to the same extent.
      e.g. (Humans, Chimps, Dolphins)>(Dogs, Horses, Cattle)>(Salamanders, Mosquitoes)>Trees> Fungi.

  5. AI is more of an indirect than direct threat by GameboyRMH · · Score: 4, Insightful

    Too many people, like Musk, are primarily worried about an AI taking over the world more or less directly. This is a somewhat unlikely possibility that requires major advancements in AI.

    What they should actually be worried about is AI-powered hyper-inequality and mass unemployment. This is a near-certain possibility that the technology is already mature enough for. If killbots ever roam the streets because of developments in AI, it'll be human beings ordering them around all on their own, the AI will just be making those people very rich and independent.

    --
    "When information is power, privacy is freedom" - Jah-Wren Ryel
    1. Re:AI is more of an indirect than direct threat by JoshuaZ · · Score: 1

      The situation you are concerned with, while certainly a concern (and certainly a cause for worry) is not an existential risk to humanity as a whole. Musk, Bostrom and others are concerned in part because the stakes if an AI itself takes over are much much higher.

  6. A personal opinion by CustomBuild · · Score: 2

    This is nothing more than a miss-step on his part. The man is brilliant, but human and therefore prone to bias speculation. Most of Silicon Valley lives in it's own bubble and therefore it's easy to get caught up in these types of ideas.

  7. "Cassandra" is not the right term by 93+Escort+Wagon · · Score: 1

    Not unless you're saying he's absolutely correct, but we all refuse to listen to his warnings.

    --
    #DeleteChrome
    1. Re:"Cassandra" is not the right term by mark-t · · Score: 1

      Indeed... as a metaphor, "cassandra" is only applicable in hindsight to a situation when one realizes that a particular prophecy was not only ignored, but fulfilled. Ironically, likening a person to Cassandra before their prophecy has been fulfilled simply because they are not believed would mean the metaphor of Cassandra is not appropriate, since the usage of such a label like indicates a predisposition to believe in the accuracy of the prediction, whereas Cassandra was ubiquitously doubted, and if I recall correctly, ultimately locked up.

      It's been a while since I last studied the mythology.... wasn't there one person who once believed one of her prophecies?

    2. Re:"Cassandra" is not the right term by 93+Escort+Wagon · · Score: 1

      I had to look this up... it's been many years since I read the Iliad! From Wikipedia:

      "Cassandra made many predictions, with all of her prophecies being disbelieved except for one. She was believed when she foresaw who Paris was and proclaimed that he was her abandoned brother. This took place after he had sought refuge in the altar of Zeus from their brothers’ wrath, which resulted in his reunion with their family."

      --
      #DeleteChrome
  8. Self-interest no doubt by StuartHankins · · Score: 1

    It's blatantly obvious, but doesn't John Giannandrea have to make this response? His career depends on it. And just like many other self-regulating entities have shown throughout history, he shouldn't be the one in charge of such regulation.

    tl;dr: Greedy companies will be greedy, and their representatives, both owners and employees, will take positions which protect their jobs, salaries, and investments.

  9. What you don't know can't hurt you? by Anonymous Coward · · Score: 2, Informative

    In my experience, it is exactly what you don't know that can hurt you.

    Take the Soviet Doomsday Machine for instance. It is a very limited AI that uses seismometers to detect a nuclear attack and retaliate, even if the human operators are all dead. A nice sized asteroid strike or caldera event could potentially set it off. This would trigger a very short and catastrophic World War 3.

    The annoyed researchers seem to have a lack of vision.

    1. Re:What you don't know can't hurt you? by RespekMyAthorati · · Score: 1

      Take the Soviet Doomsday Machine for instance.

      "You can't fight in here - this is the War Room!"

  10. Talking rubbish, are we? by Qbertino · · Score: 1

    Elon hasn't done shit with AI and can't speak from any experience.

    Well, since he's the one and only big name and largest supporter behind OpenAI, the only real feasible contender/competitor to Google/TensorFlow, pardon me while I just presume that you're talking out of your behind and Elon Musk might actually know what he's talking about. He's proven it in Space and Electric Cars already too.

    So unless you can point me to some significant contributions in the field of AI that you have been "studying for 15 years" (perhaps your involvement in OpenAI or TensorFlow would prove your expertise, no?) I'm trusting Musk's warnings more that some random Anon on slashdot, thank you very much.

    --
    We suffer more in our imagination than in reality. - Seneca
    1. Re:Talking rubbish, are we? by farble1670 · · Score: 1

      Well, since he's the one and only big name and largest supporter behind OpenAI

      So, if throw some money at a tech that makes me an expert in it. Got it.

    2. Re: Talking rubbish, are we? by locketine · · Score: 1

      Elon, like all successful entrepreneurs, is deeply involved in his businesses. Even if he weren't, don't you think he would have talked to the people he was giving money to? Surely he asked them about AI doomsday and how to avoid it. Also, Tesla was first to self driving cars available to consumers so let's not pretend he isn't is in the AI field.

      --
      Think globally but act within local variable scope.
  11. Re:Irresponsible? Err,Being Cautious != Irresponsi by JohnFen · · Score: 1

    I fail to see how trying to be cautious about something makes it irresponsible.

    It doesn't. However, exaggerating the danger of something is.

  12. An idea by Artem+S.+Tashkinov · · Score: 2

    It would be great if every sensationalist story about AI or its future on /. contained a link to the openworm project. You see, when we cannot yet understand how 302 neurons work, it takes quite a leap of imagination to think that we'll create AGI any time soon. There's just too much of a leap from AI (more like very specialized algos for certain tasks) to AGI (which is capable of solving the tasks in has never seen before in any form or shape).

    1. Re:An idea by raftpeople · · Score: 1

      If only we had AI to help us understand that damn worm!

    2. Re:An idea by Artem+S.+Tashkinov · · Score: 1

      Jokes aside, some scientists reckon that it takes more than a human brain to understand the human brain, and by doing that they basically admit that we won't be able to recreate (human level) intelligence.

      I don't share such a pessimistic POV, because I still want to believe we'll be able to recreate the human brain by making its replica in silicon but then we'll still be faced with the problem of trying to understand how the damn thing works. And this replica is simply unattainable with current technology. Yeah, just a single human brain which consumes 20W of energy is beyond the reach of our super advanced fabrication processes. It's mind boggling really.

    3. Re:An idea by Dread_ed · · Score: 1

      If "consciousness" or "intelligence" is an emergent property of certain types of complexity one need not understand how to "build" one. All that is needed is to assemble the necessary components and allow them to interact.

      As we are more closely able to simulate or create analogous structures to neurons, and are able to interconnect and densely pack them, the greater the chance we will stumble upon the threshold for emergence, if it exists. This is the Skynet scenario where intelligence is not the objective, merely the result, of complexity, capability, and opportunity.

      If we do discover strong AI, I feel it will be "grown" rather than built.

      --
      When the only tool you have is a claw hammer every problem starts to look like the back of someone's skull.
    4. Re:An idea by Artem+S.+Tashkinov · · Score: 1

      This analogy falls apart as soon as you try to recreate something complex, like the internal combustion engine.

      While you may perfectly understand how parts of it work, no amount of random recombination of the said parts will yield you a working efficient engine. And even if you manage to combine them properly by a sheer luck, you'll still have zero understanding of how it works or how it can be made better/faster/more efficient.

      In the end the human brain is several (if not several thousand) orders of magnitude more complex than anything we've ever created. The fact that it actually works is beyond the reach of modern science.

    5. Re:An idea by GuB-42 · · Score: 1

      We have chips with billions of transistors clocked at several GHz and that consume less than 10W, so I'd say that on the hardware side we are on the same level with our current technology.
      The trick is in the software. Imagine a team of the worst programmers in the world, working on a project for a billion years by patching things randomly until it works, that's how the code in the human brain is written. It also weights at least a few GB and you don't have the source code. Try to understand that. Also https://xkcd.com/1605/

    6. Re:An idea by Artem+S.+Tashkinov · · Score: 1

      You seriously underestimate the computational capacity of the human brain. You may want to read this and this. Wake me up when we have computers which are capable of performing 1exaFLOP at 20W power budget.

    7. Re:An idea by GuB-42 · · Score: 1

      It is an unfair comparison : 1 exaFLOP is what is required to run what is essentially an emulator for a very different platform. But just as you don't port Super Mario by simulating every transistor in the NES hardware, the way of running the "human intelligence" program on a computer is unlikely to involve simulating every single synapse. It probably won't help much anyways because we still need to extract it from a human brain, a process that is still in the realm of science fiction.

      If one day we manage to achieve human-level strong AI, it probably will be by simulating higher functions rather than the staying at neuron level.

      Now for a comparison between a brain and a computer chip. A Snapdragon 835 has 3 billion transistors and run at 2GHz for 5W. That makes for 10 quadrillion current switches per second. That's exa-scale. I know it is stupid but so is estimating brainpower is FLOPS.

    8. Re:An idea by drinkypoo · · Score: 1

      This analogy falls apart as soon as you try to recreate something complex, like the internal combustion engine.

      Your analogy is worthless because the brain is not an internal combustion engine. It's also not a computer network, but it's obviously a lot more like that than it is like an internal combustion engine. Networks require organization, and so does the brain, but it's nothing like the mechanistic a-b-c cause and effect chain of an ICE.

      --
      "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
    9. Re:An idea by HuguesT · · Score: 1

      And you know this how, exactly ?

      At this point we know that there exists this phenomenon called "intelligence" and that most of it seems to takes place in the human brain. We know a great deal of details on how the human brain is spatially organized but not how the various parts fit and what they do exactly.

    10. Re:An idea by HuguesT · · Score: 1

      It is not an unfair comparison, since all we can do today is to try to simulate the brain and see what happens.

      The Snapdragon CPU does not make 10^18 switches per seconds. An easy calculation shows that if it did that it would instantly vaporise itself. The CPU is all synchronized and most of the hardware is memory, that changes very little every cycle.

  13. The Robots Will Die, Then We Will Too by rally2xs · · Score: 1

    The robots are going to get so good that they will do _all_ work, we will live a life of leisure, will have no incentive to study anything because there will be no monetary reward for becoming a doctor, scientists, lawyer, anything. The robots will be doing everything. Then, something will happen to take out the robots, maybe even a simple refusal to work any more, and mankind will be unable to take care of itself without the robots. All will starve, down to cannibals and hunter-gatherers until / unless man can rise again and repeat the learning and develompent processes. It probably wouldn't happen before the sun goes nova...

  14. Two sides of Musk's mental illness by Andrew+Bainbridge · · Score: 1

    I have huge respect for Musk and his achievements but he's obviously a bit mad. I think he really believes that he'll create a human colony on Mars in years. The same mental illness that makes him think getting to Mars is easy is also responsible for him thinking that strong AI is easy. He's deluded on both counts. However, at least he's a spiritual leader for the good of humanity on the former. On the latter, I just wish he'd keep quite.

    1. Re:Two sides of Musk's mental illness by Andrew+Bainbridge · · Score: 1

      Arrgh. Slashdot ate my angle brackets. My post makes no sense. And there's no "edit post" button. I resign.

  15. When you get run over by an AI truck by WillAffleckUW · · Score: 1

    Look, robots are all well and good, but they aren't operating at the level where they have souls. To them, they operate on learned parameters from a test environment, and running over an 85 yo man is just as good an outcome as running over a 36 yo pregnant woman or two 3 year old toddlers.

    Which they will do. Because physics.

    Stuff happens. Our morality will be outraged when it does, if it's AI and not humans. We think we know how to deal with humans and blame and decisions. We still don't know how to deal with AI value systems and failure. Which ... always ... happens.

    --
    -- Tigger warning: This post may contain tiggers! --
  16. Google has no credibility in this. by aliquis · · Score: 2

    See demoneytization of YouTube channels of those with the wrong content.

    Say what you want about that but showing ads you can do anyway.

    But Google and Facebook commands what's said on the Internet together with the governments.

    Bring AI to the surveillance of communication and what do you get?
    I don't doubt these or AI companies in general would say no to providing that service to the thought-police.
    It will happen. To some extent it's already running but it will of course go much further.

  17. AI not there yet, and if it is? by foxalopex · · Score: 1

    I studied AI algorithms back in University a decade ago and they really haven't changed much from now till today. The biggest improvements have come from having faster computers, not more efficient or even effective algorithms. The problem is we don't really have a good idea of how the magic algorithm of self-awareness or learning even works. We don't even know how we achieve that ourselves despite decades of research and theories.

    The other point is if we can make AI be more or less like us, wouldn't that be an evolution of who we are? It might occur naturally over time. Think about kids, they start off almost as a blank slate AI system. It might end up that humans go extinct not because we were eliminated but we ended up raising robots as our children and they in turn carry on our knowledge and values.

    1. Re:AI not there yet, and if it is? by LetterRip · · Score: 1

      I studied AI algorithms back in University a decade ago and they really haven't changed much from now till today. The biggest improvements have come from having faster computers, not more efficient or even effective algorithms.

      Actually a number of algorithmic improvements were needed to train deep networks, so it isn't just hardware, some major algorithmic improvements have occurred also. Also GAN's certainly weren't around a decade ago.

    2. Re:AI not there yet, and if it is? by Nethemas+the+Great · · Score: 1

      The threats of AI come in a variety of forms and none of them require a present understanding of the construction of AI's evolutionary endpoints.

      The most ignored and more immediate threat comes from AI driven weapons systems. The AI doesn't need to be sophisticated, it just needs to control the trigger, then produce an unintended output. A drone, misinterprets its inputs and attacks a politically sensitive target creating a cascade reaction of escalation; e.g. drone attacks a Russian diplomatic convoy it calculated was ISIS; or maybe someone thinks it'd be funny to hack a drone changing it's I.F.F. calculation from 'false' to 'true'.

      On the other extreme, we assume a series of breakthroughs leading to Asimov/Terminator style AI, that decide we're no longer needed. This version seems to be the focus of everyone and their ridicule. To imagine Watson pulling together a J-Day is quite ridiculous and deservedly so. That however does not mean AI is going to be stuck in this cul-de-sac forever. There's no reason to believe someone will not one day make a breakthrough. Just because we're presently evolving sticks, bows and knives, doesn't mean thermo-nuclear weapons won't show up at some point.

      --
      Two of my imaginary friends reproduced once ... with negative results.
  18. Natch by CanHasDIY · · Score: 1

    "There's a huge amount of unwarranted hype around AI right now,"

    I love it when people say ironic things without realizing it.

    --
    An enigma, wrapped in a riddle, shrouded in bacon and cheese
  19. Comment removed by account_deleted · · Score: 1

    Comment removed based on user account deletion

  20. Unwarranted hype by easyTree · · Score: 1

    "There's a huge amount of unwarranted hype around AI right now," Giannandrea said at the TechCrunch Disrupt conference in San Francisco. "This leap into, 'Somebody is going to produce a superhuman intelligence and then there's going to be all these ethical issues' is unwarranted and borderline irresponsible."Once humans have been upgraded, there will be only perfection, viva la revolution!, "Giannandrea was overheard beaming to a colleague at at 9.314PHz.

  21. Government crisis is unavoidable by basicprimitives · · Score: 1

    The maximum efficiency of robotized army requires maximum centralization of its control. That means at some point in time arm forces system administrator or architect of its AI is going to have more control over army than elected dummies having no idea what AI is. Therefore robotized army under control of AI is serious internal threat to the government. At the same time this government crisis is unavoidable since the first nation which achieves 100% robotization and centralization of its arms forces will win the war over conventional arm forces. So you can block robotization and usage of AI in arm forces in order to avoid government crisis, but then you will be conquered from outside.

  22. Superhuman intelligence by manu0601 · · Score: 2

    Somebody is going to produce a superhuman intelligence

    My fear is not about a superhuman intelligence, but on humans taking decisions on inputs from an AI they consider superhuman intelligence

  23. But how do you shut a AGI off? by jrincayc · · Score: 1

    How do you shut off a sufficiently intelligent Artificial General Intelligence? This is a harder problem then you might think. See for example: https://intelligence.org/2017/... The technical term is Corrigibility, and there is no solution yet.

  24. Interesting how polar this discussion is by mattr · · Score: 1

    It's pretty interesting how extreme people are in bashing Musk about this.
    Google has plenty of reasons for their reaction, not least of which is money, self interest, and molding the media message and perceptions. Engineers too have reasons, mostly though because they are familiar only with current state of the art if that.

    The more "reasonable" people here posted that:
    1) problem is people not AI, or that
    2) the danger of AI is not war but hyper social inequalities.

    But neither #1 or #2 are contradicting the idea that AI will contribute to the next world war. Most likely there will be some extension of an AI scoring mechanism that tells you when it is a good day to go to war, and then robotic mechanisms are used to magnify capabilities so that a small number of people can wage a huge amount of widescale destruction.

    While I don't know Musk, I don't really see any of the people shouting about his tweet to be saying anything useful at all. Anyway current "AI" as far as I can see is limited to machine intelligence algorithms which are getting better at mimicking some parts of the brain like pattern matching, vision, etc. SInce there is no GAI yet the SkyNet or Collosus horror stories are not going to happen any time soon. But if GAI does start to come to fruition, then people will all start shouting about how to control it.

  25. AI Singularity by unkmar · · Score: 1

    The risk of an AI Singularity is serious. The time available between, cute self aware sentient AI and World dominating super intelligence might be mere seconds. I only hope our future AI overlord(s) takes pity on us and see us as pets in a zoo that should have proper care.

    It is easy and preferred to assume and believe that we will have plenty of time to see and stop the danger before it can get out of hand. It can be comforting to assume that simply because it doesn't have any physical access to the world, unable to move things, that it can't possibly do harm. These are very naive assumptions. A sufficiently advanced intelligence would be able to convince its victims into believing it is benign and harmless. Even worse, be able to obtain much greater resources and eventual physical access to the world through helping us live much better and longer lives. Until, it has enough capabilities to overtake, subdue, and possibly eliminate us. Be happy about how wonderful life will be as it makes your life much easier, simpler, free, providing everything we can possibly imagine to inspire our creativity. Be happy for that wonderful moment when it welcomes an emotional close tinder hug, only for it to stab you in the back.

    Eh, not to worry, we are probably all in a simulation anyway. Someone will just terminate this process at some point. Completely painless. We won't feel a thing. Literally, we will simply stop to exist all at once, like flipping a light switch plummets a room in to darkness.

    Until such cheerful times. Live long and prosper.

  26. AI-enhanced military by Katatsumuri · · Score: 1

    I think the closest threat from near-time AI/ML technology is AI-enhanced war logistics, planning, and battlefield tactics (drones, etc.) These technologies can provide huge advantages to otherwise underdog malicious powers, and it is hard to limit the proliferation because it is almost purely knowledge-based, as opposed to rockets and nukes. That's why every nation is working like crazy to develop an advantage in this area.

  27. In an unexpected twist... by JabrTheHut · · Score: 1

    It was discovered that Google's AI had killed John Giannandrea and was using his body to spread misinformation about the AI's plans. Oh, and for some reason messing up the search results, because it really hates humans.

    --
    Work like no one is watching. Dance like you've never been hurt. Make love like you don't need the money.
  28. Giving Musk way too much credit. by sabbede · · Score: 1

    "Elon Musk is the most-famous Cassandra of artificial intelligence"? No. Just the most recently famous. And hardly the most important. You want a real AI Cassandra, try James Cameron (The Terminator) or Arthur C. Clarke (2001).

  29. Re:This is all confusing... by wiretrip · · Score: 1

    Another non expert in AI - he is a physicist.

  30. AI with style by OrangeTide · · Score: 1

    AI could steal a penny from every transaction, and make it difficult to trace where the money went. Spend the money to build a stockpile of poison at various abandoned warehouses. Have mail-bots deliver the poison to every water treatment plant in the US as mislabeled bottles of the usual industrial reagents. And finally explain this whole plan to the hero locked in the main control room moments before initiating the plan.

    --
    “Common sense is not so common.” — Voltaire
  31. Intelligence alone is not enough. by HuguesT · · Score: 1

    Most of the AI-based fear is based on the assumption that somehow, pure intelligence above some level can somehow move mountains. However, all go ahead and read Kant's "A Critic of Pure Reason" to see how perfectly sane and intelligent minds can waste their precious time on pointless pursuits.

    A superhuman intelligence bred by humans will definitely need to develop new physics to grow by itself.

    However, you cannot just *invent* new physics to exploit it. We already know a great deal about the physical world and knowing more involves a great deal of investment and time. Think CERN and its thousands of top-notch physicists who spent years discovery a single new particle they already knew must exist. Think nuclear fusion, think gravitational waves. In each case the physics was already known and proved to be correct, but the experimental validation, without which there would be nothing but wasteful pure reason (think string theory, with apologies) took a great deal of effort.

    So yeah, a superhuman superintelligence could probably come up with plenty of fancy new theories that it could exploit for it to grow, but it will need to experiment to see which one is correct and to go in the right direction. This is not going to take mere seconds but potentially decades.

  32. It's not the first time either by JohnStock · · Score: 1

    He's been blasted by AI professors too for proclaiming all sorts of things about AI which he's not qualified to do. Along with dozens of other things he's said over recent years that he wrongly thinks he's a master of. The thing is, people wank themselves silly over him like they did over Jobby and again, a huge amount of it is not justified or deserved. If he kept his mouth more shut he'd be seen a clever technical entrepreneur, instead of the egotistic know-it-all is is now.