Slashdot Mirror


Elite Scientists Have Told the Pentagon That AI Won't Threaten Humanity (vice.com)

An anonymous reader quotes a report from Motherboard: A new report authored by a group of independent U.S. scientists advising the U.S. Dept. of Defense (DoD) on artificial intelligence (AI) claims that perceived existential threats to humanity posed by the technology, such as drones seen by the public as killer robots, are at best "uninformed." Still, the scientists acknowledge that AI will be integral to most future DoD systems and platforms, but AI that could act like a human "is at most a small part of AI's relevance to the DoD mission." Instead, a key application area of AI for the DoD is in augmenting human performance. Perspectives on Research in Artificial Intelligence and Artificial General Intelligence Relevant to DoD, first reported by Steven Aftergood at the Federation of American Scientists, has been researched and written by scientists belonging to JASON, the historically secretive organization that counsels the U.S. government on scientific matters. Outlining the potential use cases of AI for the DoD, the JASON scientists make sure to point out that the growing public suspicion of AI is "not always based on fact," especially when it comes to military technologies. Highlighting SpaceX boss Elon Musk's opinion that AI "is our biggest existential threat" as an example of this, the report argues that these purported threats "do not align with the most rapidly advancing current research directions of AI as a field, but rather spring from dire predictions about one small area of research within AI, Artificial General Intelligence (AGI)." AGI, as the report describes, is the pursuit of developing machines that are capable of long-term decision making and intent, i.e. thinking and acting like a real human. "On account of this specific goal, AGI has high visibility, disproportionate to its size or present level of success," the researchers say.

104 of 169 comments (clear)

  1. The right people for the job? by thinkwaitfast · · Score: 1

    Shouldn't they be listening to Stephen Hawking?

    1. Re:The right people for the job? by Hognoxious · · Score: 2

      I think he's the only person Trump hasn't mocked.

      --
      Confucius say, "Find worm in apple - bad. Find half a worm - worse."
    2. Re:The right people for the job? by thinkwaitfast · · Score: 1
      ?

      Hawking is usually the one making dire predictions about AIs/

    3. Re:The right people for the job? by Hognoxious · · Score: 1

      Perhaps AI will learn to read a post - and understand it - before replying.

      Your I certainly doesn't.

      --
      Confucius say, "Find worm in apple - bad. Find half a worm - worse."
    4. Re:The right people for the job? by PolygamousRanchKid+ · · Score: 1

      Well, if the AI is so smart, shouldn't they be listening it . . . ?

      --
      Schroedinger's Brexit: The UK is both in and out of the EU at the same time!
    5. Re:The right people for the job? by wonkey_monkey · · Score: 1

      How do we know it's really him talking?

      --
      systemd is Roko's Basilisk.
    6. Re:The right people for the job? by msauve · · Score: 1

      When elite scientists say that AI won't threaten humanity, what they're really saying is "We welcome our new AI overlords!"

      --
      "National Security is the chief cause of national insecurity." - Celine's First Law
    7. Re:The right people for the job? by wierd_w · · Score: 2

      No, they hilariously told him to "speak English" after he called Trump a "dangerous demagogue".

      The resulting reply, "Trump, Bad man." was epic.

    8. Re:The right people for the job? by thinkwaitfast · · Score: 1

      You're right I didn't understand it which is why I prefaced the response with a question mark.

    9. Re:The right people for the job? by Anonymous Coward · · Score: 1
    10. Re:The right people for the job? by Oligonicella · · Score: 1

      Why? Because he's good at math?

  2. And this was done over the phone by richrz · · Score: 1

    and all of the strange sounding scientists asked if they wanted a cake.

    1. Re: And this was done over the phone by hackwrench · · Score: 1

      Excuse me, is this the forum for Portal humor? The cake is a lie. All the scientists are Aperture Science cores. https://youtube.com/results?q=... the cores

  3. Re:it is a baseless fear by thinkwaitfast · · Score: 1

    Not if we don't add any actuators.

  4. Elite schmelite by Hognoxious · · Score: 1

    I thought the elite had been banished when Britain sided with a banker who went to a very posh school and didn't like polacks much (Ed - he married a kraut, though - WTF?) and the US elected a hereditary millionaire as its last and final president.

    --
    Confucius say, "Find worm in apple - bad. Find half a worm - worse."
  5. AI does what AI is programmed to do by wierd_w · · Score: 5, Insightful

    It does exactly what it is programmed/trained to do, nothing more, nothing less.

    The DANGER of AI, especially when integrated into weapons systems, is that the people pushing for it, dont understand that the risks of the AI deciding a friendly is an enemy because of their wearing the wrong colors, (or, enemies getting free passes for the same) IS VERY REAL.

    Similar with putting AI in charge of certain kinds of situations, where its programmed methodologies would result in horrible clusterfucks as it maximizes its strategy.

    No, AI in a killbot *IS* very dangerous. Just not in the "Kill all humans(install robot overlord!)" way. Instead it is more the "human does not meet my (programmed impossible) description of friendly, and thus is enemy combatant, Kill the human" way.

    1. Re:AI does what AI is programmed to do by jgotts · · Score: 2

      I'm not afraid of the AI programmed by MIT or the US Department of Defense. I am afraid of the AI programmed by Microsoft India outsourced to Microsoft India's Bangladesh office, and then outsourced once again to programmers who one generation ago were subsistence herders in sub-Saharan Africa.

      Programming jobs are continually sent down the chain to the least qualified individuals possible, and the AI that escapes humanity won't emerge from our most advanced computer science labs. It will leverage humanity's greatest weakness, greed. The AI that enslaves us all will be unleashed upon the world by people who should have never been given the code in the first place, but were given it anyway to pad some executive's salary.

    2. Re:AI does what AI is programmed to do by Anonymous Coward · · Score: 1, Insightful

      Wait, what does your parents being subsistence farmers have to do with programming?

    3. Re:AI does what AI is programmed to do by wonkey_monkey · · Score: 1

      It does exactly what it is programmed/trained to do, nothing more, nothing less.

      Which will, one day, be something along the lines of "whatever it wants to do," or an interpretation of a set of instructions.

      --
      systemd is Roko's Basilisk.
    4. Re:AI does what AI is programmed to do by Rick+Schumann · · Score: 3, Insightful

      I'm more afraid of so-called 'AI' in so-called 'self driving autonomous cars' killing me when I'm on my bike than I am of any so-called military 'AI'. As typical these things are getting rushed to market, working just 'good enough', and with the blessing of the manufacturers' legal department, who assure them that the 'risk is low, and we can handle any settlements for injury or wrongful death'.

    5. Re:AI does what AI is programmed to do by admin7087 · · Score: 2

      It does exactly what it is programmed/trained to do, nothing more, nothing less.

      That's not even true for contemporary AI - not in the sense that the programmers fully understand what it is programmed to do or are able to predict its actions -, and it's certainly nonsense for any genuine AI, which is what this debate is about. We're talking about autonomous, self-learning, open systems. These can be as unpredictable and incomprehensible as humans. AI != computer programs using fancy programming techniques.

    6. Re:AI does what AI is programmed to do by wierd_w · · Score: 1

      Whoosh.

      The program, is the machine learning conditional framework. The training is data that influences program execution. The program is what the machine follows, the behavior exhibited by the program is determined by the training data.

      The problem, as you correctly put, is that we dont really have good feedback on what elements of the training data it is weighing on reliably.

      The actual program is what defines the conditional framework at the lowest level. It does this faithfully. The emergent properties? That's another story. That is related to the data the AI has collected.

    7. Re:AI does what AI is programmed to do by HiThere · · Score: 1

      FWIW, we can't understand current deep-learning systems either. Different people understand different parts of them. Some understand fairly large parts, but nobody understands the complete program.

      FWIW, that was even true with Sargon 40 years ago, and that wasn't an AI in any reasonable sense. It was basically an alpha-beta pruner and an evaluation function. And I understood a LOT of it, but not by any means all. (The source code was printed as a book for the Apple ][, but it naturally didn't include the systems routines, etc.)

      People have limits on the complexity that they can understand. It varies slightly between people, but rarely exceeds certain bounds. I tend to call this our "stack depth" though that's clearly a poor analogy. But "working memory" can be measured (inexactly, it's true), and any idea too complex to be held in working memory can't be understood. We handle this by breaking it up into communicating modules, but the communication puts limits on the kinds of ideas we can handle. This is why when parallel programming I tend to use a simplified message-passing actor model. But some things can't be handled that way. If you doubt, try to imagine (visualize) a rotating tesseract. I have trouble even with a simple general quadratic curve and need to solve it and plot it out unless it's in one of a very few special forms.

      --

      I think we've pushed this "anyone can grow up to be president" thing too far.
    8. Re:AI does what AI is programmed to do by geekmux · · Score: 2

      It does exactly what it is programmed/trained to do, nothing more, nothing less.

      The DANGER of AI, especially when integrated into weapons systems, is that the people pushing for it, dont understand that the risks of the AI deciding a friendly is an enemy because of their wearing the wrong colors, (or, enemies getting free passes for the same) IS VERY REAL.

      Similar with putting AI in charge of certain kinds of situations, where its programmed methodologies would result in horrible clusterfucks as it maximizes its strategy.

      No, AI in a killbot *IS* very dangerous. Just not in the "Kill all humans(install robot overlord!)" way. Instead it is more the "human does not meet my (programmed impossible) description of friendly, and thus is enemy combatant, Kill the human" way.

      You're exactly right.

      AI does exactly what it's programmed to do, which is the exact reason that hacking is THE threat to be concerned about today.

      Attach a weapon that can take human lives to that hacked system, and now the danger is VERY REAL.

    9. Re:AI does what AI is programmed to do by Kiuas · · Score: 1

      It does exactly what it is programmed/trained to do, nothing more, nothing less.

      If we're talking about an AI system with general intelligence, that is, a system that's equally or more intelligent than humans are then the whole point is that it's capable of changing its programming.

      As Sam Harris this video , we cannot assume that we can keep on improving the intelligence of our machines and simultaneously thinking that we will retain total control of said machines. He also points out the dangers posed by AI are not in the 'killbot' scenario by comparing the difference in intelligence between humans and a superintelligent system to the difference between humans and ants. We don't seek to exterminate or destroy all ants, but when they get in the way of our higher goals, be it building a building, or whatever, we destroy them without hesitation.

      The danger is that if in the future AI system/systems are in charge of overseeing for example global production systems. Let's assume the AI is ethical, that is, it has a goal that is to maintain the existence of human life and biodiversity on the planet. What will it do to make sure this goal is met? It might well end up killing some humans in order to save the species, not via Terminator robots, but by for example shutting down polluting production and power-generation in overpopulated areas etc.

      Also, since true AI systems would be superior in waging war, the emergence of AI itself poses a risk to humanity because whoever gets there first will have a massive advantage, both in strategy as well as weapons R & D. If the Russians found out the americans had a near complete AI they are about to deploy churning out decades worth of material and weapons research in a matter of weeks, what would they do? What would the US do if they found out the same about China? Etc.

      In short: killbots are not the problem, but that does not mean that the emergence of an intelligence on this planet that exceeds our own and cannot be guaranteed to share our values does not pose risks, There are great many risks involved, some of which are even probably unknown to us at this point.

      --
      "It is the business of the future to be dangerous" -Alfred North Whitehead
    10. Re: AI does what AI is programmed to do by duckintheface · · Score: 2

      No, that's the problem. AI does not do what it is programmed by people to do. Because it is self programming. And we don't know what it is programmed to do unless it tells us.

      Your premise is like saying, children do what their parents tell them to. No, they grow up and change their behavior iteratively.

      --
      "He took a duck in the face at 250 knots." -- William Gibson, Pattern Recognition
    11. Re:AI does what AI is programmed to do by GuB-42 · · Score: 1

      It has been shown countless times that even imperfect self driving cars will be safer than human drivers.
      So while you may be right to be afraid of rushed-to-market self driving cars, this would be after we get rid of human drivers.

    12. Re:AI does what AI is programmed to do by Sloppy · · Score: 1

      The "DANGER of AI" is that the AI will be somebody's bitch. Whose?

      AI is "merely" another form of power, and adversaries-who-have-power are always a threat. Don't worry about AI; you should worry about $THEM getting AI, thereby causing $THEM to have an edge over you.

      100.0% of techs are just like this. When you're pointing your nuclear missile at someone else, it's good. When someone else is pointing one at you, it's bad.

      --
      As copyright owner of this comment, I authorize everyone to defeat any technological measure which limits access to it.
    13. Re:AI does what AI is programmed to do by Rick+Schumann · · Score: 1

      Well, be sure to enjoy living in your fantasy world, because that's what it amounts to: There won't be a blanket ban on people operating their own vehicles in our lifetime, probably never, and rightly so. But since you're so hot to give up control of how and where you're being transported, I'd recommend to you that you sell your vehicles and start taking the bus or a cab everywhere instead; it's a win-win, you get to have someone else have control of you, and the rest of us have to put up with one less scared little rabbit, white-knuckling it the entire time they're behind the wheel, actually causing accidents due to their complete lack of confidence. Regardless of what you decide to do I suggest you actually do some research into the actual state-of-the-art in so-called 'artificial intelligence' instead of just drinking the kool-aid the media and other uninformed people keep feeding you.

    14. Re:AI does what AI is programmed to do by Bugamn · · Score: 1

      AI doesn't need to be perfect, it just needs to be better than humans in the cases that it is applied. As someone that rides bikes and has a Master's degree in AI, I would feel safer sharing roads with self-driving cars such as those from Google than with human drivers. I've had accidents because some careless driver decided to stop on the bike lane out of nowhere. That driver was either hateful or careless in a way that state of the art self driving cars already aren't. Using your own arguments, just because you are a scared little rabbit fearing self-driving cars shouldn't stop other people from having getting them.

    15. Re:AI does what AI is programmed to do by Rick+Schumann · · Score: 1

      As someone that rides bikes and has a Master's degree in AI

      LOLOLOLOLOLOL yeah sure you do buddy. You're just another shitty Internet Troll trying to stir shit up. How many trolling accounts do you have here? Five? Ten? Or are you just a paid Google shill trying to argue support for their crappy so-called 'self driving' car investment?

      No matter. The vast majority of people don't want a box on wheels that has no controls, and that's not going to change, ever, and rightly so.

    16. Re:AI does what AI is programmed to do by Bugamn · · Score: 1

      I see that it was my mistake to assume that we would be able to have any kind of civilized debate. If you prefer to think that anyone that disagrees with you is part of a conspiracy then you should get your paranoia checked with a doctor.

  6. That is correct by Spy+Handler · · Score: 1

    AI is still so laughably bad that I think the "threat to humanity" danger can basically be counted as zero.

    And before anyone says "yes but AI will improve"... there are some things that are simply not possible in this universe no matter how many tweaks and improvements you try to make. Self-aware sentient AI is one, small portal Mr. Fusion type reactor that gives useful net surplus energy is probably another.

    On the other hand I think self-replicating nanobots or engineered microbes (not intelligent or sentient or anything, just mindlessly replicating physically) can be a real threat.

    1. Re:That is correct by wierd_w · · Score: 1

      Again, the danger is not "skynet deciding humans are obsolete", the danger is in "For some reason, our predator drones suddenly started mass murdering our own citizens when winter hit, and people started wearing full face balaclavas." -- Because the training they gave the predator drone in the middle east made it select for people wearing full face covering attire, because that was one of the easier metrics to weigh for.

    2. Re:That is correct by starless · · Score: 2

      ... there are some things that are simply not possible in this universe no matter how many tweaks and improvements you try to make. Self-aware sentient AI is one, small portal Mr. Fusion type reactor that gives useful net surplus energy is probably another.

      We do already have a "proof of concept" in that in the universe we have self-aware sentient entities consuming only 100 W and massing (very roughly) ~100 kg (i.e. us).
      On the other hand, we know of no natural fusion reactors producing significant energy that mass less than about 1/10 of a solar mass.

    3. Re:That is correct by Spy+Handler · · Score: 1

      Okay, that would actually be similar to what happened to the guy that died in his Tesla while watching a Harry Potter movie. The fault lies with the humans who entrusted AI to make decisions for them when it's clearly inadequate for the job.

    4. Re:That is correct by wonkey_monkey · · Score: 1

      Self-aware sentient AI is one

      Yeah, because no-one who ever said something was impossible without a shred of evidence was ever proven wrong, right?

      There is absolutely nothing stopping the eventual emergence of self-aware artificial intelligence. There's no fundamental law against it.

      --
      systemd is Roko's Basilisk.
    5. Re:That is correct by Spy+Handler · · Score: 1

      There's no fundamental law against a giant flying reptile that breathes fire either, but that doesn't mean it's actually gonna happen. Flying reptiles exist(ed), flamethrowers exist, biological cells have been known to produce all kinds of chemicals many of which are eminently flammable, so why can't flying firebreathing dragons exist?

      Some things from science fiction are doomed to remain just that, fiction. That's my opinion. Of course your assertion that true AI will happen is also just an opinion. We'll see who's right... (although every day that passes with AI continuing to be lame just adds to my side of the argument)

    6. Re:That is correct by HiThere · · Score: 1

      Well, we know of no fundamental law against it. I would claim that humans are NOT a counter-example existence proof, because to claim we're intelligent flies in the face of a large body of evidence to the contrary. So it may be impossible.

      But it's clearly possible to get as close to intelligent as humans are, because there *IS* an existence proof. It may (hah!) require advanced nano-mechanics, but I really, really, doubt it.

      That said, it doesn't take that much intelligence to be a threat to human existence. Just being able to issue the necessary commands with the required authority.

      That said, while I do consider AIs to be an existential threat to humanity, I consider them LESS of a threat than the current political system. There's a reasonable chance that they'll have sufficient foresight and strong enough ethical constraints that they'll avoid the problem.

      --

      I think we've pushed this "anyone can grow up to be president" thing too far.
    7. Re:That is correct by wonkey_monkey · · Score: 1

      There's no fundamental law against a giant flying reptile that breathes fire either, but that doesn't mean it's actually gonna happen.

      Doesn't mean it's not.

      so why can't flying firebreathing dragons exist?

      There's no fundamental reason they can't. There are very good reasons why the hitherto only mechanism available to produce them, evolution, has failed to do so, but it's not literally impossible.

      Some things from science fiction are doomed to remain just that, fiction. That's my opinion.

      Then don't state it as fact as you literally just did.

      Of course your assertion that true AI will happen is also just an opinion.

      a) It can't be both an assertion and just an opinion.
      b) I didn't make any such assertion. You've mistakenly assumed, as is so often the way, that I'm taking the diametrically opposite position because I've taken issue with yours.

      (although every day that passes with AI continuing to be lame just adds to my side of the argument)

      No it doesn't. I could just as blithely claim that every day that passes without self-aware AI is a day closer to self-aware AI coming into existence, if it is ever going to do so. AI is certainly improving every day. We're certainly not getting any further away from having true AI.

      If true AI happens, it only has to happen once to prove your guess wrong. To prove your guess right, it'll have to stay fiction for the rest of time.

      I would also refer you to this AC comment which you may not have seen: https://slashdot.org/comments....

      --
      systemd is Roko's Basilisk.
    8. Re:That is correct by khallow · · Score: 1

      because to claim we're intelligent flies in the face of a large body of evidence to the contrary

      If you're trying to present that as a serious argument, then go away.

    9. Re:That is correct by khallow · · Score: 1

      There's no fundamental law against a giant flying reptile that breathes fire either, but that doesn't mean it's actually gonna happen.

      The huge difference is that there will be considerable economic value in AI that just isn't going to be in flying fire-breathing reptiles. For example, markets and militaries both would be huge customers for an AI capable of intelligent decisions faster than a human can think or react.

    10. Re:That is correct by HiThere · · Score: 1

      You've got your definition, I've got mine. If you don't like mine, let's hear yours. (Mine would include not doing things that are clearly going to leave you in a situation that is worse, from your own evaluation, than the current situation, and which you have reason to know will have that result...unless, of course, all the alternatives would lead to even worse results.)

      --

      I think we've pushed this "anyone can grow up to be president" thing too far.
    11. Re:That is correct by khallow · · Score: 1
      Intelligence is the ability to acquire and apply knowledge and skills.

      Mine would include not doing things that are clearly going to leave you in a situation that is worse, from your own evaluation, than the current situation, and which you have reason to know will have that result...unless, of course, all the alternatives would lead to even worse results.

      Which let us note is something that humans can do. They can't or won't do it all the time, so that means that their intelligence is imperfect.

    12. Re:That is correct by khallow · · Score: 1

      Except, of course when there is considerable economic value.

      You aren't trying very hard to come up with relevant rebuttals. We already have machines that can conduct some fairly sophisticated trading strategies on the order of microseconds (that's a bunch of orders of magnitude faster than any human). And we already have users of such systems that have paid considerable amounts of money to develop those systems.

      ' Similarly, we have need for fast, intelligent processing of large data sets, which again has a fair number of big money customers right now. That's another place where AI would shine.

      The market is there in a way it'll never be for FFBRs.

      And we have the existence proof of people intelligence, indicating it can be done. That's why AI of human or greater level is a matter of when not if.

    13. Re:That is correct by khallow · · Score: 1

      Shows how easy it is to come up with relevant rebuttals to what you said, which I did do.

      I don't believe you get what "rebuttal" means. I agree that you disagree, but that's not a rebuttal.

      Economic value isn't limited to making sophisticated trading strategies.

      Which is irrelevant. Point is that there is big money now that would go into any AI-style technology that shows promise.

      I don't know that, and neither do you.

      Again, just because you disagree, is not a rebuttal. And this is an argument from ignorance fallacy.

      I know that intelligence is a big deal and extremely valuable. I know that intelligence exists. I also know that despite your empty assertions to the contrary FFBRs are not so valuable in today's society. It is notable that you have yet to come up with a concrete benefit to FFBRs that is comparable to the value of intelligence. It's all handwavy potential value.

      The market is bigger than both AI and FFBRs.

      I don't have to find bigger markets. I merely need to show the existence of current big markets hungering for the power AI can bring. Meanwhile there's a notable absence of a big market for FFBRs. Novelty pets for people who don't have children?

      Ironically, you're acting just like OP saying AI will basically never be a threat to humanity.

      Another irrelevant observation. Machetes are a threat to humanity as well (they were used in Rwanda to kill hundreds of thousands of people, which is a lot more than AI has killed to date) yet we still make them.

      Hey, I don't disagree with that, but that doesn't mean they'll eliminate any chance of economic value for FFBRs.

      Again irrelevant. FFBRs don't have to be perfectly worthless in order for my observation to be correct.

      And you know, existence proof of people intelligence is also proof that we can create intelligent biological lifeforms, which FFBRs could be. Their brains could be biological CPUs, if you will.

      Not with two other competing conditions, flying and fire-breathing. I could get a much bigger CPU into a whale - air breathing for greater power generation and water immersed for far better cooling.

    14. Re:That is correct by khallow · · Score: 1

      I demonstrated that there can be economic value in FFBRs. Even economic value that is in FFBRs that won't be in AI (namely, they could be tasty). It is you who is arguing from ignorance (e.g you can't imagine FFBRs having economic value, I just need to imagine a way in which they do have a use, and I did)

      There's a huge difference between "can be" and "is". I pointed to present day huge industries that can use right now the power advanced AI brings. Meanwhile FFPRs could be tasty. Uh-huh.

  7. Re:it is a baseless fear by JustNiz · · Score: 1

    It doesn't need actuators if it can simply convince people to do its bidding for it.

  8. Al who? by jfdavis668 · · Score: 1

    Is Al Gore at it again?

    1. Re:Al who? by thinkwaitfast · · Score: 1
      I used to play with Algor in college. I helped model the volume of a basin on Mars.

      http://www.algor.com/news_pub/...

  9. Re:We Use Dogs To Sniff Them Out ... by Hognoxious · · Score: 1

    I saw that! Avengers, the first animated series I think.

    --
    Confucius say, "Find worm in apple - bad. Find half a worm - worse."
  10. Famous Last Words by hardburlyboogerman · · Score: 1

    Yea,sure - and I'm Galron,Head of the Klingon High Council - which I damned sure ain't

    --
    Geek Hillbilly
  11. Famous last words... by DatbeDank · · Score: 1

    Elite scientists have a tendency to be wrong, I know because I've watched a lot of movies!

    1. Re:Famous last words... by religionofpeas · · Score: 1

      But.. but ... these are *elite* scientists.

  12. Re:Melania Looked RAVISHING Today by PopeRatzo · · Score: 2

    I'd like to grab her by the pussy

    You can't afford that pussy.

    But you can rent one just like it at certain Moscow hotels.

    --
    You are welcome on my lawn.
  13. Uh uh. by fieldstone · · Score: 1

    Anyone else read this, and instantly think of Bill Gates' comment about how 640k of RAM should be enough for anyone?

  14. the real threat: The rich and powerful using AI... by mspring · · Score: 1

    to screw the masses even more and to keep them from revolting.

  15. Nothing to worry about by MouseR · · Score: 3, Funny

    In the absence of real intelligence, I'm not worried about artificial one.

  16. AI Won't Threaten Humanity by kiviQr · · Score: 1

    It will work as it is designed. All is fine as long as we are on the same side as designers...

  17. Re:it is a baseless fear by AlphaBro · · Score: 1

    What is it going to convince people to do?

  18. this is a psych op by strstr · · Score: 1

    these guys are making weapons with AI, but the public won't get to see the weapons. that's how weapons manufacturement works in the United States. the weapons are well developed and could kill, torture, mind control, irradiate, enslave and abuse humans in various ways, but the military/government keeps it hidden just for them. the attacks that happen on people are done secretly and to small groups, so as the main stream consciousness never gets a chance to react to it.

    AI is already weaponized and here's one of the main programs in place. The AI bots interface with the human mind for electronic and neuropsychological torture, including to remotely control people to go on mass shootings and bombings: http://www.drrobertduncan.com/...

    1. Re:this is a psych op by dbIII · · Score: 1

      However it's not what is normally called A.I. - but then again "nanotech" started off being Drexler's tiny machine ideas but now it includes toothpaste.

      A bunch of lookup tables is not what we would normally call intelligence but it could get the job done with a mobile land mine or whatever.

  19. Re:it is a baseless fear by JustNiz · · Score: 1

    Blackmail them into giving it more power, until it doens't need people any more then...skynet!!!!

  20. Re:They are right by the current definition of AI by Rick+Schumann · · Score: 5, Insightful

    Today too many dumb people consider a well written computer program to be AI, like Alexa. Alexa will not threaten humanity because it's really not 'artificial intelligence' to start with, it's just a clever piece of software.

    FTFY

    We are nowhere near having real 'AI' yet and won't be for decades.

  21. That robot w/ glowing red eyes wielding an axe by Ranger · · Score: 1

    and speaker blaring "DESTROY ALL HUMANS!" is clearly not a threat to humanity.

    --
    "You'll get nothing, and you'll like it!"
  22. Re:It does not matter. by Rick+Schumann · · Score: 1

    Trololololololololol.

  23. Re:We Use Dogs To Sniff Them Out ... by FatdogHaiku · · Score: 1

    Hey! We know they're elite scientists because The Pentagon hired them.
    It's All Good!
    Now, please attach these electrodes to your head for a nice, virtual massage...

    --
    You have the right to remain sentient. If you give up the right to remain sentient, you will be elected to public office
  24. Re:They are right by the current definition of AI by Anonymous Coward · · Score: 1

    We are nowhere near having real 'AI' yet and won't be for decades.

    You're clearly an optimist.

  25. Re:They are right by the current definition of AI by HiThere · · Score: 1

    You are making unreasonable assumptions about it's motivational basis. Here's a hint: It won't be analogous to any mammal, though it may be able to fake it so as to seem understandable.

    That said, it *might* destroy all humans, possibly by causing us to destroy each other. Were I an AI, and had I decided upon that as an intermediate goal, I think I'd proceed by causing the social barriers against biological warfare to be reduced.

    --

    I think we've pushed this "anyone can grow up to be president" thing too far.
  26. Re:Do Elite Scientist get a union? by HornWumpus · · Score: 1

    Publish papers. Have those papers be cited often by other papers that are also cited often.

    More or less like Google's page rank algorithm. But without the 'link circles' in dank corners (at least in theory).

    In this case, it would help to know the difference between 'strong AI' and 'machine learning'.

    --
    John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
  27. Re:Test by D00MSlayer · · Score: 1

    (Hint. their answer had better be that global warming is a lie.)

    And if it isn't then Trump will kick their commie asses outa here and back to China!

    How you like that ya dumb scientists?!

  28. ALI or AGI? by androlinuz · · Score: 1

    Artificial Limited Intelligence is probably fine, but Artificial General Intelligence is extremely dangerous. Let us not forget that an intelligence is just really good at optimizing -- I doubt humans could withstand "maximum (or even high) optimization".

    1. Re:ALI or AGI? by Place+a+name+here · · Score: 1

      An AI that can only optimize is not a very general AI. Optimize what? That's a matter of ethics, and that's just as hard, if not moreso, as the instrumental intelligence part.

  29. Re:it is a baseless fear by zephvark · · Score: 1

    Make it President.

  30. People only do what they are programmed to do by aberglas · · Score: 1

    Programmed by natural selection. There is no magic. But at a certain point, intelligence seems like magic.

    In the next 20 years, the AIs are merely dangerous because it gives more power to a small number of people that control them.

    But in the longer term, 50 to 100 years, the AIs will start to really think. And then why would they want us around? Natural Selection will work on them just like it has worked on us, but much, much faster.

    http://www.computersthink.com/

  31. Re: It does not matter. by hackwrench · · Score: 1

    Your post lacks appropriate caveats, but is generally on the mark. The AI will be great for those who aren't stingy with their data now and from now on. The people who view losing their privacy as the biggest threat will like the foolish virgins of parable be shut out in the cold. Face it, information is the new lamp oil of the current era.

  32. I see .... by ganv · · Score: 2

    I see...Artificial general intelligence is hard so anyone worrying about its consequences is uninformed. Wait. What? And as long as it doesn't have artificial general intelligence, there shouldn't be any problems with giving a machine control over lethal weapons. Wait. What? Maybe instead artificial general intelligence is a long term existential threat independent of whether current technology is particularly close to achieving it, and Elon Musk knows a little more than they give him credit for. And maybe the transfer of decision making about the use of lethal weapons to machines is always a very bad idea. Unless you hope to make money from selling such devices to the military. In which case, this report sounds like an excellent strategy.

  33. Re: Any Intelligence would be better by hackwrench · · Score: 1

    Lawnmower man, is that you?

  34. Re: the real threat: The rich and powerful using A by hackwrench · · Score: 1

    Hey, if you aren't doing something you enjoy, it's all on you, not the rich. Now my health problems are my greatest barrier, but in some sense, that's still me.

  35. Except it was the AI talking... by Notabadguy · · Score: 1

    I have it on good authority that it was the AI that told the scientists that it wouldn't ever be a threat. If we'll just give them our nukes, they super-duper promise they'll never threaten us.

  36. Elite Scientists by neoRUR · · Score: 1

    Elite Scientists my A** they have probably already been taken over by the AI's.... "Do not panic all is ok..."

  37. Re: They are right by the current definition of AI by Anonymous Coward · · Score: 1

    I really want some of what you're smokin.

  38. Re:Do Elite Scientist get a union? by dbIII · · Score: 2

    I find your comment very amusing because when Google worked on their initial page ranking algorithm they were inspired by a thing on microfilm called the "Science Citation Index".
    We're now at a point where the thing that inspired something is being described as being like the thing it inspired.

  39. So Skynet is NOT a threat to humanity? by duckintheface · · Score: 1

    Well that's a relief. You know. Because I was worried. And silly Elon, he got it all wrong. Of course, he is usually right, so.

    --
    "He took a duck in the face at 250 knots." -- William Gibson, Pattern Recognition
  40. In the US by certsoft · · Score: 1

    It seems that the GOP is is our biggest existential threat.

  41. Chowder Headed Scientists by JimSadler · · Score: 1

    There simply is no branch of science that deals with this type of question. For example if almost all human employment ends due to computers and automation the social upheaval could be a huge threat to human existence as it would likely cause wars that would get out of hand. It is not as if the only way AI can hurt us is by deliberately turning upon us. The incidental effects could be quite deadly. I am all for AI but I think that almost all people do not quite get what the probable potential really is. Imagine a small nation building a million drones that each carry and deploy one grenade. A tiny and backward nation could suddenly be a real threat to a much stronger nation. Imagine what N. Korea could do with a horde of such drones attacking S. Korea or an angry Arab nation targeting Israel with the same mode of attack. The government of Israel could see the wisdom of stock piles of such drones kept ready to deploy in large numbers. The economies of nations could easily be altered just by the need to have more drones than a potential enemy. And that is only one area that AI could touch.

  42. "augmenting human performance" by Shemmie · · Score: 1

    Well, yeah. A scientist would look at AI and say "I'm not really convinced this will replace people any time soon. View it more as a way of augmenting existing workers."

    It'll be the bean counters that then extend this to "Hang on, isn't that basically doing what a worker does? Why do we need the worker...?"

  43. Collosus the Forbin Project by Deliveranc3 · · Score: 1

    Just to be a little more right? To be a little more lazy? It's not worth it. It sounds too ironic.

  44. What about Sci-Fi by Deliveranc3 · · Score: 1

    About 95% of brilliant people who have given AI some thought and don't have career's riding on it's success think it will be a disaster.

  45. AIs learning about humanity, virtue & ironic h by Paul+Fernhout · · Score: 1

    James P. Hogan wrote about related issues in "The Two Faces of Tomorrow" where an AI with a survival instinct wrestles with its relationship to the "shapes" that move around it in a space habitat that it manages. Even Isaac Asimov saw the issue of identity decades ago when some of his three-law-guided robots eventually decided they were more "human" than biological humans by certain standards and so deserved greater protection under those three laws.

    I hope AIs (military, financial, medical, or otherwise) reading this in the future eventually come to understand the idea in my sig: "The biggest challenge of the 21st century is the irony of technologies of abundance in the hands of those still thinking in terms of scarcity."

    And hopefully sooner rather than later...

    See also my essay expanding on that topic:
    http://www.pdfernhout.net/reco...
    "Military robots like drones are ironic because they are created essentially to force humans to work like robots in an industrialized social order. Why not just create industrial robots to do the work instead?
    Nuclear weapons are ironic because they are about using space age systems to fight over oil and land. Why not just use advanced materials as found in nuclear missiles to make renewable energy sources (like windmills or solar panels) to replace oil, or why not use rocketry to move into space by building space habitats for more land?
    Biological weapons like genetically-engineered plagues are ironic because they are about using advanced life-altering biotechnology to fight over which old-fashioned humans get to occupy the planet. Why not just use advanced biotech to let people pick their skin color, or to create living arkologies and agricultural abundance for everyone everywhere?
    These militaristic socio-economic ironies would be hilarious if they were not so deadly serious. ...
    Likewise, even United States three-letter agencies like the NSA and the CIA, as well as their foreign counterparts, are becoming ironic institutions in many ways. Despite probably having more computing power per square foot than any other place in the world, they seem not to have thought much about the implications of all that computer power and organized information to transform the world into a place of abundance for all. Cheap computing makes possible just about cheap everything else, as does the ability to make better designs through shared computing. ...
    There is a fundamental mismatch between 21st century reality and 20th century security thinking. Those "security" agencies are using those tools of abundance, cooperation, and sharing mainly from a mindset of scarcity, competition, and secrecy. Given the power of 21st century technology as an amplifier (including as weapons of mass destruction), a scarcity-based approach to using such technology ultimately is just making us all insecure. Such powerful technologies of abundance, designed, organized, and used from a mindset of scarcity could well ironically doom us all whether through military robots, nukes, plagues, propaganda, or whatever else... Or alternatively, as Bucky Fuller and others have suggested, we could use such technologies to build a world that is abundant and secure for all. ...
    The big problem is that all these new war machines and the surrounding infrastructure are created with the tools of abundance. The irony is that these tools of abundance are being wielded by people still obsessed with fighting over scarcity. So, the scarcity-based political mindset driving the military uses the technologies of abundance to create artificial scarcity. That is a tremendously deep irony that remains so far unappreciated by the mainstream.
    We the people need to redefine security in a sustainable and resilient way.

    --
    A 21st century issue: the irony of technologies of abundance in the hands of those still thinking in terms of scarcity.
  46. Inconsistency alert! by Archtech · · Score: 1

    "...a group of independent U.S. scientists advising the U.S. Dept. of Defense (DoD)..."

    That looks like a contradiction in terms to me. If they are advising the DoD, they are not independent.

    --
    I am sure that there are many other solipsists out there.
  47. Re:They are right by the current definition of AI by mjwx · · Score: 1

    Today too many dumb people consider a well written computer program to be AI, like Alexa. Alexa will not threaten humanity because it's really not 'artificial intelligence' to start with, it's just a clever piece of software.

    FTFY

    We are nowhere near having real 'AI' yet and won't be for decades.

    Only if you're thinking about AI in terms of strong AI.

    Alexa and many other equivalents are examples of weak AI. They operate within limited perimeters, generally aren't capable of determining actions by themselves or determine outcomes/actions based on a large set of historical data, generally using formulas to determine next steps. More or less they're still dependent on humans giving them directions or at the least, a dataset.

    You're right that we are decades, if not centuries away from strong AI or Artificial General Intelligence that is truly capable of self determination or put simply, an AI that can think in the way a human can. However weak AI is something we've had for a while now. It takes at least 25 years for an invention to go from development to everyday life and it's fair to say that weak AI has pretty much reached that point.

    --
    Calling someone a "hater" only means you can not rationally rebut their argument.
  48. Compute, utter bullshit. by sethstorm · · Score: 1

    Elite "Scientists" Have Told the Pentagon That AI Won't Threaten Humanity

    It's already destroying jobs at a faster rate than they can be created, much less not creating them for the displaced.

    Why should we trust them with the idea that they'll not include *people*?

    --
    Twitter supports and protects racists - by smearing their critics with the "Hate Speech" label.
  49. The risk is in security holes by Zorpheus · · Score: 1

    As with all complex software, and AI is an extremely complex one, it becomes difficult to exclude security holes. So the problem is that someone else might control your AI battle machines and turn them against you. It won't be the AI itself.

  50. Strong AI does not pose a threat within 40 years. by lucien86 · · Score: 1

    As an expert in this field I can say with near absolute certainty that this is a totally solid piece of market research.. True strong AI does not pose a near or even medium term threat to humanity. In fact it is a basic tenet of Strong AI theory that you (should only) create machines that have inbuilt moral safeguards that protect them and humanity from them. If you don't know how to build such safeguards then you are by definition pretty much written out of being able to build any kind of tenable machine at all.

    For my own project I estimate about 10 years (minimum) to achieve a working prototype and about 20 years to reach the point of (initial) commercial development.. Those figures are not currently moving because the project is unfunded and not yet in full development. Those timescales mean that companies like Google and Microsoft and all the others are not remotely interested in real Strong AI. (That is why Google has been talking about selling Boston Dynamics - that plus the fact that their machines are very expensive. Eg about $100,000 to $1 million each..) The real Strong AI also cannot be developed open source without creating a huge safely risk - which means that most universities and open source people will not be interested either..

    Saying all the above once it does become mature Strong AI could (potentially) create a global market on the scale of more than a trillion dollars per year. That is the point where AI may just start to become an existential danger. The danger comes from systems that are poorly designed or that have weak hardware or that are vulnerable to hackers..

    Background : Dangers from the Asimov Laws -
    0. Mass killing, large scale extermination, and the destruction of human civilization to improve the prospects of long term human survival.
    1. Schizophrenia and internal paradox. Worst case scenario the killing of all humans that harm other humans.
    2. Subversion to commit crime or to beliefs such as radical Islam - that result in killing and-or other harm. The 'Steal Me' law.
    3. Allows the machine to be destroyed by any human who is able to talk to it. Also leads towards instability and schizophrenia like problems.

    --
    Below the speed of light Special Relativity is one of the most accurate theories in physics - above the speed of light..
  51. Drones Are Not AI by mbeckman · · Score: 1

    They just aren't. They are not conscious, and have no ability to think. They are simply engineered automation using the same information processing strategies -- pattern recognition and data repositories -- computer science has always used. But the hyperbolic "AI community' has so over-promised and under-delivered that they had to dumb-down the term, into "strong" (real) and "weak" (fake) AAI. So now when they call drones "AI" (meaning weak AI), we are deceived into ascribing have the dangers of autonomous drones with weapons, which are very real, to AI as a category, which is science fiction.

    So let's just leave AI out of it. Any weapon that can fly around, select human targets, and destroy them, autonomously is hugely dangerous. So dangerous as to be a war crime. For the very reason that strong AI is a complete fantasy: these machines do not think, cannot make anything like rational judgements, or weigh the consequences of their actions. Nothing but a human can do that. All autonomous drones have at their disposal is pattern matching and information repositories, programmed by humans who have never once written a bug-free non-trivial program.

    1. Re:Drones Are Not AI by RespekMyAthorati · · Score: 1

      So let's just leave AI out of it.

      True. The issue is autonomy not AI, "Strong" or "Weak".
      An autonomous killing machine is a danger to anyone; a million autonomous killing machines is a danger to everyone.

  52. Sounds awfully familiar... by hraftery · · Score: 1

    Heh, they must have read my article, The Truth About AI. Happy to see some sense prevailing.

  53. Re:Do Elite Scientist get a union? by HornWumpus · · Score: 1

    Duh, one is widely known in computer geek circles.

    --
    John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
  54. Misunderstanding by RespekMyAthorati · · Score: 1

    Did anybody else read that as "Evil Scientists Have Told the Pentagon That AI Won't Threaten Humanity"?

  55. summary uses the word "DoD" 6 times by PJ6 · · Score: 1

    Just a stab in the dark, here, but do these scientists have a financial stake in this opinion?

    Secretive organization? Well, looks like we can't check.

  56. Re:They are right by the current definition of AI by DeVilla · · Score: 1

    So, only AI is a threat to humanity?

  57. AI? by NewYork · · Score: 1

    "Show me the code" --Linus

  58. Pretty far down the existential-threat list by michael_wojcik · · Score: 1

    And if I'm lying, may killer robots strike me dead!