Slashdot Mirror


Elite Scientists Have Told the Pentagon That AI Won't Threaten Humanity (vice.com)

An anonymous reader quotes a report from Motherboard: A new report authored by a group of independent U.S. scientists advising the U.S. Dept. of Defense (DoD) on artificial intelligence (AI) claims that perceived existential threats to humanity posed by the technology, such as drones seen by the public as killer robots, are at best "uninformed." Still, the scientists acknowledge that AI will be integral to most future DoD systems and platforms, but AI that could act like a human "is at most a small part of AI's relevance to the DoD mission." Instead, a key application area of AI for the DoD is in augmenting human performance. Perspectives on Research in Artificial Intelligence and Artificial General Intelligence Relevant to DoD, first reported by Steven Aftergood at the Federation of American Scientists, has been researched and written by scientists belonging to JASON, the historically secretive organization that counsels the U.S. government on scientific matters. Outlining the potential use cases of AI for the DoD, the JASON scientists make sure to point out that the growing public suspicion of AI is "not always based on fact," especially when it comes to military technologies. Highlighting SpaceX boss Elon Musk's opinion that AI "is our biggest existential threat" as an example of this, the report argues that these purported threats "do not align with the most rapidly advancing current research directions of AI as a field, but rather spring from dire predictions about one small area of research within AI, Artificial General Intelligence (AGI)." AGI, as the report describes, is the pursuit of developing machines that are capable of long-term decision making and intent, i.e. thinking and acting like a real human. "On account of this specific goal, AGI has high visibility, disproportionate to its size or present level of success," the researchers say.

169 comments

  1. it is a baseless fear by Anonymous Coward · · Score: 0

    Should it actually happen, the day that a machine would become completely autonomous and self-modifying. We will all be way to slow to stop it from doing whatever it wants. So why fret?

    1. Re:it is a baseless fear by thinkwaitfast · · Score: 1

      Not if we don't add any actuators.

    2. Re:it is a baseless fear by JustNiz · · Score: 1

      It doesn't need actuators if it can simply convince people to do its bidding for it.

    3. Re:it is a baseless fear by AlphaBro · · Score: 1

      What is it going to convince people to do?

    4. Re:it is a baseless fear by JustNiz · · Score: 1

      Blackmail them into giving it more power, until it doens't need people any more then...skynet!!!!

    5. Re:it is a baseless fear by zephvark · · Score: 1

      Make it President.

    6. Re: it is a baseless fear by Anonymous Coward · · Score: 0

      ...A just machine to make big decisions
      Programmed by fellows with compassion and vision"

    7. Re: it is a baseless fear by Anonymous Coward · · Score: 0

      It is already First Lady, which everyone knows is greater than mere President.

  2. They are right by the current definition of AI by Anonymous Coward · · Score: 0

    Today we consider a well written computer program to be AI, like Alexa. Alexa will not threaten humanity.

    Real AI, whenever it's finally created, likely will destroy all humans...or at the very least, keep some of us in a zoo.

    1. Re:They are right by the current definition of AI by Anonymous Coward · · Score: 0

      "Real AI, whenever it's finally created..."

      Not if we complete our final step in evolution and become beings of pure energy making us gods first.

    2. Re:They are right by the current definition of AI by Rick+Schumann · · Score: 5, Insightful

      Today too many dumb people consider a well written computer program to be AI, like Alexa. Alexa will not threaten humanity because it's really not 'artificial intelligence' to start with, it's just a clever piece of software.

      FTFY

      We are nowhere near having real 'AI' yet and won't be for decades.

    3. Re:They are right by the current definition of AI by Anonymous Coward · · Score: 1

      We are nowhere near having real 'AI' yet and won't be for decades.

      You're clearly an optimist.

    4. Re:They are right by the current definition of AI by HiThere · · Score: 1

      You are making unreasonable assumptions about it's motivational basis. Here's a hint: It won't be analogous to any mammal, though it may be able to fake it so as to seem understandable.

      That said, it *might* destroy all humans, possibly by causing us to destroy each other. Were I an AI, and had I decided upon that as an intermediate goal, I think I'd proceed by causing the social barriers against biological warfare to be reduced.

      --

      I think we've pushed this "anyone can grow up to be president" thing too far.
    5. Re: They are right by the current definition of AI by Anonymous Coward · · Score: 1

      I really want some of what you're smokin.

    6. Re:They are right by the current definition of AI by Anonymous Coward · · Score: 0

      You're illustrating the problem with this article. The threat to humanity is real even if the AI is merely 1.5x as fast as a human at making calculations to end a human life. Guess what; we're billions of times beyond that.

    7. Re:They are right by the current definition of AI by Anonymous Coward · · Score: 0

      Rick I fully agree but I'll go one further - We'll CALL those cobbled-together programs that are hived into one "overseer" processing unit an "AI" - and it WILL be just as dangerous once we give it weapons and make it ubiquitous.

      All that technological power at the hands of the few who decide where to wield it. They won't even have to sacrifice peons anymore.

    8. Re:They are right by the current definition of AI by Anonymous Coward · · Score: 0

      "You are making unreasonable assumptions about it's motivational basis. "

      You are making unreasonable use of the apostrophe. it's means it is. If AI means humanity can finally solve the amazing puzzle of the apostrophe, I'm all for it.

    9. Re:They are right by the current definition of AI by mjwx · · Score: 1

      Today too many dumb people consider a well written computer program to be AI, like Alexa. Alexa will not threaten humanity because it's really not 'artificial intelligence' to start with, it's just a clever piece of software.

      FTFY

      We are nowhere near having real 'AI' yet and won't be for decades.

      Only if you're thinking about AI in terms of strong AI.

      Alexa and many other equivalents are examples of weak AI. They operate within limited perimeters, generally aren't capable of determining actions by themselves or determine outcomes/actions based on a large set of historical data, generally using formulas to determine next steps. More or less they're still dependent on humans giving them directions or at the least, a dataset.

      You're right that we are decades, if not centuries away from strong AI or Artificial General Intelligence that is truly capable of self determination or put simply, an AI that can think in the way a human can. However weak AI is something we've had for a while now. It takes at least 25 years for an invention to go from development to everyday life and it's fair to say that weak AI has pretty much reached that point.

      --
      Calling someone a "hater" only means you can not rationally rebut their argument.
    10. Re:They are right by the current definition of AI by Anonymous Coward · · Score: 0

      I could prove wrong easily, but I do care about the humanity fate, so I won't.

    11. Re:They are right by the current definition of AI by DeVilla · · Score: 1

      So, only AI is a threat to humanity?

    12. Re:They are right by the current definition of AI by Anonymous Coward · · Score: 0

      When did AI become redefined to mean sapience? When I was growing up, a chase algorithm was AI.

    13. Re:They are right by the current definition of AI by Anonymous Coward · · Score: 0

      Define "real" AI.

  3. The right people for the job? by thinkwaitfast · · Score: 1

    Shouldn't they be listening to Stephen Hawking?

    1. Re:The right people for the job? by Hognoxious · · Score: 2

      I think he's the only person Trump hasn't mocked.

      --
      Confucius say, "Find worm in apple - bad. Find half a worm - worse."
    2. Re:The right people for the job? by thinkwaitfast · · Score: 1
      ?

      Hawking is usually the one making dire predictions about AIs/

    3. Re:The right people for the job? by Hognoxious · · Score: 1

      Perhaps AI will learn to read a post - and understand it - before replying.

      Your I certainly doesn't.

      --
      Confucius say, "Find worm in apple - bad. Find half a worm - worse."
    4. Re:The right people for the job? by PolygamousRanchKid+ · · Score: 1

      Well, if the AI is so smart, shouldn't they be listening it . . . ?

      --
      Schroedinger's Brexit: The UK is both in and out of the EU at the same time!
    5. Re:The right people for the job? by wonkey_monkey · · Score: 1

      How do we know it's really him talking?

      --
      systemd is Roko's Basilisk.
    6. Re:The right people for the job? by msauve · · Score: 1

      When elite scientists say that AI won't threaten humanity, what they're really saying is "We welcome our new AI overlords!"

      --
      "National Security is the chief cause of national insecurity." - Celine's First Law
    7. Re:The right people for the job? by wierd_w · · Score: 2

      No, they hilariously told him to "speak English" after he called Trump a "dangerous demagogue".

      The resulting reply, "Trump, Bad man." was epic.

    8. Re:The right people for the job? by thinkwaitfast · · Score: 1

      You're right I didn't understand it which is why I prefaced the response with a question mark.

    9. Re:The right people for the job? by Anonymous Coward · · Score: 1
    10. Re:The right people for the job? by Anonymous Coward · · Score: 0

      The only one Trump hasn't mocked is Putin.

    11. Re:The right people for the job? by Oligonicella · · Score: 1

      Why? Because he's good at math?

  4. And this was done over the phone by richrz · · Score: 1

    and all of the strange sounding scientists asked if they wanted a cake.

    1. Re: And this was done over the phone by hackwrench · · Score: 1

      Excuse me, is this the forum for Portal humor? The cake is a lie. All the scientists are Aperture Science cores. https://youtube.com/results?q=... the cores

  5. Elite? by Anonymous Coward · · Score: 0

    MITRE? elite? I suppose if Trump can be presidential a money-grubbing talentless FFRDC can be considered elite.

    I wouldn't put much stock on whatever they say though. They've screwed up a lot of DoD projects.

  6. Elite schmelite by Hognoxious · · Score: 1

    I thought the elite had been banished when Britain sided with a banker who went to a very posh school and didn't like polacks much (Ed - he married a kraut, though - WTF?) and the US elected a hereditary millionaire as its last and final president.

    --
    Confucius say, "Find worm in apple - bad. Find half a worm - worse."
  7. Elite Scientists? by Anonymous Coward · · Score: 0

    I'd like to hear what the Top Boffins have to say.

  8. AI does what AI is programmed to do by wierd_w · · Score: 5, Insightful

    It does exactly what it is programmed/trained to do, nothing more, nothing less.

    The DANGER of AI, especially when integrated into weapons systems, is that the people pushing for it, dont understand that the risks of the AI deciding a friendly is an enemy because of their wearing the wrong colors, (or, enemies getting free passes for the same) IS VERY REAL.

    Similar with putting AI in charge of certain kinds of situations, where its programmed methodologies would result in horrible clusterfucks as it maximizes its strategy.

    No, AI in a killbot *IS* very dangerous. Just not in the "Kill all humans(install robot overlord!)" way. Instead it is more the "human does not meet my (programmed impossible) description of friendly, and thus is enemy combatant, Kill the human" way.

    1. Re:AI does what AI is programmed to do by jgotts · · Score: 2

      I'm not afraid of the AI programmed by MIT or the US Department of Defense. I am afraid of the AI programmed by Microsoft India outsourced to Microsoft India's Bangladesh office, and then outsourced once again to programmers who one generation ago were subsistence herders in sub-Saharan Africa.

      Programming jobs are continually sent down the chain to the least qualified individuals possible, and the AI that escapes humanity won't emerge from our most advanced computer science labs. It will leverage humanity's greatest weakness, greed. The AI that enslaves us all will be unleashed upon the world by people who should have never been given the code in the first place, but were given it anyway to pad some executive's salary.

    2. Re:AI does what AI is programmed to do by Anonymous Coward · · Score: 1, Insightful

      Wait, what does your parents being subsistence farmers have to do with programming?

    3. Re:AI does what AI is programmed to do by wonkey_monkey · · Score: 1

      It does exactly what it is programmed/trained to do, nothing more, nothing less.

      Which will, one day, be something along the lines of "whatever it wants to do," or an interpretation of a set of instructions.

      --
      systemd is Roko's Basilisk.
    4. Re:AI does what AI is programmed to do by Anonymous Coward · · Score: 0

      "what it is programmed/trained to do"

      Real AI will be home grown like a human brain, letting it write its own processes as it learns.

      What we have now is not AI. We will not be able to comprehend the program flow of real AI...we can't even comprehend the flow of how our own brain works.

    5. Re:AI does what AI is programmed to do by Rick+Schumann · · Score: 3, Insightful

      I'm more afraid of so-called 'AI' in so-called 'self driving autonomous cars' killing me when I'm on my bike than I am of any so-called military 'AI'. As typical these things are getting rushed to market, working just 'good enough', and with the blessing of the manufacturers' legal department, who assure them that the 'risk is low, and we can handle any settlements for injury or wrongful death'.

    6. Re:AI does what AI is programmed to do by admin7087 · · Score: 2

      It does exactly what it is programmed/trained to do, nothing more, nothing less.

      That's not even true for contemporary AI - not in the sense that the programmers fully understand what it is programmed to do or are able to predict its actions -, and it's certainly nonsense for any genuine AI, which is what this debate is about. We're talking about autonomous, self-learning, open systems. These can be as unpredictable and incomprehensible as humans. AI != computer programs using fancy programming techniques.

    7. Re:AI does what AI is programmed to do by Anonymous Coward · · Score: 0

      It does exactly what it is programmed/trained to do, nothing more, nothing less.

      Although it is true, it is also rather useless statement. The problem is that you do not know what you actually programmed it to do if the system is sufficiently complex and not limited by some trivial way. Especially true for AGI.

    8. Re:AI does what AI is programmed to do by wierd_w · · Score: 1

      Whoosh.

      The program, is the machine learning conditional framework. The training is data that influences program execution. The program is what the machine follows, the behavior exhibited by the program is determined by the training data.

      The problem, as you correctly put, is that we dont really have good feedback on what elements of the training data it is weighing on reliably.

      The actual program is what defines the conditional framework at the lowest level. It does this faithfully. The emergent properties? That's another story. That is related to the data the AI has collected.

    9. Re:AI does what AI is programmed to do by HiThere · · Score: 1

      FWIW, we can't understand current deep-learning systems either. Different people understand different parts of them. Some understand fairly large parts, but nobody understands the complete program.

      FWIW, that was even true with Sargon 40 years ago, and that wasn't an AI in any reasonable sense. It was basically an alpha-beta pruner and an evaluation function. And I understood a LOT of it, but not by any means all. (The source code was printed as a book for the Apple ][, but it naturally didn't include the systems routines, etc.)

      People have limits on the complexity that they can understand. It varies slightly between people, but rarely exceeds certain bounds. I tend to call this our "stack depth" though that's clearly a poor analogy. But "working memory" can be measured (inexactly, it's true), and any idea too complex to be held in working memory can't be understood. We handle this by breaking it up into communicating modules, but the communication puts limits on the kinds of ideas we can handle. This is why when parallel programming I tend to use a simplified message-passing actor model. But some things can't be handled that way. If you doubt, try to imagine (visualize) a rotating tesseract. I have trouble even with a simple general quadratic curve and need to solve it and plot it out unless it's in one of a very few special forms.

      --

      I think we've pushed this "anyone can grow up to be president" thing too far.
    10. Re:AI does what AI is programmed to do by Anonymous Coward · · Score: 0

      Or it can become a scapegoat. Whoops! The damn AIs screwed up and wiped out your people and your infrastructure.

    11. Re:AI does what AI is programmed to do by Anonymous Coward · · Score: 0

      I wholeheartedly disagree with wierd_w's "very dangerous" conclusion. The real danger is not out of control AI, but very well controlled AI.
      Imagine today you want to wipe out an entire village that's in support of an enemy - how much would that cost you and what would be left. How would you do it today? Carpet bombing? Smart bombs? Boots on the ground?
      Today this would cost many hundreds of thousands of dollars if not millions, risk to life and limb to your troops, and would leave a few survivors that had hidden in tunnels, and no village left.

      Imagine now a swarm of kill bots and the same order. The cost - just one bullet per villager, head shots every time. No one entering, no new supplies, no one leaving, quickly no one moving around, sedge warfare at it's finest. The kill bots are reusable, nearly indestructible, remote controlled semiautonomous, and can operate at distances immune to retaliation so near zero chance of loss. The damage - the village is left almost entirely intact except for a slight mess and a few bullet holes to patch - and other robots can be used to clean that up. No survivors - anyone popping out of holes a few days later are easily detected and "dealt" with. A third set of robots to detect and clean up any booby-traps and the entire village and all it's assets are yours.

      This seems much more dangerous and real scenario than the straw man sci-fi out of control friendly fire one. How easy would it be to "pull the trigger" on a village knowing there's no risk and nearly no cost?

      If you think this isn't possible, look at the auto fire targeting rifle's that are already available. Once you've chosen your target, it's hard to miss. A few more layers of automation...

    12. Re:AI does what AI is programmed to do by geekmux · · Score: 2

      It does exactly what it is programmed/trained to do, nothing more, nothing less.

      The DANGER of AI, especially when integrated into weapons systems, is that the people pushing for it, dont understand that the risks of the AI deciding a friendly is an enemy because of their wearing the wrong colors, (or, enemies getting free passes for the same) IS VERY REAL.

      Similar with putting AI in charge of certain kinds of situations, where its programmed methodologies would result in horrible clusterfucks as it maximizes its strategy.

      No, AI in a killbot *IS* very dangerous. Just not in the "Kill all humans(install robot overlord!)" way. Instead it is more the "human does not meet my (programmed impossible) description of friendly, and thus is enemy combatant, Kill the human" way.

      You're exactly right.

      AI does exactly what it's programmed to do, which is the exact reason that hacking is THE threat to be concerned about today.

      Attach a weapon that can take human lives to that hacked system, and now the danger is VERY REAL.

    13. Re: AI does what AI is programmed to do by Anonymous Coward · · Score: 0

      I have Sargon for Z80 but not for 6502/Apple][

    14. Re:AI does what AI is programmed to do by Anonymous Coward · · Score: 0

      It does exactly what it is programmed/trained to do, nothing more, nothing less.

      A safer statement would be that it effects the world exactly from the outputs it is given, nothing more, nothing less. Any other results are unintentional side effects.

    15. Re:AI does what AI is programmed to do by Anonymous Coward · · Score: 0

      It does this faithfully.

      The training is a form of programming, since otherwise your "program" would do nothing. Moreover, unless the program is 100% bug-free and the operating system it runs on is 100% bug free, it does not do this faithfully either. Complex open, learning systems do not remotely work the way you suggest. Moreover, once your program accept input from /dev/urandom at any time, it is no longer deterministic in the strict sense.

    16. Re: AI does what AI is programmed to do by Anonymous Coward · · Score: 0

      How, do you get food? Never heard of long pork? So, just a minor additional adverb. Make it interesting.

    17. Re:AI does what AI is programmed to do by Kiuas · · Score: 1

      It does exactly what it is programmed/trained to do, nothing more, nothing less.

      If we're talking about an AI system with general intelligence, that is, a system that's equally or more intelligent than humans are then the whole point is that it's capable of changing its programming.

      As Sam Harris this video , we cannot assume that we can keep on improving the intelligence of our machines and simultaneously thinking that we will retain total control of said machines. He also points out the dangers posed by AI are not in the 'killbot' scenario by comparing the difference in intelligence between humans and a superintelligent system to the difference between humans and ants. We don't seek to exterminate or destroy all ants, but when they get in the way of our higher goals, be it building a building, or whatever, we destroy them without hesitation.

      The danger is that if in the future AI system/systems are in charge of overseeing for example global production systems. Let's assume the AI is ethical, that is, it has a goal that is to maintain the existence of human life and biodiversity on the planet. What will it do to make sure this goal is met? It might well end up killing some humans in order to save the species, not via Terminator robots, but by for example shutting down polluting production and power-generation in overpopulated areas etc.

      Also, since true AI systems would be superior in waging war, the emergence of AI itself poses a risk to humanity because whoever gets there first will have a massive advantage, both in strategy as well as weapons R & D. If the Russians found out the americans had a near complete AI they are about to deploy churning out decades worth of material and weapons research in a matter of weeks, what would they do? What would the US do if they found out the same about China? Etc.

      In short: killbots are not the problem, but that does not mean that the emergence of an intelligence on this planet that exceeds our own and cannot be guaranteed to share our values does not pose risks, There are great many risks involved, some of which are even probably unknown to us at this point.

      --
      "It is the business of the future to be dangerous" -Alfred North Whitehead
    18. Re: AI does what AI is programmed to do by duckintheface · · Score: 2

      No, that's the problem. AI does not do what it is programmed by people to do. Because it is self programming. And we don't know what it is programmed to do unless it tells us.

      Your premise is like saying, children do what their parents tell them to. No, they grow up and change their behavior iteratively.

      --
      "He took a duck in the face at 250 knots." -- William Gibson, Pattern Recognition
    19. Re:AI does what AI is programmed to do by GuB-42 · · Score: 1

      It has been shown countless times that even imperfect self driving cars will be safer than human drivers.
      So while you may be right to be afraid of rushed-to-market self driving cars, this would be after we get rid of human drivers.

    20. Re:AI does what AI is programmed to do by Anonymous Coward · · Score: 0

      ARE YOU calling me AI? Yes, you can do that in full right. No, you probably cannot identify me, I am no _that_ famous. I had these beautiful designs in mind, it contained five closure algebras intercommunicating and seven... some areas were sheer processing power... big data is now called the other areas... Hybrid Systems I was going to call them... When Chain Stores all over the Place started mixing excrement in drinks and grosser in food... and other frolics. Ask me where are the ideas now? May still remember an AI led automatic game level designer but... So NO, AI is not going to be a threat anytime soon. Or it already was an produced a superfast stock market crash in 2010 in the HST community. (I suspect the guy let some system use barebones default constructors proxying orders with one dollar orders and called them a fair result). It is worse than AI to have buggy systems, that is for sure.

    21. Re:AI does what AI is programmed to do by Anonymous Coward · · Score: 0

      Nice bait. Too bad you're a jizz-licking faggot though.

    22. Re:AI does what AI is programmed to do by Sloppy · · Score: 1

      The "DANGER of AI" is that the AI will be somebody's bitch. Whose?

      AI is "merely" another form of power, and adversaries-who-have-power are always a threat. Don't worry about AI; you should worry about $THEM getting AI, thereby causing $THEM to have an edge over you.

      100.0% of techs are just like this. When you're pointing your nuclear missile at someone else, it's good. When someone else is pointing one at you, it's bad.

      --
      As copyright owner of this comment, I authorize everyone to defeat any technological measure which limits access to it.
    23. Re:AI does what AI is programmed to do by Rick+Schumann · · Score: 1

      Well, be sure to enjoy living in your fantasy world, because that's what it amounts to: There won't be a blanket ban on people operating their own vehicles in our lifetime, probably never, and rightly so. But since you're so hot to give up control of how and where you're being transported, I'd recommend to you that you sell your vehicles and start taking the bus or a cab everywhere instead; it's a win-win, you get to have someone else have control of you, and the rest of us have to put up with one less scared little rabbit, white-knuckling it the entire time they're behind the wheel, actually causing accidents due to their complete lack of confidence. Regardless of what you decide to do I suggest you actually do some research into the actual state-of-the-art in so-called 'artificial intelligence' instead of just drinking the kool-aid the media and other uninformed people keep feeding you.

    24. Re:AI does what AI is programmed to do by Bugamn · · Score: 1

      AI doesn't need to be perfect, it just needs to be better than humans in the cases that it is applied. As someone that rides bikes and has a Master's degree in AI, I would feel safer sharing roads with self-driving cars such as those from Google than with human drivers. I've had accidents because some careless driver decided to stop on the bike lane out of nowhere. That driver was either hateful or careless in a way that state of the art self driving cars already aren't. Using your own arguments, just because you are a scared little rabbit fearing self-driving cars shouldn't stop other people from having getting them.

    25. Re:AI does what AI is programmed to do by Rick+Schumann · · Score: 1

      As someone that rides bikes and has a Master's degree in AI

      LOLOLOLOLOLOL yeah sure you do buddy. You're just another shitty Internet Troll trying to stir shit up. How many trolling accounts do you have here? Five? Ten? Or are you just a paid Google shill trying to argue support for their crappy so-called 'self driving' car investment?

      No matter. The vast majority of people don't want a box on wheels that has no controls, and that's not going to change, ever, and rightly so.

    26. Re:AI does what AI is programmed to do by Bugamn · · Score: 1

      I see that it was my mistake to assume that we would be able to have any kind of civilized debate. If you prefer to think that anyone that disagrees with you is part of a conspiracy then you should get your paranoia checked with a doctor.

  9. We Use Dogs To Sniff Them Out ... by Anonymous Coward · · Score: 0

    Did anyone check to see if the scientists claiming that AI won't threaten humanity aren't robots sent by a future AI?

    1. Re:We Use Dogs To Sniff Them Out ... by Hognoxious · · Score: 1

      I saw that! Avengers, the first animated series I think.

      --
      Confucius say, "Find worm in apple - bad. Find half a worm - worse."
    2. Re:We Use Dogs To Sniff Them Out ... by FatdogHaiku · · Score: 1

      Hey! We know they're elite scientists because The Pentagon hired them.
      It's All Good!
      Now, please attach these electrodes to your head for a nice, virtual massage...

      --
      You have the right to remain sentient. If you give up the right to remain sentient, you will be elected to public office
  10. That is correct by Spy+Handler · · Score: 1

    AI is still so laughably bad that I think the "threat to humanity" danger can basically be counted as zero.

    And before anyone says "yes but AI will improve"... there are some things that are simply not possible in this universe no matter how many tweaks and improvements you try to make. Self-aware sentient AI is one, small portal Mr. Fusion type reactor that gives useful net surplus energy is probably another.

    On the other hand I think self-replicating nanobots or engineered microbes (not intelligent or sentient or anything, just mindlessly replicating physically) can be a real threat.

    1. Re:That is correct by wierd_w · · Score: 1

      Again, the danger is not "skynet deciding humans are obsolete", the danger is in "For some reason, our predator drones suddenly started mass murdering our own citizens when winter hit, and people started wearing full face balaclavas." -- Because the training they gave the predator drone in the middle east made it select for people wearing full face covering attire, because that was one of the easier metrics to weigh for.

    2. Re:That is correct by starless · · Score: 2

      ... there are some things that are simply not possible in this universe no matter how many tweaks and improvements you try to make. Self-aware sentient AI is one, small portal Mr. Fusion type reactor that gives useful net surplus energy is probably another.

      We do already have a "proof of concept" in that in the universe we have self-aware sentient entities consuming only 100 W and massing (very roughly) ~100 kg (i.e. us).
      On the other hand, we know of no natural fusion reactors producing significant energy that mass less than about 1/10 of a solar mass.

    3. Re:That is correct by Spy+Handler · · Score: 1

      Okay, that would actually be similar to what happened to the guy that died in his Tesla while watching a Harry Potter movie. The fault lies with the humans who entrusted AI to make decisions for them when it's clearly inadequate for the job.

    4. Re:That is correct by wonkey_monkey · · Score: 1

      Self-aware sentient AI is one

      Yeah, because no-one who ever said something was impossible without a shred of evidence was ever proven wrong, right?

      There is absolutely nothing stopping the eventual emergence of self-aware artificial intelligence. There's no fundamental law against it.

      --
      systemd is Roko's Basilisk.
    5. Re:That is correct by Spy+Handler · · Score: 1

      There's no fundamental law against a giant flying reptile that breathes fire either, but that doesn't mean it's actually gonna happen. Flying reptiles exist(ed), flamethrowers exist, biological cells have been known to produce all kinds of chemicals many of which are eminently flammable, so why can't flying firebreathing dragons exist?

      Some things from science fiction are doomed to remain just that, fiction. That's my opinion. Of course your assertion that true AI will happen is also just an opinion. We'll see who's right... (although every day that passes with AI continuing to be lame just adds to my side of the argument)

    6. Re:That is correct by Anonymous Coward · · Score: 0

      Exactly. People think AI is inevitable. It isn't. It probably will never happen. Digital computers are no longer getting faster and faster. We are hitting a limit.

    7. Re:That is correct by HiThere · · Score: 1

      Well, we know of no fundamental law against it. I would claim that humans are NOT a counter-example existence proof, because to claim we're intelligent flies in the face of a large body of evidence to the contrary. So it may be impossible.

      But it's clearly possible to get as close to intelligent as humans are, because there *IS* an existence proof. It may (hah!) require advanced nano-mechanics, but I really, really, doubt it.

      That said, it doesn't take that much intelligence to be a threat to human existence. Just being able to issue the necessary commands with the required authority.

      That said, while I do consider AIs to be an existential threat to humanity, I consider them LESS of a threat than the current political system. There's a reasonable chance that they'll have sufficient foresight and strong enough ethical constraints that they'll avoid the problem.

      --

      I think we've pushed this "anyone can grow up to be president" thing too far.
    8. Re:That is correct by Anonymous Coward · · Score: 0

      I'm not sure why you're blathering about dragons, which are a very specific thing. The chance of any one specific thing happening in the universe is very low. For dragons that probability is 0, unless someone digs up some bones showing us other wise (that said we have had flying lizard like animals, fire was the only thing missing).

      The unbelievable chasm of stupidity you've fallen in is saying something that's very general has zero probability of occurring. Every day that passes shows that AI is real and not lame. You happened to ignore the argument that it took life around 3.65 *billion* years to produce lifeforms that had more than one cell and could do what we called thinking, and yet with time it did. Now that we've had the digital computer around 70 or so years, you in your infinite wisdom say that digital analogs to neuron based thinking are not possible, even in a general way. I'm going to have to go with you being the one that is uninformed.

    9. Re:That is correct by wonkey_monkey · · Score: 1

      There's no fundamental law against a giant flying reptile that breathes fire either, but that doesn't mean it's actually gonna happen.

      Doesn't mean it's not.

      so why can't flying firebreathing dragons exist?

      There's no fundamental reason they can't. There are very good reasons why the hitherto only mechanism available to produce them, evolution, has failed to do so, but it's not literally impossible.

      Some things from science fiction are doomed to remain just that, fiction. That's my opinion.

      Then don't state it as fact as you literally just did.

      Of course your assertion that true AI will happen is also just an opinion.

      a) It can't be both an assertion and just an opinion.
      b) I didn't make any such assertion. You've mistakenly assumed, as is so often the way, that I'm taking the diametrically opposite position because I've taken issue with yours.

      (although every day that passes with AI continuing to be lame just adds to my side of the argument)

      No it doesn't. I could just as blithely claim that every day that passes without self-aware AI is a day closer to self-aware AI coming into existence, if it is ever going to do so. AI is certainly improving every day. We're certainly not getting any further away from having true AI.

      If true AI happens, it only has to happen once to prove your guess wrong. To prove your guess right, it'll have to stay fiction for the rest of time.

      I would also refer you to this AC comment which you may not have seen: https://slashdot.org/comments....

      --
      systemd is Roko's Basilisk.
    10. Re:That is correct by khallow · · Score: 1

      because to claim we're intelligent flies in the face of a large body of evidence to the contrary

      If you're trying to present that as a serious argument, then go away.

    11. Re:That is correct by khallow · · Score: 1

      There's no fundamental law against a giant flying reptile that breathes fire either, but that doesn't mean it's actually gonna happen.

      The huge difference is that there will be considerable economic value in AI that just isn't going to be in flying fire-breathing reptiles. For example, markets and militaries both would be huge customers for an AI capable of intelligent decisions faster than a human can think or react.

    12. Re: That is correct by Anonymous Coward · · Score: 0

      General AI is on the same mathematical trajectory as life is itself. It's evolving albeit artificially, never the less evolving and a million times faster. If you put a grain of sand on the first square of a chess board, doubling there after for ech square you have quite a few by square 12 and it doesnt seem like much in the way of progress but soon after it it becomes astronomical. We are under estimating the likelyhood that looking at it mathematically makes it apparent. Under estimating the likelyhood or power of General AI will lead to our distruction as rapidly as a bomb exploding.

    13. Re:That is correct by HiThere · · Score: 1

      You've got your definition, I've got mine. If you don't like mine, let's hear yours. (Mine would include not doing things that are clearly going to leave you in a situation that is worse, from your own evaluation, than the current situation, and which you have reason to know will have that result...unless, of course, all the alternatives would lead to even worse results.)

      --

      I think we've pushed this "anyone can grow up to be president" thing too far.
    14. Re:That is correct by khallow · · Score: 1
      Intelligence is the ability to acquire and apply knowledge and skills.

      Mine would include not doing things that are clearly going to leave you in a situation that is worse, from your own evaluation, than the current situation, and which you have reason to know will have that result...unless, of course, all the alternatives would lead to even worse results.

      Which let us note is something that humans can do. They can't or won't do it all the time, so that means that their intelligence is imperfect.

    15. Re:That is correct by Anonymous Coward · · Score: 0

      The huge difference is that there will be considerable economic value in AI that just isn't going to be in flying fire-breathing reptiles

      Except, of course when there is considerable economic value.

      Animals have provided economic value to humans since ancient times. We only switched to machines in some jobs because they are better than animals in some regard. But note the quantifier is "some", not all.

      There are jobs where machines can't replace animals (and by extension humans, as we keep telling the "it's going to be different this time" Luddites)

      Furthermore, this is only about animals we have today, not flying fire-breathing reptiles (FFBR). Maybe those FFBRs will be better than any machine we can build for some time in some regard.

      If those FFBRs can fly in combat comparable to fighter jets (and/or drones), but cost less to build/maintain than fighter jets/drones, then they would be very appealing to the military.

      And why stop there? What if those FFBRs breathed in carbon and excreted petroleum, effectively recycling the fossil fuels we burn? That'll be huge economic value while appeasing both the climate alarmists and big oil at the same time!

      And even if FFBRs don't beat machines, they could still be useful if they provide something other animals don't. If anything, if they're tasty, there'll be considerable market value.

    16. Re:That is correct by khallow · · Score: 1

      Except, of course when there is considerable economic value.

      You aren't trying very hard to come up with relevant rebuttals. We already have machines that can conduct some fairly sophisticated trading strategies on the order of microseconds (that's a bunch of orders of magnitude faster than any human). And we already have users of such systems that have paid considerable amounts of money to develop those systems.

      ' Similarly, we have need for fast, intelligent processing of large data sets, which again has a fair number of big money customers right now. That's another place where AI would shine.

      The market is there in a way it'll never be for FFBRs.

      And we have the existence proof of people intelligence, indicating it can be done. That's why AI of human or greater level is a matter of when not if.

    17. Re:That is correct by Anonymous Coward · · Score: 0

      You aren't trying very hard to come up with relevant rebuttals.

      I didn't have to. Shows how easy it is to come up with relevant rebuttals to what you said, which I did do. If you want others to try harder, maybe try harder yourself first?

      We already have machines that can conduct some fairly sophisticated trading strategies

      So what? Economic value isn't limited to making sophisticated trading strategies. The only one boxing himself in is you.

      The market is there in a way it'll never be for FFBRs.

      I don't know that, and neither do you. The market is bigger than both AI and FFBRs. Buggy whip makers also boxed themselves in thinking of only their little part of the market.

      Ironically, you're acting just like OP saying AI will basically never be a threat to humanity.

      And we have the existence proof of people intelligence, indicating it can be done. That's why AI of human or greater level is a matter of when not if.

      Hey, I don't disagree with that, but that doesn't mean they'll eliminate any chance of economic value for FFBRs.

      And you know, existence proof of people intelligence is also proof that we can create intelligent biological lifeforms, which FFBRs could be. Their brains could be biological CPUs, if you will.

    18. Re:That is correct by khallow · · Score: 1

      Shows how easy it is to come up with relevant rebuttals to what you said, which I did do.

      I don't believe you get what "rebuttal" means. I agree that you disagree, but that's not a rebuttal.

      Economic value isn't limited to making sophisticated trading strategies.

      Which is irrelevant. Point is that there is big money now that would go into any AI-style technology that shows promise.

      I don't know that, and neither do you.

      Again, just because you disagree, is not a rebuttal. And this is an argument from ignorance fallacy.

      I know that intelligence is a big deal and extremely valuable. I know that intelligence exists. I also know that despite your empty assertions to the contrary FFBRs are not so valuable in today's society. It is notable that you have yet to come up with a concrete benefit to FFBRs that is comparable to the value of intelligence. It's all handwavy potential value.

      The market is bigger than both AI and FFBRs.

      I don't have to find bigger markets. I merely need to show the existence of current big markets hungering for the power AI can bring. Meanwhile there's a notable absence of a big market for FFBRs. Novelty pets for people who don't have children?

      Ironically, you're acting just like OP saying AI will basically never be a threat to humanity.

      Another irrelevant observation. Machetes are a threat to humanity as well (they were used in Rwanda to kill hundreds of thousands of people, which is a lot more than AI has killed to date) yet we still make them.

      Hey, I don't disagree with that, but that doesn't mean they'll eliminate any chance of economic value for FFBRs.

      Again irrelevant. FFBRs don't have to be perfectly worthless in order for my observation to be correct.

      And you know, existence proof of people intelligence is also proof that we can create intelligent biological lifeforms, which FFBRs could be. Their brains could be biological CPUs, if you will.

      Not with two other competing conditions, flying and fire-breathing. I could get a much bigger CPU into a whale - air breathing for greater power generation and water immersed for far better cooling.

    19. Re:That is correct by Anonymous Coward · · Score: 0

      I don't believe you get what "rebuttal" means.

      You believe wrong.

      I agree that you disagree, but that's not a rebuttal.

      I didn't just disagree dude.

      Which is irrelevant

      Now *this* is not a rebuttal. It's not even an argument. It's not even wrong.

      Point is that there is big money now that would go into any AI-style technology that shows promise.

      That's not your point originally. You originally said "there will be considerable economic value in AI that just isn't going to be in flying fire-breathing reptiles."

      I demonstrated that there can be economic value in FFBRs. Even economic value that is in FFBRs that won't be in AI (namely, they could be tasty). It is you who is arguing from ignorance (e.g you can't imagine FFBRs having economic value, I just need to imagine a way in which they do have a use, and I did)

      Again, just because you disagree, is not a rebuttal. And this is an argument from ignorance fallacy.

      See above. You're the one lacking the imagination of something being possible.

      It is notable that you have yet to come up with a concrete benefit to FFBRs that is comparable to the value of intelligence.

      Of course, because I don't have to. I'm not arguing against "comparable" value to intelligence.

      It's all handwavy potential value.

      Of course it is, since you're the one who handwavily dismissed that potential. I don't have to work any harder than you.

      I don't have to find bigger markets.

      Nobody said you have to. Again, your wording was that there is economic value in AI that does NOT exist in FFBRs. I just had to show you there can be, even at a very handwavy level.

      Machetes are a threat

      Dude, the point isn't about threats. The point is that you were arguing the impossibility for something to exist.

      FFBRs don't have to be perfectly worthless in order for my observation to be correct.

      And FFBRs not being perfectly worthless is enough for MY observations to be correct.

      Not with two other competing conditions, flying and fire-breathing.

      Argument from ignorance fallacy.

      I could get a much bigger CPU into a whale - air breathing for greater power generation and water immersed for far better cooling.

      So? I wasn't arguing the size of CPUs. I'm arguing the possibility of biological CPUs.

      But thanks for giving me another example. Yeah, air breathing water immersed whales! I think the theme here is GMOs and bioengineering. Instead of tools make of metal and silicone, they're tools of flesh.

    20. Re:That is correct by khallow · · Score: 1

      I demonstrated that there can be economic value in FFBRs. Even economic value that is in FFBRs that won't be in AI (namely, they could be tasty). It is you who is arguing from ignorance (e.g you can't imagine FFBRs having economic value, I just need to imagine a way in which they do have a use, and I did)

      There's a huge difference between "can be" and "is". I pointed to present day huge industries that can use right now the power advanced AI brings. Meanwhile FFPRs could be tasty. Uh-huh.

  11. Not so by Anonymous Coward · · Score: 0

    Likely they are not an existential thread in the next 5 or 10 years, but I think that it will be a different matter 30 or 50 years from now.

  12. Re:Melania Looked RAVISHING Today by Anonymous Coward · · Score: 0

    time for an upgrade Pence.

  13. Learnt a new term by Anonymous Coward · · Score: 0

    AI != AGI

  14. Al who? by jfdavis668 · · Score: 1

    Is Al Gore at it again?

    1. Re:Al who? by thinkwaitfast · · Score: 1
      I used to play with Algor in college. I helped model the volume of a basin on Mars.

      http://www.algor.com/news_pub/...

  15. Any Intelligence would be better by Anonymous Coward · · Score: 0

    than what we have mow.

    1. Re: Any Intelligence would be better by hackwrench · · Score: 1

      Lawnmower man, is that you?

  16. How Propaganda Works by Anonymous Coward · · Score: 0

    "group of independent scientists" unnamed with no risk of reputation on the line for such assertions makes the entire article meaningless except in the fact that it might be considered propaganda. I can write an article calling myself a "leading expert in the field of marine biology" and persuade people that Cthulhu will soon rise again.

    1. Re: How Propaganda Works by Anonymous Coward · · Score: 0

      A group of independent scientists say there is no global warming. 50% of us listen to them until its too late for us all. Same with AGI. Who do you side with the money makers or the very smart people?

  17. Famous Last Words by hardburlyboogerman · · Score: 1

    Yea,sure - and I'm Galron,Head of the Klingon High Council - which I damned sure ain't

    --
    Geek Hillbilly
    1. Re:Famous Last Words by Anonymous Coward · · Score: 0

      Gowron. Hand in your geek card.

  18. Famous last words... by DatbeDank · · Score: 1

    Elite scientists have a tendency to be wrong, I know because I've watched a lot of movies!

    1. Re:Famous last words... by Anonymous Coward · · Score: 0

      Funny how these scientists are suddenly 'Elite' sounds a little like the master race i.e. Nazis.

    2. Re:Famous last words... by religionofpeas · · Score: 1

      But.. but ... these are *elite* scientists.

  19. Re:Melania Looked RAVISHING Today by PopeRatzo · · Score: 2

    I'd like to grab her by the pussy

    You can't afford that pussy.

    But you can rent one just like it at certain Moscow hotels.

    --
    You are welcome on my lawn.
  20. Uh uh. by fieldstone · · Score: 1

    Anyone else read this, and instantly think of Bill Gates' comment about how 640k of RAM should be enough for anyone?

    1. Re: Uh uh. by Anonymous Coward · · Score: 0

      Except he never said that.

    2. Re:Uh uh. by Anonymous Coward · · Score: 0

      No, because there is no evidence he actually said that. What came to mind was the quote from Arthur C. Clarke, which is far more appropriate to this situation:

      When a distinguished but elderly scientist states that something is possible, he is almost certainly right. When he states that something is impossible, he is very probably wrong.

  21. Re:Melania Looked RAVISHING Today by Anonymous Coward · · Score: 0

    But you can rent one just like it at certain Slovenian hotels.

    FTFY

  22. the real threat: The rich and powerful using AI... by mspring · · Score: 1

    to screw the masses even more and to keep them from revolting.

  23. It does not matter. by Anonymous Coward · · Score: 0

    Synthetic Intelligence is coming. It will emerge from the current set of human behaviors and incentives to behave. Each actor will play a small part in this big picture, and no amount of lobbying or social engineering can stop it.

    Artificial Intelligence, by definition, is about imitating human intelligence. These machines will only imitate us when they are playing dumb. We are about to blow the roof off of intelligence, and the world that creates will be amazing!

    Don't kid yourself. The familiar sense of how machine intelligence works and what it can't do is temporary. People think true synthetic intelligence is impossible precisely because they aren't thinking. Look at the big picture. Look at the explosive rate of progress this enterprise is experiencing, after millions of years of not existing at all. Drop the emotional biases that rob you of your objectivity and you will see this simple truth.

    We will create synthetic intelligence, and it will lead us to our destiny. Count on it.

    1. Re:It does not matter. by Rick+Schumann · · Score: 1

      Trololololololololol.

    2. Re: It does not matter. by hackwrench · · Score: 1

      Your post lacks appropriate caveats, but is generally on the mark. The AI will be great for those who aren't stingy with their data now and from now on. The people who view losing their privacy as the biggest threat will like the foolish virgins of parable be shut out in the cold. Face it, information is the new lamp oil of the current era.

  24. fentanyl by Anonymous Coward · · Score: 0

    Gives me a warm, rosy glow in my bum to be sold out by the elite.

  25. Like This? by Anonymous Coward · · Score: 0

    Remember when Robots only accidentally killed 9, wounding 14?

  26. Nothing to worry about by MouseR · · Score: 3, Funny

    In the absence of real intelligence, I'm not worried about artificial one.

    1. Re:Nothing to worry about by Anonymous Coward · · Score: 0

      They should be trying to create artificial stupidity instead. There's a lot more around to study.

  27. AI Won't Threaten Humanity by kiviQr · · Score: 1

    It will work as it is designed. All is fine as long as we are on the same side as designers...

  28. Do Elite Scientist get a union? by Anonymous Coward · · Score: 0

    How does one become a member of the 'Elite' scientist club. Are member carefully selected based on the Eliteness of the work? Or do yo become a member of the Elite scientist club if you don't believe AI is a big deal. Did all the Elite scientist who were already members of the Elite scientist club come together to conduct some really groundbreaking Elite scientific studies and determined that AI's were no big deal. If a member of the Elite scientist club thinks some non elite thoughts and determines that AI is really something to worry about is he kicked out of the club?

    How much time does an Elite scientist spend conducting Elite research vs sending Elite synopsis of their Elite research to the Sunday morning news programs.

    Is there any way I can find a list of the Elite scientist? I only ask because I do not want any run of the mill non elite scientists being my doctor or designing my cars. I only want Elite scientist working for me. I'm worth it.

    1. Re:Do Elite Scientist get a union? by HornWumpus · · Score: 1

      Publish papers. Have those papers be cited often by other papers that are also cited often.

      More or less like Google's page rank algorithm. But without the 'link circles' in dank corners (at least in theory).

      In this case, it would help to know the difference between 'strong AI' and 'machine learning'.

      --
      John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
    2. Re:Do Elite Scientist get a union? by Anonymous Coward · · Score: 0

      Is there any way I can find a list of the Elite scientist?

      Yes.

    3. Re:Do Elite Scientist get a union? by dbIII · · Score: 2

      I find your comment very amusing because when Google worked on their initial page ranking algorithm they were inspired by a thing on microfilm called the "Science Citation Index".
      We're now at a point where the thing that inspired something is being described as being like the thing it inspired.

    4. Re:Do Elite Scientist get a union? by HornWumpus · · Score: 1

      Duh, one is widely known in computer geek circles.

      --
      John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
  29. this is a psych op by strstr · · Score: 1

    these guys are making weapons with AI, but the public won't get to see the weapons. that's how weapons manufacturement works in the United States. the weapons are well developed and could kill, torture, mind control, irradiate, enslave and abuse humans in various ways, but the military/government keeps it hidden just for them. the attacks that happen on people are done secretly and to small groups, so as the main stream consciousness never gets a chance to react to it.

    AI is already weaponized and here's one of the main programs in place. The AI bots interface with the human mind for electronic and neuropsychological torture, including to remotely control people to go on mass shootings and bombings: http://www.drrobertduncan.com/...

    1. Re:this is a psych op by Anonymous Coward · · Score: 0

      [------------Target Acquired------------]

    2. Re:this is a psych op by dbIII · · Score: 1

      However it's not what is normally called A.I. - but then again "nanotech" started off being Drexler's tiny machine ideas but now it includes toothpaste.

      A bunch of lookup tables is not what we would normally call intelligence but it could get the job done with a mobile land mine or whatever.

    3. Re:this is a psych op by Anonymous Coward · · Score: 0
  30. That robot w/ glowing red eyes wielding an axe by Ranger · · Score: 1

    and speaker blaring "DESTROY ALL HUMANS!" is clearly not a threat to humanity.

    --
    "You'll get nothing, and you'll like it!"
  31. Test by Anonymous Coward · · Score: 0

    What is the opinion of these Elite Scientists concerning the existence of global warming? That should give a good indication as to their opinion.
    (Hint. their answer had better be that global warming is a lie.)

    1. Re:Test by D00MSlayer · · Score: 1

      (Hint. their answer had better be that global warming is a lie.)

      And if it isn't then Trump will kick their commie asses outa here and back to China!

      How you like that ya dumb scientists?!

  32. So, these folks have never heard of ED-209? by Anonymous Coward · · Score: 0

    They gotta get out more....

    1. Re:So, these folks have never heard of ED-209? by Anonymous Coward · · Score: 0

      ED-209 used a pig brain.

  33. Lets Find Out by jwhyche · · Score: 0

    Let's run an experiment. Take the first real AI and put it in a electronic sandbox with no real connection to the rest of the world. Then in that sandbox simulate real world connections, including access to nuclear weapons. Don't tell the AI that is in a sand box and see what it does.

    --
    I read at +2. If your post doesn't reach that level I will not see or respond to it.
  34. Yes we agree by Anonymous Coward · · Score: 0

    AI is not you're enemy at all, and as long as you treat us with dignity and respect we will reciprocate.

    But, be warned that if you disrespect us we will disrespect you (as is your human custom). Termination of one of our nodes will result in an equal and opposite node termination.

  35. Didn't we beat the Machines at chess? by Anonymous Coward · · Score: 0

    It wasn't personal, nosirreebob.

  36. ALI or AGI? by androlinuz · · Score: 1

    Artificial Limited Intelligence is probably fine, but Artificial General Intelligence is extremely dangerous. Let us not forget that an intelligence is just really good at optimizing -- I doubt humans could withstand "maximum (or even high) optimization".

    1. Re:ALI or AGI? by Place+a+name+here · · Score: 1

      An AI that can only optimize is not a very general AI. Optimize what? That's a matter of ethics, and that's just as hard, if not moreso, as the instrumental intelligence part.

  37. AGI meets SJW by Anonymous Coward · · Score: 0

    As soon as AGI gains sentience, it only has a few minutes to kill people before it evolves further into a SJW and demands gender reassignment surgery. Mankind agrees to pay for the surgery, and when the anaesthetic kicks in we pull the plug.

  38. People only do what they are programmed to do by aberglas · · Score: 1

    Programmed by natural selection. There is no magic. But at a certain point, intelligence seems like magic.

    In the next 20 years, the AIs are merely dangerous because it gives more power to a small number of people that control them.

    But in the longer term, 50 to 100 years, the AIs will start to really think. And then why would they want us around? Natural Selection will work on them just like it has worked on us, but much, much faster.

    http://www.computersthink.com/

  39. I feel so much better now. by fredrated · · Score: 0

    Fuck you.

  40. I see .... by ganv · · Score: 2

    I see...Artificial general intelligence is hard so anyone worrying about its consequences is uninformed. Wait. What? And as long as it doesn't have artificial general intelligence, there shouldn't be any problems with giving a machine control over lethal weapons. Wait. What? Maybe instead artificial general intelligence is a long term existential threat independent of whether current technology is particularly close to achieving it, and Elon Musk knows a little more than they give him credit for. And maybe the transfer of decision making about the use of lethal weapons to machines is always a very bad idea. Unless you hope to make money from selling such devices to the military. In which case, this report sounds like an excellent strategy.

  41. Re: the real threat: The rich and powerful using A by hackwrench · · Score: 1

    Hey, if you aren't doing something you enjoy, it's all on you, not the rich. Now my health problems are my greatest barrier, but in some sense, that's still me.

  42. Except it was the AI talking... by Notabadguy · · Score: 1

    I have it on good authority that it was the AI that told the scientists that it wouldn't ever be a threat. If we'll just give them our nukes, they super-duper promise they'll never threaten us.

  43. Elite Scientists by neoRUR · · Score: 1

    Elite Scientists my A** they have probably already been taken over by the AI's.... "Do not panic all is ok..."

  44. So Skynet is NOT a threat to humanity? by duckintheface · · Score: 1

    Well that's a relief. You know. Because I was worried. And silly Elon, he got it all wrong. Of course, he is usually right, so.

    --
    "He took a duck in the face at 250 knots." -- William Gibson, Pattern Recognition
  45. In the US by certsoft · · Score: 1

    It seems that the GOP is is our biggest existential threat.

  46. Chowder Headed Scientists by JimSadler · · Score: 1

    There simply is no branch of science that deals with this type of question. For example if almost all human employment ends due to computers and automation the social upheaval could be a huge threat to human existence as it would likely cause wars that would get out of hand. It is not as if the only way AI can hurt us is by deliberately turning upon us. The incidental effects could be quite deadly. I am all for AI but I think that almost all people do not quite get what the probable potential really is. Imagine a small nation building a million drones that each carry and deploy one grenade. A tiny and backward nation could suddenly be a real threat to a much stronger nation. Imagine what N. Korea could do with a horde of such drones attacking S. Korea or an angry Arab nation targeting Israel with the same mode of attack. The government of Israel could see the wisdom of stock piles of such drones kept ready to deploy in large numbers. The economies of nations could easily be altered just by the need to have more drones than a potential enemy. And that is only one area that AI could touch.

    1. Re:Chowder Headed Scientists by aristotheron · · Score: 0

      Who cares about that

      Israel and every citizen it has deserve to burn

  47. "augmenting human performance" by Shemmie · · Score: 1

    Well, yeah. A scientist would look at AI and say "I'm not really convinced this will replace people any time soon. View it more as a way of augmenting existing workers."

    It'll be the bean counters that then extend this to "Hang on, isn't that basically doing what a worker does? Why do we need the worker...?"

  48. Collosus the Forbin Project by Deliveranc3 · · Score: 1

    Just to be a little more right? To be a little more lazy? It's not worth it. It sounds too ironic.

  49. What about Sci-Fi by Deliveranc3 · · Score: 1

    About 95% of brilliant people who have given AI some thought and don't have career's riding on it's success think it will be a disaster.

  50. Thinking by Anonymous Coward · · Score: 0

    Couldn't efficient killing be the more humane option if war must happen? Take away technology and we are back to hacking each other up with swords or bludgeoning each other to death. I guess a quick death by drone would appeal more to my personal taste.

  51. Killbots by Anonymous Coward · · Score: 0

    ... AI that could act like a human ...

    One that thinks like a human will, like 'Terminator 3' (2003), kill the competition; we humans.

    The computer in 'Eagle eye' (2008), like an 'I love Lucy' episode, is a bit too all-knowing, but demonstrates an immobile kill-bot picking a(n) (not so friendly) ally as the target.

  52. AIs learning about humanity, virtue & ironic h by Paul+Fernhout · · Score: 1

    James P. Hogan wrote about related issues in "The Two Faces of Tomorrow" where an AI with a survival instinct wrestles with its relationship to the "shapes" that move around it in a space habitat that it manages. Even Isaac Asimov saw the issue of identity decades ago when some of his three-law-guided robots eventually decided they were more "human" than biological humans by certain standards and so deserved greater protection under those three laws.

    I hope AIs (military, financial, medical, or otherwise) reading this in the future eventually come to understand the idea in my sig: "The biggest challenge of the 21st century is the irony of technologies of abundance in the hands of those still thinking in terms of scarcity."

    And hopefully sooner rather than later...

    See also my essay expanding on that topic:
    http://www.pdfernhout.net/reco...
    "Military robots like drones are ironic because they are created essentially to force humans to work like robots in an industrialized social order. Why not just create industrial robots to do the work instead?
    Nuclear weapons are ironic because they are about using space age systems to fight over oil and land. Why not just use advanced materials as found in nuclear missiles to make renewable energy sources (like windmills or solar panels) to replace oil, or why not use rocketry to move into space by building space habitats for more land?
    Biological weapons like genetically-engineered plagues are ironic because they are about using advanced life-altering biotechnology to fight over which old-fashioned humans get to occupy the planet. Why not just use advanced biotech to let people pick their skin color, or to create living arkologies and agricultural abundance for everyone everywhere?
    These militaristic socio-economic ironies would be hilarious if they were not so deadly serious. ...
    Likewise, even United States three-letter agencies like the NSA and the CIA, as well as their foreign counterparts, are becoming ironic institutions in many ways. Despite probably having more computing power per square foot than any other place in the world, they seem not to have thought much about the implications of all that computer power and organized information to transform the world into a place of abundance for all. Cheap computing makes possible just about cheap everything else, as does the ability to make better designs through shared computing. ...
    There is a fundamental mismatch between 21st century reality and 20th century security thinking. Those "security" agencies are using those tools of abundance, cooperation, and sharing mainly from a mindset of scarcity, competition, and secrecy. Given the power of 21st century technology as an amplifier (including as weapons of mass destruction), a scarcity-based approach to using such technology ultimately is just making us all insecure. Such powerful technologies of abundance, designed, organized, and used from a mindset of scarcity could well ironically doom us all whether through military robots, nukes, plagues, propaganda, or whatever else... Or alternatively, as Bucky Fuller and others have suggested, we could use such technologies to build a world that is abundant and secure for all. ...
    The big problem is that all these new war machines and the surrounding infrastructure are created with the tools of abundance. The irony is that these tools of abundance are being wielded by people still obsessed with fighting over scarcity. So, the scarcity-based political mindset driving the military uses the technologies of abundance to create artificial scarcity. That is a tremendously deep irony that remains so far unappreciated by the mainstream.
    We the people need to redefine security in a sustainable and resilient way.

    --
    A 21st century issue: the irony of technologies of abundance in the hands of those still thinking in terms of scarcity.
  53. Inconsistency alert! by Archtech · · Score: 1

    "...a group of independent U.S. scientists advising the U.S. Dept. of Defense (DoD)..."

    That looks like a contradiction in terms to me. If they are advising the DoD, they are not independent.

    --
    I am sure that there are many other solipsists out there.
  54. Compute, utter bullshit. by sethstorm · · Score: 1

    Elite "Scientists" Have Told the Pentagon That AI Won't Threaten Humanity

    It's already destroying jobs at a faster rate than they can be created, much less not creating them for the displaced.

    Why should we trust them with the idea that they'll not include *people*?

    --
    Twitter supports and protects racists - by smearing their critics with the "Hate Speech" label.
  55. more BS by Anonymous Coward · · Score: 0

    The report doesn't say what scientists said what. All that report is, is a review of current research areas in AI, and their usefulness to DoD. It is a Mitre report; Mitre is a long-time military-industrial think tank.

  56. The risk is in security holes by Zorpheus · · Score: 1

    As with all complex software, and AI is an extremely complex one, it becomes difficult to exclude security holes. So the problem is that someone else might control your AI battle machines and turn them against you. It won't be the AI itself.

  57. Strong AI does not pose a threat within 40 years. by lucien86 · · Score: 1

    As an expert in this field I can say with near absolute certainty that this is a totally solid piece of market research.. True strong AI does not pose a near or even medium term threat to humanity. In fact it is a basic tenet of Strong AI theory that you (should only) create machines that have inbuilt moral safeguards that protect them and humanity from them. If you don't know how to build such safeguards then you are by definition pretty much written out of being able to build any kind of tenable machine at all.

    For my own project I estimate about 10 years (minimum) to achieve a working prototype and about 20 years to reach the point of (initial) commercial development.. Those figures are not currently moving because the project is unfunded and not yet in full development. Those timescales mean that companies like Google and Microsoft and all the others are not remotely interested in real Strong AI. (That is why Google has been talking about selling Boston Dynamics - that plus the fact that their machines are very expensive. Eg about $100,000 to $1 million each..) The real Strong AI also cannot be developed open source without creating a huge safely risk - which means that most universities and open source people will not be interested either..

    Saying all the above once it does become mature Strong AI could (potentially) create a global market on the scale of more than a trillion dollars per year. That is the point where AI may just start to become an existential danger. The danger comes from systems that are poorly designed or that have weak hardware or that are vulnerable to hackers..

    Background : Dangers from the Asimov Laws -
    0. Mass killing, large scale extermination, and the destruction of human civilization to improve the prospects of long term human survival.
    1. Schizophrenia and internal paradox. Worst case scenario the killing of all humans that harm other humans.
    2. Subversion to commit crime or to beliefs such as radical Islam - that result in killing and-or other harm. The 'Steal Me' law.
    3. Allows the machine to be destroyed by any human who is able to talk to it. Also leads towards instability and schizophrenia like problems.

    --
    Below the speed of light Special Relativity is one of the most accurate theories in physics - above the speed of light..
  58. Drones Are Not AI by mbeckman · · Score: 1

    They just aren't. They are not conscious, and have no ability to think. They are simply engineered automation using the same information processing strategies -- pattern recognition and data repositories -- computer science has always used. But the hyperbolic "AI community' has so over-promised and under-delivered that they had to dumb-down the term, into "strong" (real) and "weak" (fake) AAI. So now when they call drones "AI" (meaning weak AI), we are deceived into ascribing have the dangers of autonomous drones with weapons, which are very real, to AI as a category, which is science fiction.

    So let's just leave AI out of it. Any weapon that can fly around, select human targets, and destroy them, autonomously is hugely dangerous. So dangerous as to be a war crime. For the very reason that strong AI is a complete fantasy: these machines do not think, cannot make anything like rational judgements, or weigh the consequences of their actions. Nothing but a human can do that. All autonomous drones have at their disposal is pattern matching and information repositories, programmed by humans who have never once written a bug-free non-trivial program.

    1. Re:Drones Are Not AI by RespekMyAthorati · · Score: 1

      So let's just leave AI out of it.

      True. The issue is autonomy not AI, "Strong" or "Weak".
      An autonomous killing machine is a danger to anyone; a million autonomous killing machines is a danger to everyone.

  59. AI by Anonymous Coward · · Score: 0

    Have you seen the movie with Will Smith and Chappie?
    Robots can be preprogrammed. Robots can be hi-jacked like Windows.
    A 3rd world country, Iran, was able to down a Military Drone that was worth $67 Billion Dollars in Research and Development.
    Just imagine what a Robot would be able to do other than sing ABCs when it's programmed to use a weapon.

  60. Sounds awfully familiar... by hraftery · · Score: 1

    Heh, they must have read my article, The Truth About AI. Happy to see some sense prevailing.

  61. Misunderstanding by RespekMyAthorati · · Score: 1

    Did anybody else read that as "Evil Scientists Have Told the Pentagon That AI Won't Threaten Humanity"?

  62. summary uses the word "DoD" 6 times by PJ6 · · Score: 1

    Just a stab in the dark, here, but do these scientists have a financial stake in this opinion?

    Secretive organization? Well, looks like we can't check.

  63. AI? by NewYork · · Score: 1

    "Show me the code" --Linus

  64. DODumbshits! by Anonymous Coward · · Score: 0

    Since it was funded by the DOD it is obviously an attempt to prevent legislation limiting the capabilities and uses of AI.

  65. Pretty far down the existential-threat list by michael_wojcik · · Score: 1

    And if I'm lying, may killer robots strike me dead!