Slashdot Mirror


The AI Anxiety (washingtonpost.com)

An anonymous reader writes: The Washington Post has an article about current and near-future AI research while managing to keep a level head about it: "The machines are not on the verge of taking over. This is a topic rife with speculation and perhaps a whiff of hysteria." Every so often, we hear seemingly dire warnings from people like Stephen Hawking and Elon Musk about the dangers of unchecked AI research. But actual experts continue to dismiss such worries as premature — and not just slightly premature. The article suggests our concerns might be better focused in a different direction: "Anyone looking for something to worry about in the near future might want to consider the opposite of superintelligence: superstupidity. In our increasingly technological society, we rely on complex systems that are vulnerable to failure in complex and unpredictable ways. Deepwater oil wells can blow out and take months to be resealed. Nuclear power reactors can melt down. Rockets can explode. How might intelligent machines fail — and how catastrophic might those failures be?"

14 of 207 comments (clear)

  1. What about human-intelligence anxiety by Anonymous Coward · · Score: 5, Insightful

    It's politically incorrect to say this, but most humans are not intelligent. Their behavior follows predictable patterns. Their intellectual life is next to naught.

    If you are not intelligent, you are expendable and fungible like any other industry-raised sheep. Born out of industrial breeding, fed with a formula, and led straight to the slaughterhouse. It doesn't take an evil super AI to beat you. You are already beaten by the mechanism that is called the System.

    Be intelligent.

    1. Re:What about human-intelligence anxiety by Bengie · · Score: 3, Insightful

      90% of what we do is sub-conscious and our prefrontal cortexes will make up a rational story for what we do.

      That only applies when you blindly do what you feel like. When I reflect on what I have done, if I did something I didn't like, I analyze why I did something. Once I've locked down on the rational, I can change it, and I won't do it again next time. I used to be easily agitated, but the only thing more annoying that someone bothering me is letting myself be bothered by someone. Once I figure out why something or someone bothers me, I can make the issue not bother me.

      The first time I observe a given annoyance, I seemingly have little control over it, it's only once I've reflected on it that I can control myself. An example of this is when I was younger, the sound of a crying baby drove me up the wall. After getting flustered many times, I thought about why I felt that way. I eventually realized that it's because I had no control over them crying, but I wanted to help them to make them stop, but many times trying to help was futile. Once I realized that it was my failing attempts that bothered me and not so much the crying, the next day I was suddenly unbothered by children crying. Assuming it's not a hunger or pain cry.

      90% of what I do may be my subconscious, but I can control my subconscious, just not in real-time. I need time to reflect and a sleep-cycle.

    2. Re:What about human-intelligence anxiety by ShanghaiBill · · Score: 4, Funny

      It's politically incorrect to say this, but most humans are not intelligent.

      But you are one of the rare smart ones, right?

      https://xkcd.com/610/

  2. Windows and Siri by tverbeek · · Score: 5, Funny

    Anyone worrying about computers outsmarting us and taking over in the near future has insufficient experience with both Windows and Siri.

    --
    http://alternatives.rzero.com/
  3. I'm worried about AI by rsilvergun · · Score: 3, Insightful

    making most jobs obsolete. That's something that could happen in the near term. Since almost every country bases it's quality of life on the jobs it hands out that doesn't bode well for me, a member of the working class.

    --
    Hi! I make Firefox Plug-ins. Check 'em out @ https://addons.mozilla.org/en-US/firefox/addon/youtube-mp3-podcaster/
  4. Re:documentary about superstupidity by Tablizer · · Score: 3, Informative

    There's an "automation-related" saying that dates back to at least the 70's:

    "To err is human; to really foul things up you need a computer."

  5. We are being ruled already, without AI by wcrowe · · Score: 4, Insightful

    The machines have already taken over, even without AI. This is because everyone instantly believes what a machine tells them, no matter what. Look at people who have had their identity stolen. A machine says they took out a loan here, and a loan there. Now the creditor is demanding payment. The victim can't convince the creditor that they did not take out the loan because the machine says they did, and the machine is never wrong. Despite the fact that there is no physical evidence that any loan was ever granted to the victim, the machine is believed over the human. No one ever questions how the data got into the machine. No one ever assumes that any mistake was made at any time. Whatever the machine says is assumed to be the truth.

    Recently, a friend related this story. He was at a checkout line at Target, and had purchased about $60 worth of items. He handed the clerk a $100 bill. The clerk mistakenly keyed in an extra zero, and the machine dutifully informed the clerk to make change of about $940. The clerk, without hesitation, started to do this and my friend had to stop her and explain her mistake. The clerk couldn't understand. They eventually had to call a manager over to explain the problem. This girl was prepared to do whatever the machine told her, despite the fact that it didn't make any sense.

    We don't need AI for the machines to rule over us.

    --
    Proverbs 21:19
  6. Re:The usual media spin by ranton · · Score: 4, Insightful

    We are at least 50 years off from strong AI as in human level common sense about the world.

    The focus on dangers of creating strong AI is the worst part of current AI hysteria. Strong AI will most likely come decades or even centuries after modern day AI has massively reshaped our workforce and society in general.

    The AI we should be worried about include self driving cars, natural language processing, pattern recognition, and robotics. These technologies could combine to make a majority of humans unemployable. The don't do this by making humans unnecessary. They do it by making certain humans so productive that average people have no economic value. It is AI's ability to empower the most educated in our society that is the greatest "problem".

    This could either lead to a utopian world if we can enact a form of basic income for everyone, or a very distopian world if we allow income inequality to grow unchecked. Unlike strong AI which most researchers agree has a very low chance of occurring soon, the AI systems I am referring to are almost guaranteed to massively disrupt our economy in the next few decades.

    --
    -- All that is necessary for the triumph of evil is that good men do nothing. -- Edmund Burke
  7. Re:don't prevent intelligence because of fear.. by mark-t · · Score: 4, Interesting

    Being free willed does not mean that one cannot or will not necessarily ever make so-called "decisions" that can be predicted from a knowledge of the state, it only means that one is *capable* of it. However, how is the behavior of a system where one is not capable of it any different than one where the state itself is unknowable? You can apply a variation of the halting problem to establish with certainty that either the universe is not deterministic, or else it impossible within its framework to contrive a test that incontrovertibly proves that it is so.

    e.g. If I could know what decisions you were making (a notion that is at least theoretically possible, if the universe were truly deterministic), I could analyze it and predict the answer you would give to a particular question, even if I told you truthfully what the answer to that question were going to be.... however, with your so-called illusion of free will, you could utilize the information that I gave you in the present about your alleged future action, and then deliberately contradict it, invalidating the prediction that I made, meaning that my knowledge about the future state was incorrect, which leads one inescapably to the conclusion that even if the universe is deterministic, it is impossible to know it.

    And it is noteworthy that by outward present appearances, we appear to have free will with regards to decisions that we make.

    So if, by all the standards that can ever be measured, you appear to be a "free-willed" person, then how is your behavior any different than if you actually *were* a free-willed individual? And if your behavior is identical to as if you actually were a so-called "free-willed" being, what purpose does suggesting that you are not free willed even mean?

    Plus of course, one cannot advocate the notion that we are not free willed without also suggesting that we abdicate the notion of personal responsibility... but that's a philosophical debate for another time.

  8. Already happened a few times. Famine to Netflix by raymorris · · Score: 4, Interesting

    > making most jobs obsolete.

    That's already happened a few times. At one time, most people worked in agriculture- mankind spent most of our time feeding ourselves. An "economic downturn ", therefore, was when a lot of people starved to death.

    After machines such as plows and later GPS-guided combines with largely automated food processing plants did most of the work of producing food, inexpensive food was therefore readily available and humans had time to do things not strictly necessary for survival, like education, producing consumer goods, writing and printing books, comfortable clothes, and creating washing machines and dishwashers. With the efficiency of machines, consumer goods including books, and conveniences like washing machines and refrigerators became readily available to the masses.

    No longer scrubbing our clothes on a washboard, we then had time to make and play video games.

    The replacement of human labor with machines has been a continuous process for over a thousand years, peaking about 200 years ago. In the process, our standard of living has gone from digging for anything we could eat in the winter to stopping by Walmart to select which of the 160 different fruit and vegetable varieties we want to munch on while we enjoy our Netflix movie.

    1. Re:Already happened a few times. Famine to Netflix by ranton · · Score: 4, Interesting

      That's already happened a few times [...] The replacement of human labor with machines has been a continuous process for over a thousand years, peaking about 200 years ago.

      There are at least two things that are likely to make this time different (obviously no one knows for sure)

      This change in the workforce will be much faster than previous ones. We are already starting to see this happen now, and in my opinion it is almost the sole reason the middle class is shrinking in the US (when not accompanied by market forces agnostic income redistribution that is). The loss of agricultural jobs happened gradually over more than a 50 year period. Other labor shifts in the industrial revolution happened even slower than that. Advanced in AI (even ignoring Strong AI) have the opportunity to disrupt industries in under 10 years. The two situations are hardly comparable.

      Previous changes in the workforce involved removing manual labor jobs. This disrupted the economy for two species that relied on these jobs: humans and horses. Humans had the cognitive ability to find new jobs to do, while horses were almost completely removed from our economy. The intelligence difference between humans and horses is very drastic and obvious. The difference in capability between the top 20% of our workforce and the bottom 80% is tiny by comparison, but still real.

      The danger is not AI becoming smarter than 80% of humans. The danger is AI empowering the top 20% enough that the bottom 80% no longer have economic value. No one knows what the actual percentages of haves and have nots will be, but considering the top 10% of earners today make 50% of the income I am guessing the percentage of people who gain from an AI-enhanced economy will be very small (sub-10%).

      Perhaps this will not happen, but it is certainly a likely scenario. Saying it will never happen just because society weathered the industrial revolution well is intellectually lazy.

      --
      -- All that is necessary for the triumph of evil is that good men do nothing. -- Edmund Burke
  9. If humans have free will by jd · · Score: 3, Interesting

    Then so do subatomic particles. You don't need AI if that's all you want. If subatomic particles do not have free will, then neither do humans. This second option allows physics to be Turing Complete and is much more agreeable.

    If computers develop sufficient power for intelligence to be an emergent phenomenon, they are sufficiently powerful to be linked by brain interface for the combination to also have intelligence as an emergent phenomenon. The old you would cease to exist, but that's just as true every time a neuron is generated or dies. "You" are a highly transient virtual phenomenon. A sense of continuity exists only because you have memories and yet no frame of reference outside your current self.

    (It's why countries with inadequate mental health care have suspiciously low rates of diagnosis. Self-assessment is impossible as you, relative to you, will always fit your concept of normal.)

    I'm much less concerned by strong AI than by weak AI. This is the sort used to gamble on the stock markets, analyse signal intelligence, etc. In other words, this is the sort that frequently gets things wrong and adjusts itself to make things worse. Weak AI is cheap, easy, incapable of sanity checking, incapable of detecting fallacies and incapable of distinguishing correlation and causation.

    Weather forecasts are not particularly precise or accurate, but they've got a success rate that far outstrips that of Weak AI. This is because weather forecasts involve running hundreds of millions of scenarios that fit known data across vast numbers of differing models, then looking for stuff that's highly resistant to change, that will probably happen no matter what, and what on average happens alongside it. These are then filtered further by human meteorologists (some solutions just aren't going to happen). This is an incredibly processed, analytical, approach. The correctness is adequate, but nobody would bet the bank on high precision.

    The automated trading computers have a single model, a single set of data, no human filtering and no scrutiny. Because of the way derivatives trading works, they can gamble far more money than they actually have. In 2007, such computers were gambling an estimated ten times the net worth of the planet by borrowing against predicted future earnings of other bets, many of which themselves were paid for by borrowing against other predicted future earnings.

    These are the machines that effectively run the globe and their typical accuracy level is around 30%. Better than many politicians, agreed, but not really adequate if you want a robust, fault-tolerant society. These machines have nearly obliterated global society on at least two occasions and, if given enough attempts, will eventually succeed.

    These you should worry about.

    The whole brain simulator? Not so much. Humans have advantages over computers, just as computers have advantages over machines. You'll see hybridization and/or format conversion, but you won't see the sci-fi horror of computers seeing people as pets (think that was an Asimov short story), threats counter to programming (Colossus, 2010's interpretation of 2001, or similar) or vermin to be exterminated (The Matrix' Agent Smith).

    The modern human brain has less capacity than the Neanderthal brain, overall and in many of the senses in particular. You can physically enlarge parts of your brain, up to about 20%, through highly intensive learning, but there's only so much space and only so much inter-regional bandwidth. This means that no human can ever achieve their potential, only a small portion of it. Even with smart drugs. There are senses that have atrophied to the point that they can never be trained or developed beyond an incredibly primitive level. Even if that could be fixed with genetic engineering, there's still neither space nor bandwidth to support it.

    --
    It's a small world and it smells funny; I'd buy another if it wasn't for the money; Take back what I paid (SoM)
  10. Re:We know about superstupidity from seeingWashing by matbury · · Score: 4, Informative

    > "Anyone looking for something to worry about in the near future might want to consider the opposite of superintelligence: superstupidity"

    At least we know what superstupidity looks like and what it does, based on observing Washington, DC. One lesson is to minimize the control and possible impact from failures of these complex but inherently stupid systems. See, for example the office of the vice president - a VP might say some stupid things, but it doesn't really do too much damage.

    The new crop of candidates provide another lesson in superstupidity. They aren't exactly a bunch of brain surgeons either.

    Congress-critters ain't stoopid, they're pretty smart. They understand what they need to do to get elected and stay in office. Unfortunately, that rarely means serving the best interests of the majority of the electorate... or even reading, let alone understanding, the legislature they put forward on behalf of their corporate sponsors.

  11. Re:The usual media spin by ranton · · Score: 3, Insightful

    You mean some sort of theoretical future problem means we have to drop everything, abandon our successful economy, and adopt socialism IMMEDIATELY, without any debate? Yeah, sure.

    I said nothing of the sort. First off, every country including the United States have socialist programs. In the United States these include social security, Medicare, police and fire departments, postal service, and many others. Most of the solutions for the almost certain economic changes brought on my improved AI will include socialist programs, such as the basic income I mentioned. They will not include abandoning our successful economy, just like enacting a minimum wage, 40 hour work weeks, or social security did not require abandoning our economy. They will simply add more protections for those who are left behind during rapid economic changes.

    Just a quick quiz: do you know what socialism thinks about people who don't work?

    Yes, it doesn't have a single opinion on the matter. There is no single set of economic rules that define socialism. Each country that has enacted socialist programs, including the United States, define the goals of these programs uniquely.

    Those who don't work won't eat, either. Socialism is about work, not lazy idlers. You don't believe me, I know, so here's an informative quote from someone who knows socialism much better than you do.

    George Bernard Shaw does not speak for everyone who desires for more socialist programs worldwide. He is merely a playwright who had very poor opinions of the uneducated and poor. Anyone with such dogmatic and unforgiving opinions knows far less about how socialism can actually be used to benefit society than most people. He was a hateful bigot and elitist, nothing more. If I gathered quotes of capitalists in the 1800's advocating slavery would that somehow show that capitalism is hopelessly flawed?

    --
    -- All that is necessary for the triumph of evil is that good men do nothing. -- Edmund Burke