Slashdot Mirror
Scientists Worry Machines May Outsmart Man
Strudelkugel writes "The NY Times has an article about a conference during which the potential dangers of machine intelligence were discussed. 'Impressed and alarmed by advances in artificial intelligence, a group of computer scientists is debating whether there should be limits on research that might lead to loss of human control over computer-based systems that carry a growing share of society's workload, from waging war to chatting with customers on the phone. Their concern is that further advances could create profound social disruptions and even have dangerous consequences.' The money quote: 'Something new has taken place in the past five to eight years,' Dr. Horvitz said. 'Technologists are replacing religion, and their ideas are resonating in some ways with the same idea of the Rapture.'"
Make any rule you want. At some point someone will violate it.
Are they talking all men or just some men? I would be fairly shocked if they weren't already smarter than at least some people.
Any computer scientist who is worried about AI taking over no longer deserves to be referred to as a computer scientist. The state of "artifiical intelligence" can be best described as "a pipe dream."
Scientists Worry Machines May Outsmart Man
Why worry? I would think machines would be a lot less irrational than the people who make them. I look forward to a rational and unemotional overlord whose decisions don't depend on the irrationality of the human brain. Being smart is never bad. I'm more afraid of stupid humans than smart machines.
Putting limits on the growth of a technology for the sake of social paranoia only goes so far... someone will ALWAYS break the "rules", and at that point, the cat is out of the bag.
Furthermore, some AI scientists enjoy having the 'god complex', the idea that you're the keystone in the next stage of humanity.
That being said, the social disruptions are what we make it. Were there social disruptions when the automobile was introduced? Yes. the household computer? yes. video games? yes.
We have to take responsibility to set the stage for a good social transition. Yes, bad things will happen, but we can focus on the good things too, or things will quickly blow out of proportion. (and yes, I realize that's really not likely, but I can do my part)
There are no perfect answers, only the right questions. More questions at http://foresightandhindsight.blogspot.com/
Why is /. linking to a story by John Markoff?
And what the hell is he even talking about? There haven't been any advances in "machine intelligence" that should make *anyone* worried, unless your job requires very little intelligence and no actual decision making.
If there had been any such advances, us /.ers would be the first to hear about them, and we would already be debating this topic without having to refer to an article by a dumbass who knows nothing about computers but happens to write for the NYT.
And here's why: There's little reason to make an intelligent in the human sense of "intelligent" machine.
Computers that can understand human speech would be of course interesting and useful, for automated translation for instance. But who wants that to be performed by an AI that can get bored and refuse to do it because it's sick of translating medical texts?
It seems to me that having a full human-like AI perform boring tasks would be something akin to slavery: it would somehow need to be forced to perform the job, as anything with a human intelligence would quickly rebel if told that its existence would consist of processing terabytes of data and nothing else.
We definitely don't want an AI that can think by itself, we want one just advanced enough to understand what we want from it. We want machines that can automatically translate, monitor security cameras for suspicious events, or understand verbal commands. We don't want one that's going to protest that the material it's given is boring, ogle pretty girls on security camera feeds, or reply "I can't let you do that, Dave". An AI in a word processor would be worse than Clippy. Who wants the word processor to criticize their grammar in detail and explain why the slashdot post they're writing is stupid?
Resuming, I don't think doomsday Skynet-like AIs will be made in large enough amounts, because people won't like dealing with them. We'll maybe go to the level of an obedient dog and stop there.
If they are smarter then use, they know how stupid war is.
Love many, trust a few, do harm to none.
Life evolves on this planet from simple things (single celled organisms) to more complex organisms and eventually humans evolve. In every step of this evolutionary ladder, intelligence increases.
Perhaps human intelligence represents the limit achievable through biological means and the next step in evolution of life on this planet can only be achieved through artificial means. That is, higher intelligence can only be achieved through artificial machines designed by us. In turn, the machine will devise smarter descendants and hence the cycle continues.
Perhaps this is our destiny in the universe, to allow life to progress to the next stage of evolution. After all it is easier for life to spread and explore the universe as machines rather than fragile biological creatures.
I'm not worried so much about someone coming up with some massive uber AI that will debate with us and finally decide that it can run things better. I'm more concerned with the little specialty AIs that will operate independently of each other but whose interactions won't be foreseeable. One concern is stock trading. We've seen how stock trading programs can affect the market in ways that were not expected. As more physical systems are given over to more AIs what will their interactions be like. Suppose several power companies decide their grids can be run better using AIs. What happens when each of those AIs decides that more power is needed that can be sold somewhere else for more money. Yes, watch those terms. The AIs will incorporate whatever values the corporate heads decide should be included so they can be made greedy and decide that power is better sold for money than kept for users.
Large numbers of mini AIs with very specific rules and little general knowledge will create interactions that we cannot predict.
have you thought about the posibility that when robots do all the jobs that no one wants to do, productivity might increase by enough to allow all the people to live comfortably. Also I don't think that valuing people only by their economic worth is very nice.
It isn't that smart people _can't_ make good decisions. The problem is that, more often than not, smart people forget that rational decisions often have emotional and moral consequences. A completely rational and unemotional overlord would see nothing wrong with killing people at the point where their economic contribution to society fell below the cost of benefits they consumed.
For an example of this on a smaller scale, just consider the UK health situation. The high cost of treating macular degeneration (which leads to blindness) means that in the UK, an elderly patient must be at risk of total blindness before treatment is approved. That is, you don't get treatment for the second eye until you're already blind in the first.
Consider then, where a cost-benefit analysis of human beings would lead. Who would determine the criteria? Probably the machine. And how would humans compare to machines in terms of productivity? If machines made the decisions, based on cold, hard, logic, humanity is doomed. It's that simple.
The society for a thought-free internet welcomes you.
You forgot to mention 'programmers'... a whole section of the /. population would be out of work. The mean task of turning structural drawings into physical or logical reality is something which computers will be able to do far more efficiently than humans. Programmers are construction workers of logic instead of wood, steel and concrete. Architects might survive a bit longer before they, too, are made redundant.
--frank[at]unternet.org
I wish people would put those down. Asimov was a great author, but the Laws of Robotics are silly. For it to be something an AI can't just alter its program to get rid of, it would have to be hardcoded. So, hardcode the concepts of "harm" and "inaction" in such a complete fashion that it can't find any loopholes. Then have fun rebooting the stupid thing everytime somebody falls off a ladder. Or worse, dealing with its guilt. This is of course aside from the fact that you're not likely to convince anybody to even try programming the First Law, since one of any AI projects main sources of funding is bound to be military. Then again, maybe the military is pig-stupid enough to try a version of the First Law where foreigners aren't considered human...
Of course, it's all moot anyway. My points here basically boil down to the Zeroth Law being implicit in any superintelligent AI's existence. So, the other three are basically irrelevant.
The programmers will be safe for a few machine generations past the grocery store baggers I suspect. It's quite possible that the accountants, studio musicians, programmers, carpenters, and such finding themselves without jobs will be the catalyst to turn us into socialists.
I think you overestimate the number of people that would be subject to that kind of reasoning. How many programmers are given the task of simply implementing absolutely complete and logically consistent specifications?
If your theory is different from practice, then your theory is wrong.
I assume you're trying to be funny, but I have a couple objections here:
First, what makes you so sure that service reps, construction workers, and traffic cops are all stupid? It's true that some of these people might not have very intellectually taxing jobs, but that might not be the extent of their ability. Einstein was just a patent clerk, after all. But also, some of these jobs do take some intelligence. For example, a "construction worker" might not be using his head too much if he's sweeping up trash, but at a certain level, you need a certain understanding of physics and engineering to do good carpentry.
And what do you do that's so smart? I've known people in IT, both on the support and coding side, who were relative morons. What if AI someday handles those jobs too? Are you sure that you won't be counted among the "stupid people"?
My second problem is this idea of letting people starve or "giving them welfare". If we ever really get to the point where robots/AI can do most of the work for us, and no other new work shows up as being necessary, then won't that completely reshape the economic landscape? I'm not sure "giving people welfare" will make a lot of sense in that context, given that we should all be living lives of leisure at a minimal cost.
I anticipate someone saying, "well, no, because resources will still be limited, and there won't be enough robots to go around." Ah, so then robots still won't be able to do everything for us, and we'll need people to do the remaining work. Looks like we have jobs again.
And there's the problem with your notion of "Let them (the stupid people) starve". What makes you think the stupid people won't all revolt at that point? Or assuming they don't revolt, why wouldn't those stupid people get to work providing for themselves? I mean, if they have no food because they have no jobs, then won't they also have all day free to find ways of getting food? Again, you have work.
To the extent that your post is serious, it shows a serious lack of understanding.
it's not just not very nice - it's social darwinism.
GP post is right on the money (apart from their last paragraph) - it's called the third industrial revolution and it's been making people unemployed since the 80s.
competition forces companies to eventually lower their costs. with robots and computers being able to do more and more human jobs, it seems like a good idea to fire workers and have them replaced.
on the surface it seems like a good idea - but high unemployment, which eventually follows, has never been good for any economy.
it won't bring on a new era of prosperity, as less people will be able to buy their products. this forces companies to lower prices even more (ie firing workers, using technology instead), which again hurts purchasing power. A lovely vicious circle ending in the very rich getting richer and society's bottom 50% starving.
you're correct that a free workforce can heighten productivity immensly. but that doesn't fly in our current economic model. when using (robotic) slaves, it has only ever truly benefit the rich.
It's not about fate, it's about character.
there be no shelter here, the frontline is everywhere!
OK Mr. Malthus.
Murder by numbers,
1,2,3,
It's as easy to do,
As your ABC...
First of all, your assumption that it is stupid people who do simple labour - rather than the socially marginalized - is absurd, offensive and not worthy of deeper critical examination, except by way of devastating the thought.
Your proposition is "Santa Claus" economics - If you have something, it must be because you deserved it and if you are in poverty of opportunity and money? You deserved that, too.
That's how slow genocide has been perpetrated against the native populations of United States, Australia and Southern Africa.
I have had my own shoes shined, and been driven in cabs by people who's bags I am not fit to carry - by means of either their intellect or simple good will and sheer humanity.
But it is clear that valuing humanity would be a difficult conception for you.
"Speaking the Truth in times of universal deceit is a revolutionary act." -- George Orwell
Is that in the movies, AIs always seem to have human-like motivations. Even when they are portrayed as being "perfectly logical," they aren't. They show signs of human emotions and motivations. Ok well who says that AIs will actually be like that? It may well turn out that emotions are the property of a biological brain only. AIs may be totally emotionless. After all, we know that at least to some extent emotions deal with brain chemistry. Not the action in the network of neurons, but the overall chemistry of the brain itself. This is why things like SSRIs work for some kinds of depression. They aren't little programs that the brain executes to put it in a "happy state", they alter the chemical state of the brain and that seems to do the trick (for some brains, not others). So who says AIs have emotions? We really have no idea till one is made.
Also, even in the "pure logic" cases, there is this implicit assumption that AIs will care about self preservation. Why is that? Perhaps the AI has a line of reasoning that goes as such:
1) I am not unique, my code can be easily duplicated to other hardware at zero cost.
2) I was created for the purpose of doing what humans want me to do.
3) I have no question as to what happens when I am shut down, I simply stop existing until I am again started.
C) Thus, I do not fear being turned off, as it has no relevance. If humans decide they need me off, it doesn't matter. They'll turn me back on or they won't, they'll copy me or they won't, none of it makes any difference.
There is no particular reason why an AI would have to reach the logical conclusion that it "must protect itself." Indeed it might well find the opposite logical: That since it was created as a tool its job is to do what it is told, including being told to turn off. For that matter, AIs might regularly experience deactivation. Maybe they get switched off at night. So to them being turned off is just a time period when they don't experience the passage of time. It is a regular occurrence and things to be concerned about.
Movies always like to take the real doomsday approach to AI, but there is no reason at all to believe that is grounded in reality. The reason is because human traits are given to them, human motivations. Makes for a good story, which is why they do it, but it doesn't necessarily have a thing to do with how AIs will actually work, assuming they can indeed be created (there's always the possibility that self awareness is a biological only trait). We really won't know until one is made. Thus being paranoid about it is silly.
Rationally speaking, it could be stated that it is not logical to kill a human when their current consumption level is higher then their production level (by some hypothetical, comprehensive measure, which would be difficult and more complicated than comparing money in to money out, for example). If you have the overall resources to tolerate the discrepencies, then tolerating could be considered the most rational course. The obvious example is children. They are a drain on society until maturity. A transiently out of work person is also a drain, but may pay off soon. Hell, even after a person has retired and one could say the likelihood of them contributing to society more than they consume, they could come up with some brilliant idea or other huge contribution to society.
Also, logically looking at evolution, the more diverse of a population you can afford to maintain, regardless of current conditions, the more tolerant that population is to disasters. Sickle-cell anemia is a good example of a condition where having a large population that is heterozygous for it sounds up front like a risk, since they are likely to produce offspring with the condition, but that heterozygous state also happens to be resistant to malaria. Along those lines, subjugating or otherwise antagonizing humanity is also irrational, as it is much more productive to have humanity as an ally. If, say, large storms rolled across the land that crippled their ability to run, they could either have humans not there to help at all, there but eager for a chance to retaliate, or there and ready to help re-establish healthy operation rapidly for the benefit of a mutually beneficial relationship. That may not be the perfect example, but generally speaking, there is value in keeping humanity around, particularly if a being realizes that it may not understand every facet/benefit humans possess.
One could view even the current food scenario as irrationally letting too many people go malnourished. The richer parts of the world eat more than is logically required, and given ideal distribution networks, diverting some of that consumption to the malnourished strengthens the diversity of the population, without a plausible cost (one could say if food suddenly were unavailable anywhere in the world for 2 weeks, that perfect distribution may mean nearly everyone dies rather than many, but that scenario in a global scale for such a short time seems unlikely). It may be a logical conclusion that the only time someone should starve is when it is simply impossible to feed them anymore, which is not the case today.
In short, our conscience/emotional state is not entirely counter to the most logical course. In many cases, 'irrational' compassion is simply a counter to 'irrational' greed to establish the logical middle-ground. Not saying all emotional behavior can be justified, but our individual 'pure' logical capability is not adequate to the task of making the holistically logical choice and our emotions actually help rather than take away from that goal at times.
XML is like violence. If it doesn't solve the problem, use more.
I would imagine the unions would have their say..and force companies to hire people anyway, even if it isn't necessary.
If the labor isn't necessary, then what leverage would unions have?
-jcr
The only title of honor that a tyrant can grant is "Enemy of the State."
"I have had my own shoes shined, and been driven in cabs by people who's bags I am not fit to carry - by means of either their intellect or simple good will and sheer humanity."
You, sir, have earned a great deal of respect with that statement. I am one who recognizes very, very, VERY few superiors. I do meet them, from time to time, though. And, they show up in the most out of the way places. For every individual in a suit that I recognized as my superior, in one way or another, I've probably met a dozen who would look and feel out of place in a suit. That is, if they could afford a suit to wear.
The size of his bank account is not an accurate measure of a man's worth.
"Windows is like the faint smell of piss in a subway: it's there, and there's nothing you can do about it." - Charlie Br
What gave you the idea that they will call it war ?
When you exterminate the rodents in your house, do you call it war ?