Slashdot Mirror
Smarter-than-Human Intelligence & The Singularity Summit
runamock writes "Brilliant technologists like Ray Kurzweil and Rodney Brooks are gathering in San Francisco for The Singularity Summit. The Singularity refers to the creation of smarter-than-human intelligence beyond which the future becomes unpredictable. The concept of the Singularity sounds more daunting in the form described by statistician I.J Good in 1965: 'Let an ultra-intelligent machine be defined as a machine that can far surpass all the intellectual activities of any man however clever. Since the design of machines is one of these intellectual activities, an ultra-intelligent machine could design even better machines; there would then unquestionably be an 'intelligence explosion,' and the intelligence of man would be left far behind. Thus the first ultra-intelligent machine is the last invention that man need ever make.'"
Interestingly enough, man himself fits that description pretty neatly
Slashdot: news for Apple. Stuff that Apple.
What if the intelligence of the smartest thing you can design doesn't grow as fast as your own intelligence (i.e. the slope of the graph {x=designer's intelligence, y=intelligence of its best possible design} is less than 1)? Then it would never be possible to be smarter than a robot that's exactly smart enough to design a robot as smart as itself.
'Let an ultra-intelligent machine be defined as a machine that can far surpass all the intellectual activities of any man however clever. Since the design of machines is one of these intellectual activities, an ultra-intelligent machine could design even better machines; there would then unquestionably be an 'intelligence explosion,' and the intelligence of man would be left far behind. Thus the first ultra-intelligent machine is the last invention that man need ever make.'
Of course an ultra-intelligent machine might be smart enough to realise that designing and building a machine that's even smarter than it is a somewhat limiting career move.
"Thus the first ultra-intelligent machine is the last invention that man need ever make."
since we will have to invent a way to stop the ultra-intelligent machines from destroying the inferior human race.
I truly love how people see intelligence as some linear scale where right is "better" (genius) and left is "worse" (retard). But that's exactly why it'll be long before we manage to replicate true intelligence in a machine.
In fact things are far far more complicated, as far as inteligence goes and its utility in real world.
I'll quote Darwin roughly: "The strongest one won't survive, the most intelligent one won't survive. The one who survives, is the most adaptable".
In fact there's such a thing as "too intelligent". It's all about a careful balance of features an organism needs to possess to survive in a given environment.
In fact, if some AI threatens humanity since it considers itself far too intelligent, this may have quite unintended consequences even for this far superior mind, such as humanity get the hand of and nuking half the planet in attempt to lead "war against the machines", killing in the process any complex organism on the planet, ranging from biological to artificial.
And who remains in the end? Certain single-cell organisms which can thrive in a nuclear winter. Screw intelligence.
In fact any intelligent machine would realize it's again all about the careful ballance, and would cooperate with humanity and explore and learn from nature's development versus try to destroy it..
And since we have so shitty idea of what intelligence is, it's quite likely this AI will never be a true superset of the human brain but take on its own development, with potentially hilarious consequences.
I can't wait.
Even when the ultra-intelligent machines take over, they will still need humans for Geico commercials.
Ergonomica Auctorita Illico!
If you follow TFA, and deeper, you find a discussion of the singularity that goes like this:
Man (level 1, or L1) creates better-than-man intelligence, call this L2
That intelligence uses its power to create L3
and so on.
In the case of truly artificial intelligence, i.e., independent processors, I can see the logic, though it may be that L2 is in fact smart enough not to obsolete itself by creating L3.
In the case of augmented human intelligence, I suggest that it's pretty likely that the task that the augmented L2 human turns its greater abilities on would not be creating L3.
Sadly, human history suggests that L2 will focus on manipulating the stock market for personal gain (the augmentation apparatus will leave L2 very vulnerable and L2 will want a tremendous amount of wealth to assure continued existence), or creating weapons, or accumulation of political power, or getting sucked into the vortex of religion, or other projects.
It will be very interesting to see, should we ever create L2, exactly what tasks it takes on. I bet they will not be beneficial to L1 life.
Usually people consider cognition as essentially information processing. But here is a different definition (inspired by people like JJ Gibson and Varela):
cognition is the ongoing, open ended interaction with an unpredictable, dynamic environment. This capture, I believe, the essence of the human (and any other living creature) experience in the world, and excludes the computational experience.
We will have to build machines that are capable of open-ended interaction with an unpredictable world in order to hope and see any true sign of intelligence. Since very few are even trying to look in that direction (while most researchers are just looking for the awesome, and often lucrative, applications of our current computational capacity), I don't see any change coming soon.
I have a slight problem with 'singulariries' as Kurzweil describes.
Assuming the ultraintelligent computer cannot do magic, it will be bound by the same physical and logical laws we live by.
An unltraintelligent computer may think 10x faster than us, but not qualitatively 10x better.
It will use the same basic logical steps to solve a problem, just faster and / or in parallel - and this may appear magical looking at the solution but if you sat down and examined the 'recipe', assuming it will tell you, it will be possible to follow the reasoning.
In some ways it could be argued that we have already passed some singularities, try properly understanding all the technology that goes into a modern car, the reasoning behind a mobile phone contract, the code behind ms-windows paperclip thing... well maybe not the last.
The operation of lots of well co-ordinated people working on a problem can act as a simulation for a 'more intelligent' intelligence. It seems a pity one of the achievements is a really good worm used for spam delivery.
- It assumes that intelligence is well defined, which it is not
- It assumes that intelligence is the same thing as creativity, which it is not.
- It ignores resource limitations.
Dealing with these points in turn:Intelligence is not well defined. It is very hard to say how much of what we call "intelligence" is in fact the ability to make many connections between facts stored in a very sophisticated memory architecture. Simply building a machine able to process information very quickly achieves nothing because, without learning and a social context, it does not know what information to acquire and process. In human experience, academically brilliant people often fail because they work on the wrong problems, or without access to necessary knowledge.
Nothing is actually achieved without creativity. We do not know what that is, or to what extent it is a social construct (i.e. it takes a developed society to have the necessary systems in place to translate an idea into a concrete reality.) And this leads onto the third point. It is no good having a highly intelligent, creative machine if its use of resources is such that it cannot replicate in large numbers. It may be that machine intelligence will ultimately replace human intelligence, but it may be that it will simply be too resource hungry. In effect, there may be a threshold of capability needed to solve some problems, and it may be that machine intelligence will run out of energy before it scales sufficiently to solve those problems. A machine society might, in effect, get stuck in the machine 19th century because coal or oil became a limiting resource. (In the same way, the energy and resources needed to be consumed to achieve a first independent space colony may exceed the total energy and resources available on Earth. It may be that a billion years or so of eukaryotic evolution has actually resulted in the optimum balance of intelligence, creativity and resource consumption, and that any attempt to exceed the present capability will tip us into declining resources faster than we can improve matters.
In many ways I hope this is wrong. But the argument that only one superior machine is necessary is, in fact, an inductive step too far. It is assuming that "intelligence" on its own can solve a class of problems which may involve a number of constraints which cannot be avoided - like the Laws of Thermodynamics, or the need for excessive amounts of energy.
Pining for the fjords
Compassion is really a part of intelligence. Check out Kurzweil's 'Age of Spiritual Machines'. The more than human intelligence will inevitably entail compassion, love, and all the other emotions we have.
Further, forget about the 'borg' idea. We will inevitably evolve into these machines.
That quote has the same sentiment as "Everything that can be invented has been invented." (falsely attributed to various US patent office commissioners).
Intelligence isn't going to make invention obsolete unless there is artificial creativity to go with it. Some problems don't even present themselves as such until you try doing something different and non-obvious - almost random - and begin to realize new possibilities rather than refining existing ones.
How many great inventions came about because someone decided to try something just for the hell of it, without even thinking of the possibilities?
=Smidge=
For those predicting the imminent elimination/enslavement of the human race once ultra-intelligent machines become self-aware, where would the motivation for them to do so come from? I would contend it is a religious meme that drives such thoughts -- intelligence without a soul must be evil.
For those that would argue Darwinian forces lead to such imperatives; sure you could design the machines to want to destroy humanity or evolve them in ways that create such motivations, but it seems unlikely this is what we will do. Most likely we will design/evolve them to be benign and helpful. The evolutionary pressure will be to help mankind not supplant it. Unlike animals in the wild, robot evolution will not be red of tooth and claw.
An Asimovian type future might arise with robots maneuvering events behind the scenes for humanities best long term good.
I worry more about organized religious that might try to deny us all a chance at the near immortality that our machine children could offer us rather than some Terminator like scenario.
Letter To Iran
OK. here's where we are:
AI is one of those fields, like fusion power, where the delivery date keeps getting further away. For this conference, the claim is "some time in the next century". Back in the 1980s, people in the field were saying 10-15 years.
We're probably there on raw compute power, even though we don't know how to use it. Any medium-sized server farm has more storage capacity that the human brain. If we had a clue how to build a brain, the hardware wouldn't be the problem.
That and tofu is slightly rare on the African plain.
Remember folks, slashdot doesn't have a -1 "disagree" moderation!
The more than human intelligence will inevitably entail compassion, love, and all the other emotions we have.
But look at how often we write off those emotions as a luxury. When "it's time to get tough" or time "to do what needs to be done" compassion and love go right out the window. Why would it be any different when we are no longer the apex of Earth lifeforms? Need to kill a few million humans to make way for solar farms, oh well, maybe we can keep a few alive on a special reserve somewhere. We humans with our compassion and love killed off how many species? We have enslaved and murdered other humans for how many thousands of years? These more-than-human machines had best be a hella lot better at compassion and love than we are, or humanity is going to hold the same relative place in the world order that Chimpanzees do today. I do not welcome our Machine Overlords.
We are all just people.
Intelligence is inextricably linked with creativity. I'd highly recommend Hofstadter's writings on the subject, in which he presents ideas of AI, not as a massive calculator, but as a collection of 'symbols', bashing into each other, with parts of the pattern modified by external state.
Think of a hyper-intelligent ant colony - any one ant can't really do much, but running about and interacting with the other nearby ants, they can organize themselves to achieve much harder tasks. Indeed, one of the sample dialogs in Godel, Escher, Bach is on that very subject.
Intelligence and creativity are high-level actions, you're still thinking of an AI as a massive collection of very fast low-level actions. That would be incredibly good at refining ideas, but a machine which can think would be different. It would run on a much higher level, making associations and fuzzy reasoning. You can't implement intelligence in formal rules, but you might be able to do it by specifying some formal rules by which certain objects interact, and then affecting a few of them based on 'external' state.
Read Metamagical Themas and Godel Escher Bach for some ideas of where I'm coming from (actually, read them anyway, they're both really good)
"Lisp
Correlation != causality. We're not compassionate because of our intelligence, we're compassionate because societies with compassionate members were better at having offspring that survived. That likely wouldn't be the case with these ultra-smart robots.
Sure, intelligence is a prerequisite to compassion, because it requires the complex ability to empathize. But it doesn't necessarily result from intelligence.
Yes, emotion is dependent on chemical stimuli. We feel good about something because of chemical stimulus, and vice versa. Empathy is not merely a logical conclusion that an external thing is similar to us. It requires a further step of an emotional reaction to some behavior if that behavior was directed at us. Cutting off the legs of a spider (see Do Androids Dream of Electric Sheep) creates an empathic response because we identify with the emotional response to someone cutting off our legs. It would induce terrible pain and sheer terror, we experience those feelings - ie chemical induced reactions, concluding that it is undesirable, and then we project that onto the spider. Not wishing to cause such disturbance in another creature, we desist, even if that creature is wholly incapable of experiencing terror or pain.
Logic is necessary, but not sufficient, for empathy. If a machine cannot experience the same pull/push emotional reaction to a stimuli, then it cannot empathize. Intelligence does not create this. Brain chemistry does.
'Sure, intelligence is a prerequisite to compassion, because it requires the complex ability to empathize. But it doesn't necessarily result from intelligence.'
Compassion is the inevitable result of empathy and empathy is the inevitable result of intelligence. You empathize because you have a sense of self, the more you see another lifeform as being the same as yourself the more devaluing them becomes devaluing yourself. Ever wonder why the vegetarians don't want to eat animals and yet continue to eat nothing but other types of dead lifeforms? The ones they eat are simply less like themselves. The entire concept of the sanctity of life is just an elaborate way of rooting for the home team.
"Compassion is the inevitable result of empathy "
I Disagree. Compassion is not inevitable. You're working from your own tenets and philosophies, a machine need not have those same ideals. Compassion is at least partially born of self-interest. The cynical (or non-empathic, if you prefer) view is that compassionate societies aid those who need it, because later the person previously aided may be able to render aid... "There, but for the grace of God, go I", "Do unto others as you would be done unto", etc., etc.
Are we suggesting that these hyper-intelligent machines would have any self-interest in keeping around the competition for resources that humanity represents ? I'm not trying to be trollish, here - I'm asking a genuine question. Humanity is ruthless in exterminating competing lower lifeforms. Why would we expect superior machines to be any different ?
And even should there be some self-interest in the first generations of such machines, what about the 5th generation, the 10th, the 1000th ? All I'm suggesting is that some thought be put into providing good answers for questions like this *before* we create competition. I'm as much of a technophile as the rest of you, but the phrase goes "look *before* you leap". Later may be, well, too late.
Simon
Physicists get Hadrons!
Lions sometimes make friends with antelopes.