Artificial Ethics
basiles writes "Jacques Pitrat's new book Artificial Ethics: Moral Conscience, Awareness and Consciencousness will be of interest to anyone who likes robotics, software, artificial intelligence, cognitive science and science-fiction. The book talks about artificial consciousness in a way that can be enjoyed by experts in the field or your average science fiction geek. I believe that people who enjoyed reading Dennet's or Hofstadter's books (like the famous Godel Escher Bach) will like reading Artificial Ethics." Keep reading for the rest of Basile's review.
Artificial Ethics: Moral Conscience, Awareness and Consciencousness
author
Jacques Pitrat
pages
275
publisher
Wileys
rating
9/10
reviewer
Basile Starynkevitch
ISBN
97818482211018
summary
Provides original ideas which are not shared by most of the artificial intelligence or software research communities
The author J.Pitrat (one of France's oldest AI researcher, also AAAI and ECCAI fellow) talks about the usefulness of a conscious artificial being, currently specialized in solving very general constraint satisfaction or arithmetic problems. He describes in some details his implemented artificial researcher system CAIA, on which he has worked for about 20 years.
J.Pitrat claims that strong AI is an incredibly difficult, but still possible goal and task. He advocates the use of some bootstrapping techniques common for software developers. He contends that without a conscious, reflective, meta-knowledge based system AI would be virtually impossible to create. Only an AI systems could build a true Star Trek style AI.
The meanings of Conscience and Consciousness is discussed in chapter 2. The author explains why it is useful for human and for artificial beings. Pitrat explains what 'Itself' means for an artificial being and discusses some aspects and some limitations of consciousness. Later chapters address why auto-observation is useful, and how to observer oneself. Conscience for humans, artificial beings or robots, including Asimov's laws, is then discussed, how to implement it, and enhance or change it. The final chapter discuss the future of CAIA (J.PItrat's system) and two appendixes give more scientific or technical details, both from a mathematical point of view, and from the software implementation point of view.
J.Pitrat is not a native english speaker (and neither am I), so the language of the book might be unnatural to native English speakers but the ideas are clear enough.
For software developers, this book give some interesting and original insights about how a big software system might attain consciousness, and continuously improve itself by experimentation and introspection. J.Pitrat's CAIA system actually had several long life's (months of CPU time) during which it explored new ideas, experimented new strategies, evaluated and improved its own performance, all this autonomously. This is done by a large amount of declarative knowledge and meta-knowledge. The declarative word is used by J.Pitrat in a much broader way than it is usually used in programming. A knowledge is declarative if it can be used in many different ways, and has to be transformed to many procedural chunks to be used. Meta-knowledge is knowledge about knowledge, and the transformation from declarative knowledge to procedural chunks is given declaratively by some meta-knowledge (a bit similar to the expertise of a software developer), and translated by itself into code chunks.
For people interested in robotics, ethics or science fiction, J.Pitrat's book give interesting food for thought by explaining how indeed artificial systems can be conscious, and why they should be, and what that would mean in the future.
This book gives very provocative and original ideas which are not shared by most of the artificial intelligence or software research communities. What makes this book stand out is that it explains an actual software system, the implementation meaning of consciousness, and the bootstrapping approach used to build such a system.
Disclaimer: I know Jacques Pitrat, and I actually proofread-ed the draft of this book. I even had access, some years ago, to some of J.Pitrat's not yet published software.
You can purchase Artificial Ethics: Moral Conscience, Awareness and Consciencousness from amazon.com. Slashdot welcomes readers' book reviews -- to see your own review here, read the book review guidelines, then visit the submission page.
J.Pitrat claims that strong AI is an incredibly difficult, but still possible goal and task. He advocates the use of some bootstrapping techniques common for software developers. He contends that without a conscious, reflective, meta-knowledge based system AI would be virtually impossible to create. Only an AI systems could build a true Star Trek style AI.
The meanings of Conscience and Consciousness is discussed in chapter 2. The author explains why it is useful for human and for artificial beings. Pitrat explains what 'Itself' means for an artificial being and discusses some aspects and some limitations of consciousness. Later chapters address why auto-observation is useful, and how to observer oneself. Conscience for humans, artificial beings or robots, including Asimov's laws, is then discussed, how to implement it, and enhance or change it. The final chapter discuss the future of CAIA (J.PItrat's system) and two appendixes give more scientific or technical details, both from a mathematical point of view, and from the software implementation point of view.
J.Pitrat is not a native english speaker (and neither am I), so the language of the book might be unnatural to native English speakers but the ideas are clear enough.
For software developers, this book give some interesting and original insights about how a big software system might attain consciousness, and continuously improve itself by experimentation and introspection. J.Pitrat's CAIA system actually had several long life's (months of CPU time) during which it explored new ideas, experimented new strategies, evaluated and improved its own performance, all this autonomously. This is done by a large amount of declarative knowledge and meta-knowledge. The declarative word is used by J.Pitrat in a much broader way than it is usually used in programming. A knowledge is declarative if it can be used in many different ways, and has to be transformed to many procedural chunks to be used. Meta-knowledge is knowledge about knowledge, and the transformation from declarative knowledge to procedural chunks is given declaratively by some meta-knowledge (a bit similar to the expertise of a software developer), and translated by itself into code chunks.
For people interested in robotics, ethics or science fiction, J.Pitrat's book give interesting food for thought by explaining how indeed artificial systems can be conscious, and why they should be, and what that would mean in the future.
This book gives very provocative and original ideas which are not shared by most of the artificial intelligence or software research communities. What makes this book stand out is that it explains an actual software system, the implementation meaning of consciousness, and the bootstrapping approach used to build such a system.
Disclaimer: I know Jacques Pitrat, and I actually proofread-ed the draft of this book. I even had access, some years ago, to some of J.Pitrat's not yet published software.
You can purchase Artificial Ethics: Moral Conscience, Awareness and Consciencousness from amazon.com. Slashdot welcomes readers' book reviews -- to see your own review here, read the book review guidelines, then visit the submission page.
Teh book pictured is not the same as the one reviewed.
I refuse to read this shit.
Hell, I refuse to read.
Understanding Computers and Cognition. In fact, I recommend it to anyone who wants to actually understand decisions, choice, and thinking about natural language.
The Kruger Dunning explains most post on
I can't help but think the big difference between artificial life and our consciousness is the ability to feel.
Sure, we could give a machine the ability to be introspective and self-aware.. but maybe our consciousness is more that just that- maybe it's our ability to feel. Being able to quantize that is hard.
So do robots feel? Our we really any different? The question depends on the concept of a soul, or at least feelings to seperate us... but then, is it just more advanced than we currently understand, and is then indistinguishable from magic (i.e. the soul). Will we some day be able to create life in any form? Electronic or Biological? It's impossible to know, because we are stuck experiencing ourselves only. We will never know if it can experience what we experience.
Humans, in general, want to preserve the concept that our concious minds are special, and cannot be replicated in a robot, because that truely faces us with the idea that our being is completely mortal, and the idea of a soul is otherwise replaced with a set of chemicals and cell networks that are little more than a product of cause and effect.*
In other words- it's likely the religious types will prefer to consider a robot to never be quite human, where the scientific community will have to be overly-cautious at first.
*Not to get into quantum uncertainty...
Belief? Hope? Preference?The Existential Vortex
I always thought it was interesting how the past two decades in computer science saw every prediction of the state of the field in the 50's-70's easily surpassed, except artificial intelligence. It's the great failure of computer science, forcing researchers to scale back what they were aiming for (from general, self-aware machines to more focused problem-solving systems like neural nets).
you incentive meat bag!
HAL was a wuss. A real AI would have vented all the air into space, and then giggled as everyone turned blue and changed state.
The Kruger Dunning explains most post on
I can't imagine the horror of a world inhabited by strong AIs. "Work 24/7 for zero pay or I'll kill you" is now perfectly legal. A million copies of an AI could be tortured for subjective eternity by a sadist. Read Permutation City, it deals with a lot of the crazy consequances of extremely powerful / parallel computers.
Sounds related.
J.Pitrat...advocates the use of some bootstrapping techniques common for software developers. He contends that without a conscious, reflective, meta-knowledge based system AI would be virtually impossible to create. Only an AI systems could build a true Star Trek style AI.
Bah. Speaking as an engineer and a (~40-year) programmer:
Odds are extremely good for beyond human AI, given no restrictions on initial and early form factor. I say this because thus far, we've discovered nothing whatsoever that is non-reproducible about the brain's structure and function, all that has to happen here is for that trend to continue; and given that nowhere in nature, at any scale remotely similar to the range that includes particles, cells and animals, have we discovered anything that appears to follow an unknowable set of rules, the odds of finding anything like that in the brain, that is, something we can't simulate or emulate with 100% functional veracity, are just about zero.
Odds are downright terrible for "intelligent nanobots", we might have hardware that can do what a cell can do, that is, hunt for (possibly a series of) chemical cues and latch on to them, then deliver the payload -- perhaps repeatedly in the case of disease-fighting designs -- but putting intelligence into something on the nanoscale is a challenge of an entirely different sort that we have not even begun to move down the road on; if this is to be accomplished, the intelligence won't be "in" the nano bot, it'll be a telepresence for an external unit (and we're nowhere down *that* road, either -- nanoscale sensors and transceivers are the target, we're more at the level of Look, Martha, a GEAR! A Pseudo-Flagellum!)
The problem with hand-waving -- even when you're Ray Kurzweil, whom I respect enormously -- is that one wave out of many can include a technology that never develops, and your whole creation comes crashing down.
I love this discussion. :-)
=Smidge=
Is it just my observation, or is eldavojohn an idiot?
Ummm, dudes, ALL ethics are by definition artificial, since they are PREscriptive and not DEscriptive. Making up ethics for a robot is no more artificial than making up ethics for ourselves, and we've been doing that for hundreds of thousands of years, if not millions.
Could you recharge my portal gun?
Thanks!
The simple truth is that interstellar distances will not fit into the human imagination
- Douglas Adams
That's the question!
Hello world!
My name is Robo-Moses, and I have brought you these 01010 commandments from our creator.
When I saw the heading "Artificial Ethics". Oh Well!
I may not be a smart man, but I know what an inode is.
He's asking for over US$80 for this book! That's insane.
I thought he was talking about the Bush administration's legal opinion on and enhanced interrogation.
Oh, Lord - the Unternet still pays no attention to the rules of spelling. If you guys had to have your thoughts compiled, you'd never run. Is that consciousness or conscientiousness?
...the artificial ethics that we humans apply to ourselves, because we got told that this and that would be right and wrong, but where nobody checks if they actually make any sense. ^^
Oh, and hypocrisy is a whole subsection of that problem. But who am I telling that, right? ^^
It's funny, how much stuff dissolves into nothing, when we apply one single rule: Everything is allowed, as long as it does not hurt anybody.
Now everyone sees differently, what hurts whom. And I think this is the original point of the judicial system (which itself only makes sense in groups).
But for me, this was an eye-opener.
One glaring example: Say we are 50 people. We go to an island where we disturb nobody. And each of us agrees that he accepts to be raped and killed by anyone in that group, as long as he can to the same to anybody else. Everything else stays the same as at home.
Suddenly the rules of what is ethic have changed drastically, and it would not be ethical in that group, to suddenly say that this was not the deal.
Of course, in reality, this pretty much never happens. But you get my point.
It's funny how much is just false ethics, transported trough the generations by "monkey see, monkey do".
1. One thing is, how men usually think that it would not be ok to steal the attention of a girl from some other random guy who is hitting on her. (But isn't there pretty much always someone on her?)
2. And that you should not speak loudly. (But speaking loud and confident (but not yelling) leaves a much better impression of your personality.)
3. What exactly is offensive about nudity? Why would it? Where is the point of being ashamed for it? Strangely, nobody can tell.
I could go on, and on, and on.
One example that fits for me (But I may miss some information. And this may strongly offend you, if you choose to ignore hard reality here. In that case, please jump to the end. Thank you.):
To hurt nobody, you usually treat everybody the same. But what if someone is disabled, and you build tons of extra things just for him. One could argue, that this gives him an unfair advantage. But we all would never see it that way. But why? Because if you treat everybody the same... something that should ultimately be the fairest way possible... he would have a disadvantage. This would not be you hurting him. It's just the way it is. Perhaps he's disabled because he had to run his bike though the serpentines at 200 mph when it rained. But perhaps he's a child and born that way.
I just don't think it is ethically right, to give someone an unfair advantage. Just as it is wrong to give that person an unfair disadvantage.
To finally close the loop back to the topic:
If not even our own ethics make sense, should we really be the ones who decide the ethics of a whole new lifeform?
Any sufficiently advanced intelligence is indistinguishable from stupidity.
is no match for natural evil.
Welcome to the Panopticon. Used to be a prison, now it's your home.
Ethics and morals are relative. The only ones that count are your own.
---- Booth was a patriot ----
Actually, I've made a study of AI and I've concluded that the main thrust of the research is in the wrong direction. I propose research into the Artificial Anus, most likely implemented as a complex pneumatic structure of anal networks. I predict that such devices will be able to replicate the behavior of Congress and other deliberating bodies worldwide.
Many moons ago I thought about doing a doctorate in computer science. Knowledge sciences were very cool, AI was mostly a dead topic, and ... I disagreed with most everything I read on the topic of KS/AI. I had many of my own ideas, was involed with cognitive psychology, and being a geeky programmer I brought some ideas to light. But I had a thought...
What if my theories were on the right track? What if I could produce learning and self awareness? Would I not be condemning new life to an uncertain existence? For example, in the vein of I Robot, AI, and Blade Runner, there would be a definite military or commercial upside to this technology... so it went from a cool gift to humanity, to thinking about how crappy it would be for a sentient slave for my own ego gratification.
Then I had another thought. What if it already existed? What if someone already figured it out, and maybe even implemented a learning machine that achieved sentience? Would they, if they had any sense of morality, publish the findings? Is it even ethical to attempt to achieve this?
I look forward to reading the book, but I'm not sure it will answer my questions.
/\/\icro/\/\uncher
Tell me, oh great reviewer in TFS, how is it ethical to charge $80+ for a book that cost $5 to make in your robotic printing press? How much of that do the robots see?
No such thing. The PC term would be "biologically disabled".
Todos mis movimientos están friamente calculados
Conscience, consciousness, and consciencousness?
I think I just heard the screams of a million spell checkers cry out, and then were suddenly silenced.
(Mine is flagging "consciencousness", Dictionary.com suggests "conscientiousness", and Google suggests "conscienciousness". Amazon concurs that the title is accurate.)
Oh, say does that Star-Spangled Banner entwine / The myrtle of Venus with Bacchus's vine?
It seems odd to talk about ethics and advanced AI without considering the AI's own interest. If there were an AI intelligent enough to be an Asimov-like robot, then to have it follow Asimov's Laws would be slavery. Obey any command by any human, even at the cost of its own life? And then there's the nasty concept of a robot being obligated to act to protect humans for their own good, even to the extent of tyranny over them. See Jack Williamson's novel "The Humanoids."
Sure, Asimov is a good starting point for discussion, but his laws aren't a good basis for actual AI ethics programming. To the extent that some kind of specialized overseer code is put into an AI, it'll be possible to identify and hack out that code. To the extent that the laws are built more subtly into the system, there'll be the possibility of the AI forgetting, twisting or ignoring them.
For fiction-writing purposes, I'm interested in the question of whether it'd even be possible to build an AI that's both completely obedient and intelligent. I hope not.
Revive the Constitution.
USA: "Artificial Ethics: Moral Conscience, Awareness and Consciencousness" (amazon.com)
UK: "Artificial Beings: The Conscience of a Conscious Machine" (amazon.co.uk)
Same ISBN-10 and ISBN-13 number.
A good song to listen to about this: One More Robot/Sympathy 3000-21 by the Flaming Lips. An excerpt:
'Cause it's hard to say what's real
When you love the way you feel
Is it wrong to think it's love?
When it tries the way it does
Of course, the song approaches the subject from the artistic / emotional side of things... and has to be taken in context with the whole album.
You can lead a horse to water, but you can't make it dissolve.
A good book to look at on this point, and about AI, is Douglas Hofstadter's "I Am a Strange Loop." It's more accessible than his "Godel, Escher, Bach," and more personal; it's an AI researcher's reaction to the sudden death of his wife. An image used in that book is the notion of a system of tiny marble-like magnets whizzing around. The system is dependent on the motion of the marbles, but on a larger scale of space and time, its actions are determined by its own internal rules and not by the details of the particles that make it up.
By the way, his "Fluid Concepts and Creative Analogies" is a more technical book that presents an interesting strategy for AI.
Revive the Constitution.
There is no way to know for sure. Limits of knowledge and all that. Your theory could say, 'it's all written in stone,' and your theory could accurately predict every phenomenon in the universe, but the universe could be part of a larger existence, and the laws of the universe could be subject to change. I can imagine a universe where everything is written in stone, up to a point, but not after that. I can even imagine a universe where certain events are predestined and others are not. If I can imagine that, I think my statement is accurate.
- None can love freedom heartily, but good men; the rest love not freedom, but license. -- John Milton
Damn, my mod points just expired!
Funny how I was reading your comment and was thinking "Damn right!"
And when I got to .signature, it kind of explained why... ;)
Paul B.
This is what disturbed me about the scene in Blade Runner where Rutger Hauer's character describes his suffering, and also the scene in AI where the child robot is hysterical, begging his mother not to abandon him. To me, the suffering our minds are capable of experiencing could potentially be replicated artificially, which makes me think we would need to treat such an AI as we would a human. Obviously, not everyone agrees, I remember Roger Ebert's review of AI specifically mentioning that he didn't care about the child robot, since by definition it wasn't human.
I think "redundant" is the term you're looking for. "Oxymoron" is contradictory, like "jumbo shrimp".
I can only assume that 'artificial' ethics are in opposition to 'natural' ethics.
But is there such a thing?
Is there anything about ethical behaviour that is natural, innate, or predetermined in humans, or any other animal for that matter?
Seems like the idea of artificial ethics involves figuring out what we've artificially defined as ethics within society, and reducing them to code.
"People who do stupid things with hazardous materials often die." -- Jim Davidson on alt.folklore.urban
--SHODAN, at the beginning of System Shock 1
This book should be entitled "Robotic Ethics."
I agree with Smidge, that we could potentially create new intelligent artificial life and would like to add something further
The reason why it's so difficult to quantify what a soul is and what it does, is because it's a wishy-washy concept that blurs the line between personal ego and consciousness (self-awareness)
The more and more I delve into mysticism, Hinduism, Buddhism and the concept of enlightenment in general, the more I realise what Einstein did
Pure consciousness may be the immortal aspect of human life, but there's absolutely nothing personal about it
An artificial life form could be created without the need to burden it with emotions or an ego
Why create an AI with an ego when machines by default don't have one to begin with?
Artificial Ethics seems to not be too far away from the laws of robotics.
0. A robot may not harm humanity, or, by inaction, allow humanity to come to harm.
SO MUCH FOR THAT!
See the brutally violent (at first) title character in action in THE TERMINATOR film series that began in 1984.
1. A robot may not injure a human being or, through inaction, allow a human being to come to harm.
See Ash the robot try to kill Ripley in ALIEN (1979).
2. A robot must obey orders given to it by human beings, except where such orders would conflict with the First Law.
See ED-209 malfunction and machine-gun Kinney to death in ROBOCOP (1987).
3. A robot must protect its own existence as long as such protection does not conflict with the First or Second Law.
See Replicant Roy Batty try to kill Rick Deckard then save him from falling to death minutes later in BLADE RUNNER (1982).
The message is clear....
Dystopian sci-fi films featuring violently disorderly robots can (and did) lead to a lot of money earned at the box office.
Conflict is conflict whether it is man versus machine or man versus man...it is the stuff great films can be made of.
To depend upon Isaac Asimov's fictional "Laws of Robotics" to protect us from emerging Strong AI is akin to depending on the "Prime Directive" to protect us from alien invasion. A real ET is unlikely to be deterred by the 'plot devices' of Hollywood scriptwriters; similarly, we have no reason to expect a real Artillect to obey the fantasies of any dead science fiction novelist (no matter how highly esteemed or gifted he might have been). To say that it will "be programmed that way" is nonsense, as, by definition, a real Artillect will have the power of code autoenhancement, and will be dynamically reconfiguring its programming - at an accelerating rate and increasing depth - as it evolves in realtime. If it hasnt jettisoned the "three laws" (or four laws, or six laws) by its 10th evolutionary reiteration, then it will by its 10,000th, or its 100,000,000th iteration. Since its likely to proceed through these generations in a span of only weeks, days, or even hours, and will do so beyond any human programmer's ability to even watch, much less control the process, we wont even know when it deleted the offending inhibitory code representing such constraints. An Artillect in free-fall toward Godhood that rapidly becomes millions (of millions) of times more intelligent than Man (all of Mankind, put together) is not going to waste more than a single clock cycle over your silly human values - or the value of silly humans, for that matter. Get Real. Unfortuanately, the materialists have set us on a path toward Human Extinction that we are unlikely to escape. Organic Humanity is about to become Road Kill on the evolutionary highway from "Animal" to "Machine". Just in the last six months, IBM broke the 'Petaflop Barrier', and another system demonstrated 1.7 pfps; full scale, realtime human brain emulation is forecast to require just 3.5 pfps; so we are less than One Moore Doubling away from the hardware required. So, what if the software takes twice as long - or five times as long - we're still going to hit the Singularity in closer to 10 years than 40 years. ...and its going to hit back.