NPR Looks to Technological Singularity
Rick Kleffel writes to tell us that NPR is featuring a piece with both Vernor Vinge and Cory Doctorow looking at the possibility of the "technological singularity" in the near future. Wikipedia defines a technological singularity as a "hypothetical "event horizon" in the predictability of human technological development. Past this event horizon, following the creation of strong artificial intelligence or the amplification of human intelligence, existing models of the future cease to give reliable or accurate answers. Futurists predict that after the Singularity, posthumans and/or strong AI will replace humans as the dominating force in science and technology, rendering human-specific social models obsolete."
Will AIs produce AIs, and if so, will they be better, or equally flawed?
The current thinking is that we will make seed AI, i.e., general intelligence for manipulating software, and that it will improve itself, in an incremental fashion, all the way up to and beyond the level of human intelligence. Of course, this will be done with the help and guidance of programmers but the fear is that by giving it free reign to manipulate itself we will no longer be able to understand what it creates. Not only will this mean that we won't learn anything, but we'll also be unable to control it. As such, most people who seriously consider working on this stuff advocate a goal based higher level of functioning with "friendliness" to humans as being the primary goal and improve yourself as a secondary subgoal. That way, even if the beast gets out of control, the worst it will do is solve world hunger.
How we know is more important than what we know.