Wolfram's 2,3 Turing Machine Is Universal!
Rik702 writes "Wolframscience.com have announced that an undergraduate from Birmingham, UK has proved Wolfram's 2,3 Turing Machine is universal." You can read a pdf of the proof as well as some related coverage.
That was on my To Do list for next week.
He tried to kill me with a forklift!
Clarification:
Wolfram's claim in NKS that he had discovered some fundamentally new way to approach science that couldn't be handled by existing peer review processes was hogwash. Others had done that kind of thing long before, and little in NKS helped advance the state of the art.
Wolfram's proof in NKS that his Rule 110 cellular automaton was a Universal Turing Machine, was not hogwash. (That UTM was different from the one described in the story, obviously.)
Apology to Ubuntu forum.
...does it run Linux?
Give me Classic Slashdot or give me death!
Very true. He is a clever guy, but not as clever as he thinks he is, and the book was just regurgitated from other sources. There was very little new or really much science in it. Basically he enumerates a lot of possible combinations of rules and says "some of these will turn out to be slightly interesting, you mark my words.". Well, some of them did. I'm SO impressed.
Look at a map of the world. Some of those countries are going to end up going to war, you mark my words. See? I'm a visionary too.
TWW
"Encyclopedia" is to "Wikipedia" what "Library" is to "Some people at a bus stop"
I recall that to, and was curious enough to see if the criticism was summarized well in Wikipedia. (It is.) Personally, I loved the book, and read it knowing that it was standing on the shoulders of other's work. I remember first reading about the idea of modeling the world as cellular automata in a 1988 issue of The Atlantic, in an article called Did the Universe Just Happen? (search for "Wolfram" in that page) and I thought his book was a terrific work on the subject.
I can understand how people's nerves got a little tender by having their contributions not been properly attributed, footnoted, etc. It didn't ruin my enjoyment though.
The "cue the foo posts in 3, 2, 1..." posts will commence with no subsequent foo posts in 3, 2, 1...
For some perspectives on the complete nonprofundity and borderline academic dishonesty of Wolfram's book from some people who _do_ know what they're talking about, see this review (PDF) from the Notices of the American Mathematical Society and this collection of many more links to reviews.
Constructive logic destructs my brain.
Yes the 'blowing it' pun was intended...
Wolfram never actually proved Rule 110. The actual work for that was done by Matthew Cook - who presented the paper at a conference while he was working in Wolfram's employ - and eventually got himself and the conference sued. Apparently, working for Wolfram means you sign over any and all papers, ideas, and patents over to him, without receiving any real credit for them.
Another little-known fact is that Wolfram was just one of several people who initially coded Mathematica. He decided one day to take all the code, form a company on his own, and engage in expensive lawsuits with all of his former collaborators to gain ownership of the code.
As far as I'm concerned, the man at this point is wasted intelligence. He may come out with another non-trivial result or two over the course of the rest of his life, but his best contributions to the science may yet come from his wallet - like sponsoring prizes like this one.
http://www.cscs.umich.edu/~crshalizi/reviews/wolfram/
The above link is worthwhile, entertaining, and should help bring back anyone who drank the Wolfram Kool-Aid.
(go blue)
But it's worth noting that the Rule 110 proof, while not hogwash, was also not Wolfram's.
Give me Classic Slashdot or give me death!
I for one now admit that all previously welcomed overlords can be emulated by this 2 state, 3 color overlord.
@AlexSheive
The wolfram site is slashdotted but this link for the article in nature is not.
~ In Trust, We Trust ~
There's a $1 million prize for proving or disproving P = NP from the Clay Mathematics institute if you're still interested.
An old-timer with old-timey ideas.
Sometimes the changes in Science come from just thinking about things differently. Whether Stephen is arrogant or not is irrelevant to the ideas or claims being evaluated. I doubt anything is invented in a vacuum, but rather a product of all the little discoveries and thoughts finally coalescing into something tangible.
The main point here is that we are reaching limits in machine technology, and jumping to a different scale will require a new way of thinking about what we've already learned.
Let me recommend three books: "The Structure of Scientific Revolutions" by Kuhn, "Bionics" by Salsburg, and "How Inventions Begin" by Leinhard. Three different thinkers; three different descriptions of the progress of technology.
I have heard a number of criticisms on NKS, but most of the critics I've met have not actually read the book. (OK, it's a big book... I've found the same problems with people criticizing "Science and Sanity" by Korzybski, "Synergetics" by Fuller, and "Democracy in America" by de Tocqueville.) If you are going to criticize a book, please read it and understand it first.
Recently William Gibson mentioned the problems with writing Science Fiction due to the unpredictability of the future and rapid technological change. As our technology becomes more abstract, more materials will be "intelligent" in new ways. For instance, imagine concrete with the intelligence to repair itself when a pothole is in imminent probability of forming. This type of "Turing Machine" computational ability at the molecular level may be the key to inventing this product.
"The mind works quicker than you think!"
yeah, I know I'm pimping my own site, sosumi...
Anyway, I was thinking about 1D CA the other week, and realized one of the attractions was that you plot time and make it 2D... but there's no particular reason you can't do the same thing to a 2D CA, like Life...
http://kisrael.com/2007/10/21/ is the result, ethereal blue sculptures made by plotting 2D Life with Time as a physical dimension.
I'm not sure if I learned a lot or proved anything, but it *is* pretty...
SO YOU'RE GOING TO DIE: The Comic for Dealing with Death
N = 1. Solved! I can't believe they weren't able to figure that out.
steampunk web design
Well said, Comic Book Guy!
You don't read a lot of serious science here because this isn't the place for it.
Every so often a fairly specialized technical discussion will crop up and even to people like me, who are casually interested, it is obvious that people who are serious about the subject are posting. They don't write full blown journal quality posts because a) see above, and b) as you correctly point out, Slashdot's demographic on the whole doesn't have the higher level knowledge necessary to understand them.
But that doesn't mean there isn't an interesting discussion going on. On the contrary, there are good opportunities to interact with serious people you would otherwise never be able to access. If you can effectively ignore the "I got wireless working under Linux so I know everything" mentality anyway.
Along the lines of the RIAA submissions from NewYorkCountryLawyer. How many attorneys who actively defend against RIAA lawsuits as their primary practice do you meet in a day?
"Sacrifice for the good of The State" - The State
Boy you're telling me. I remember when Wolfram was the wunderkind of the 1980s and 1990s, who was going to Change The World(TM) with his brilliance. Ha. Jeff Bezos or Linus Torvalds have done far more with computers to Change The World in interesting and useful ways.
Alan Turing is usually considered to be the father of computers. He invented a theoretical machine that he conjectured could solve any problem that could be solved by a machine. It consisted of a an infinitely long tape (memory) and a small finite set of operations that could be performed infinitely fast. Modern computers are *very* similar to his theoretical machine, except they're only very fast (as opposed to infinitely fast) and they only have a lot of memory (as opposed to an infinite amount of memory). No one has ever found a problem that could be solved by a more complex machine and could show that it couldn't be solved by a Turing machine. (BTW, Turing eventually killed himself by eating a poisoned apple after most of the scientific community shunned his work due to some personal habits. This was the inspiration for Apple computers' logo.) So Wolfram proposed an even simpler machine and conjectured that it could solve anything that a Turing machine could solve. Now this guy proved that Wolfram was right. I should mention for completeness that two other guys (Church, and dang, I forgot the other one) also proposed systems that were provably equivalent to Turing's machine around the same time, but Turing's was the easiest one to turn into an actual machine.
From the article:
So basically there's a machine that has two states, each of which can be three colors, and that machine can perform ANY computation that an x86 cpu can perform. The code to add two 32 bit numbers in an x86 processor might be just a few bytes and the code to do the same thing with this 2,3 Turing machine might be thousands of bytes, but it can do it. It will be horribly inefficient and slow, but it can be done. They've proved that a 2,2 machine is impossible so a 2,3 machine was the simplest possible theoretical Turing machine. This paper proved that one exists. It doesn't have a practical application right now, but the article mentions possible molecular computers that can use this simple machines to do calculations on strands of molecules like DNA.
As an undergraduate in 1968, I did an independent study that estimated the size of the universal turing machine described in: Davis, Martin (1958), Computability and Unsolvability, New York NY: McGraw-Hill Book Company. This was tedious but not hard. For any slashdotters ready to rush out and implement a working universal Turing machine, be forwarned that your parts list needs to include an infinitely long tape. Worse, when calculating the output of an arbitrary recursive function on your universal Turing machine, you won't know in advance how long the tape needs to be, in case you were cheap and bought a tape with finite length rather than the more expensive infinite one.
The universal Turing machine itself consists of a large but quite finite set of quadruples. The problem is the longish tape.
Lots of nitpicking of the solution and Wolfram and such have been posted. Let the nitpickers contribute!
It takes a push from various people, and communication and conflicts of opinions to wind up exciting someone to sit down and solve some excruciating problem.
I don't care whether it is math, mechanics, biology or physics, someone has to do the HARD work, and Wolfram contributed in his own promotional way, and Alex Smith solved the SOB of the smallest Turing problem, with a significant set of input from the judging panel requesting addtional work.
A community of interested people wound up involved in getting an advanced solution. Then others said "but what good is it in requiring an infinite memory/tape". Similar things were said about past inventions, until other inventors figured out how to make the prior/first invention practical.
I love math, but am not a mathemetician, so I have to contribute with the mundane discoveries and designs I do in my arena of medical product design, and they too will live on beyond me.
The complainers should leave something that outlives them. That is what makes for a great society.
A system is "Universal" if it can, given infinite memory and an appropriate program, compute any computable function. A previous system even more simple than this one, Rule 110, was proven to be Universal by one of Wolfram's associates (Wolfram had the idea that it might be, Matthew Cook discovered the proof). However, a Universal Turing machine has some extra requirements with regards to the implementation. So this is the simplest Universal Turing Machine.
If you already know programming, then here's how to think of it:
A Turing machine is a programming language.
A Universal Turing machine is a language that is sufficiently flexible enough to perform any computation (including emulate any other Turing machine - i.e. language)
A Non-Universal Turing machine is a language that is built to do a specific purpose well, but does not have enough flexibility to perform any computation.
For computer programmers, nearly every general-purpose language we deal with on a daily basis is Turing-complete. An example of a non-Turing Complete language might be a configuration file. It has a language, you may even be able to do some basic scripting in it, but unless it is built out of a general-purpose language you cannot perform any computation in it.
What they think it is useful for is to help us to make nanomachines easier. If we can construct a Turing machine with simpler parts, we can have a compiler that can pick up the slack in making the program.
On another note, Wolfram takes these tiny Turing machines as reason to not believe that people have souls, while I on the other hand take these to indicate that life must be designed, but that has to do more with the general properties of Turing machines rather than the size of them.
Engineering and the Ultimate
"The man makes a good point." -- how the heck does a simple me-too comment like this get modded up? I find this rather upsetting, somehow.
"Turing eventually killed himself by eating a poisoned apple after most of the scientific community shunned his work due to some personal habits."
Much, much sadder. He was prosecuted for homosexuality, sentenced to a course of estrogen, became depressed, and killed himself. This was how a grateful nation treated a man who had played a large, perhaps the leading role, in decoding Enigma signals - the decisive element in the Battle of the Atlantic. Tragic and wicked.
I think that you misunderstand Chomsky's critique of behaviorism. He did not claim that classical conditioning did not work on rats. Nor did he claim that classical conditioning did not work on humans for some behaviors. What he claimed is that behaviorism was not a complete psychological theory in that it could not explain human linguistic behavior. Behaviorist accounts of human language were based on a grossly oversimplified and inaccurate idea of what human linguistic behavior is like. Essentially, they thought that all you had to do was pair chunks of sound with meanings by classical conditioning. What Chomsky did was show that human language involves much more than simple wordmeaning associations, that behaviorists had not provided anything resembling an account of human language as it actually is, and that it was very unlikely that they could.
Chomsky's review of Skinner's Verbal Behavior was indeed the death knell of behaviorism as a theory of human cognition. It was one of the central events resulting in the development of what we now call cognitive science. Behaviorist psychology survived in some ways for several reasons. First, even if it doesn't explain human language, it does work for a lot of behavior, both of humans and of other organisms. If you were interested in rats, it was still reasonable to study operant conditioning of rats. Second, as a consequence of the first reason, classical conditioning is an effective form of behavior modification for certain types of behavior. Clinical psychologists therefore continue to make use of it. What they try to do is not induce native language acquisition. Third, there is a certain amount of inertia in any field. It takes a while for new ideas to be accepted even if the evidence for them is strong, and even then people working in areas not directly affected often don't find it worthwhile to change what they are doing. (Note, for example, that classical mechanics is not only used in engineering but continues to be taught by physicists even though in a technical sense since the introduction of relativity we know that it isn't right. It's much simpler to use it where it works than to do everything relativistically.)
The failure of Skinner and many other psychologists of the time to recognize the complexity of human language and therefore to believe that their theories could handle it has often been repeated, in psychology and AI. Quite a few linguistically oriented AI projects announced success only for it to turn out that the claims were vastly overblown because they had an inadequate understanding of the problem, which they therefore had not solved. For an entertaining critique of such work see: Norbert Hornstein and B. Elan Dresher (1976) "On Some Supposed Contributions of Artificial Intelligence to the Scientific Study of Language," Cognition 4, pp.32l-398. For a somewhat more recent example, I remember a talk by a proponent of neural nets in the late 1980s who claimed to have a net that "learned English syntax". The reality was that, if fed rather carefully constructed data, the net learned to distinguish transitive verbs from intransitive verbs. There is a lot more than that to "learning English syntax".