Slashdot Mirror


Studying Intelligence Thru Entropy?

An Anonymous Coward asks: "Given that entropy is the measure of order or disorder. Given that any force that changes the entropy of any system in a predictable way is an 'intelligent' force. Is it true that the study of HOW entropy changes in any given system is the study of intelligence itself, in that given system? I is it true that producing systems whose sole purpose it is to capture and synthesise changes in entropy is the production of intelligent systems?"

"A case in point. Neural networks are weighted switches. They store their 'weights' in the neuron. The storage of these weights determines the networks ability to perform an intellectual task. Therefore studying the 'entropy' of these weights and what and how they change and the effects of these changes is to study the networks 'intelligence' directly?

Another case in point. Genetic algorithms can search a solution landscape and then select the 'best' solution as a seed to the next iteration. This 'best current solution' will have an entropy or measure of order or disorder. So, in these terms, the system is measuring the level of chaos in the system according to some rules and selecting the solution that produces the least chaos (most entropy)

Is this striking any cords with anyone?"

2 of 35 comments (clear)

  1. Re: Information "entropy" is not entropy. by Black+Parrot · · Score: 2, Funny


    > I wouldn't be the grammar nazi if I didn't take point out that: "Is this striking any cords with anyone?" (line from original story) is incorrect.

    "didn't take point out"???

    Playing grammar nazi is a dangerous game: there seems to be a law of nature that increases the probability of grammatical errors in posts criticizing others' grammar. (I think they call it the "Second Law of Poetic Justice".)

    --
    Sheesh, evil *and* a jerk. -- Jade
  2. Re: Information "entropy" is not entropy. by SEWilco · · Score: 2, Funny
    "what is the conversion factor for Joules/Kelvin to bits?"

    Mountain Dew cans is the conversion factor. Joules of energy fed to Computer Science students.