Slashdot Mirror


Information Theory Places New Limits On Origin of Life

KentuckyFC writes: Most research into the origin of life focuses on the messy business of chemistry, on the nature of self-replicating molecules and on the behavior of autocatalytic reactions. Now one theorist says the properties of information also place important limits on how life must have evolved, without getting bogged down in the biochemical details. The new approach uses information theory to highlight a key property that distinguishes living from non-living systems: their ability to store information and replicate it almost indefinitely. A measure of this how much these systems differ from a state of maximum entropy or thermodynamic equilibrium. The new approach is to create a mathematical model of these informational differences and use it to make predictions about how likely it is to find self-replicating molecules in an artificial life system called Avida. And interestingly, the predictions closely match what researchers have found in practice. The bottom line is that according to information theory, environments favorable to life are unlikely to be unusual.

28 of 211 comments (clear)

  1. Thermodynamic equilibrium is not required by Anonymous Coward · · Score: 2, Insightful

    It's a fallacy that entropy always increases ON EARTH, and therefore life is impossible to have evolved naturally, because it violates the 2nd law of thermodynamics. That's only true in a closed system, which most definitely the Earth is not. There's this "Sun" bombarding the planet with energy, constantly.

    Stop bringing thermodynamics into biochemical or origin of life questions. It's irrelevant.

    1. Re:Thermodynamic equilibrium is not required by K.+S.+Kyosuke · · Score: 3, Informative
      Quoting:

      The key idea in Adami’s formulation is that living systems do not exist in a state of thermodynamic equilibrium

      Not only is it not required, they're looking for exactly the thing you're mentioning, so I don't see any point in your comment. Also, they're not saying anything about Earth with increasing entropy. Where did you get that? Are we reading the same things in the first place?

      --
      Ezekiel 23:20
    2. Re:Thermodynamic equilibrium is not required by pscottdv · · Score: 2

      The thermodynamic and information theory definition of entropy are the same, which is why "bringing thermodynamics into biochemical or origin of life questions" is entirely relevant.

      --

      this signature has been removed due to a DMCA takedown notice

  2. Re:Unusual in a huge system ... by Jesrad · · Score: 3, Informative

    Wait. If they are unlikely to be unusual, then they are likely to be usual. Right ?

    --
    Maybe we deserve this world ?
  3. Re:First by ArcadeMan · · Score: 2, Informative

    And this is the only information that you need.

  4. Re:Empirical Data Trumps Information Theory by K.+S.+Kyosuke · · Score: 4, Insightful

    The empirical data can't violate information theory any more than it can violate quantum physics. If the purpose is to establish bounds on the solutions, this approach is perfectly reasonable.

    --
    Ezekiel 23:20
  5. Re:Unusual in a huge system ... by gstoddart · · Score: 2

    Oh, shit ... yes, I'm a moron ... I got the opposite out of that.

    So, information theory tells us life should be common.

    --
    Lost at C:>. Found at C.
  6. Life may be common, but not always as we know it by damn_registrars · · Score: 2

    There are a few points along the way where development of life on earth had to go one way, or the other, and was not able to sustain both directions. For example, the chirality of amino acids where the overwhelming majority of them are L forms even though there is no physical restriction on the creation of the D form. Similarly the DNA double helix is right-handed in almost all cases.

    One interesting thing about this is that if we were to find a planet filled with plants made up of D amino acids and left-handed DNA we may find ourselves unable to consume those plants for nutritional value.

    --
    Damn_registrars has no butt-hole. Damn_registrars has no use for a butt-hole.
  7. The definition of life? by goombah99 · · Score: 5, Interesting

    If we define life as the ability to organize and propopagate information then the highest form of life is a salt crystal or any self propagating organization of atoms with long range order. A diamond has far lower entropy than any living system. Like wise if we define it as system that processes energy to propogate itself then we have Fire as the ultimate for of life.

    clearly gasses (disorded are dead) and crystals are dead. SO is life a liquid (in the middle of the two)? Again obviously not.

    The best definition of a living system in terms of information tehory concepts I have come across is the one by David Wolpert who coined in the term self-dissimilarity in reaction to the vogue study of self-similarity in self-organizing systems. For example, a pile of sand is self-organizing system that is ever changing but also ever-self simmilar. it's not alive either

    so solids, liquids, gasses and self-simmilar self organizing systems are all bankrupt as a informational definition of life. What's self-dissimilarity then?

    It's the concept that the organizational principles of a system can suddenly change as one crosses scales.

    imagine one zooms out from a microsope from the atomic scale. at first you see the atom and it has some interesting symmetires in the way the electron oribits have some simmilarities. at a higher scale we see the molecule. then the collection of molecules. soon we see the patterning of molecules.
    we observe that this is infact cell. then many cells. then it's an organ. then its many organs. then an animal. then a school of fish. then zooming our we see schools of fish separated across the ocean.

    the key insight is this. at each scale everything you infer about the information content and predictibitly of adjaceny in the pattern works to predict the patterns propoagation at a slightly larger zoom. Up until it suddenly fails. you reach the edge of the liver or the edge of the cell or the edge of the animal. then the lower scale is useless in predicting how the next scale up is organized.

    these abrupt steps in dissimilarity is a halmark of living systems. the degree of information gain at the step is phenomenal. this is different than saying for example that a composite rock is alive. the difference is that the system is processing information and energy across these organizational boundaries. that's pretty much the best definition of life interms of a single defintion that can be plotted on a graph. the x-axis is the zoom, and the y-axis is the predictability of the next larger scale from the lower one. you see steps. that plus the processing of information across steps is a living system. If you accept this you might feel like their are non-traditional defintiions of life as well. for example, if a bacteria is living thing, is it possible that a community of bacteria is also a lvifing thing. Perhaps the earth is too.

    What's intriguing here is that systems with this property may imprint themselves on other systems. you might for example be able to spot radio emissions or atmospheric molecular composition that displays the imprint of dissimilar steps in it's self organization.

    SO unless this theory considers this, I'm skeptical about it. Salt is self organizing but it's not alive. It is however highly probable. Indeed eutectic separation is highly propable but it's just physics not life.

    --
    Some drink at the fountain of knowledge. Others just gargle.
    1. Re:The definition of life? by goombah99 · · Score: 4, Interesting

      Since I seem to be dismissing that paper for trying to use thermodynamics to define the probability of a living system I wanted to quickly add that I am explicitly not dismission it. I'm dismissing the summary that conflating the definition of life with a lower bound on it's thermodynamic probability. Often times thermodynamic bounds are very useful in ruling out how something did not happen and to identify the high probability way something could have happened.

      Take for example, the observation that most complex living systems are beautiful as well. Why are they beautiful to us. I think it is because they visually have organization. And the single most obvious facet of organization are symmetries at large scale. For example, atomically speaking your eyes are very far apart. Yet your body has this beautiful bilateral symmetry.

      THe obvious question is whether symmetries in living systems occur because living systems select for symmetry because there is an evolutionary advantage to it or because of thermodynamics.

      to see this take something simpler. The packing of seeds in a sunflower is optimal in some sense (fibonaci) yet one might believe there's a chance it's just a thermodynamic accident not a careful selection.

      In fact drill down a little more and consider the fact that nearly all proteins in your body form homo dimers that are symmetric.

      an interesting paper
      http://www.ncbi.nlm.nih.gov/pu...

      comes to the stunning conclusion that this symmetry is not from evolutionary selection! it's overwhelmingly improbable that function can arise from random collisions between proteins, and the only likely way two proteins can collide and form a low energy conformation that last long enough to perform a function is for collisions that form a symmetrical arrangement. Almost all other collisions wont last long enough for the dimer to perform a function (such as catalyzing production of a useful metabolite). Since Natural selection cannot operate on anything that doesn't do something to increase fitness this means that assymetric collisions are completely invisible to the organism. Therefore thermodynmics can rightfully claim that nearly all protein symmetry arrises simply from thermodynamic probability not from natural selection having a prefernce for symmetry. This is not to say that symmetry has no selectable characteristics. It's just that at the molecular level, those selectable characteristics are not required to explain the emergence of symmetry as we observe it. The frequency that we observe symmetric versus asymmetric homo dimers of proteins is exactly the frequency we would expect at random due to thermodynamics.

      Thus the interesting thing about this new work in thermodynamics is it sets a lower bound on the conditions needed for life to emerge. It does not however define the probability of life emerging.

      --
      Some drink at the fountain of knowledge. Others just gargle.
    2. Re:The definition of life? by Anonymous Coward · · Score: 2, Informative

      Even starting with you assumption, life is much more complex and it seems to me has much lower entropy than any diamond.

      You are making my point for me. The only reason you beleive life is more complex than a diamond is because of the complexity of it's many different kinds of organization. a diamond is a very simple organization based on a single organizing principle. (and so I might add is DNA oligomerization which is what the author of the paper is discussing). But a living cell has many different kinds of organization whos infomration partioning and propagation seems very non-random.

      and yet the diamond has lower entropy than the cell.

      so thanks for making my point.

  8. What? by Grizzley9 · · Score: 4, Funny

    environments favorable to life are unlikely to be unusual.

    How can you not argue against not having that be untrue?

  9. The web of life... by Dimwit · · Score: 2

    I blew my wife's mind the other day when I pointed out that we are literally just a small component of a single, globe-spanning, four billion year long chemical reaction. A single, very long running checmial reaction. It's pretty neat when you think about it.

    --
    ...but it's being eaten...by some...Linux or something...
    1. Re:The web of life... by halivar · · Score: 2

      I blew my wife's mind the other day

      Did you mean to post AC? This is admissible in court, you know.

  10. Re:Life may be common, but not always as we know i by John_Sauter · · Score: 4, Funny

    ....if we were to find a planet filled with plants made up of D amino acids and left-handed DNA we may find ourselves unable to consume those plants for nutritional value.

    More importantly, they would not be able to consume us for nutritional value.

  11. Re:Life may be common, but not always as we know i by gstoddart · · Score: 3, Insightful

    More importantly, they would not be able to consume us for nutritional value.

    So, we'd be junk food?

    Great, that makes me feel much better. :-P

    --
    Lost at C:>. Found at C.
  12. Re:Empirical Data Trumps Information Theory by Bengie · · Score: 2

    We also assume information cannot travel through space faster than c, so we put a restriction on how fast DNA can spread. Or should we assume this is wrong until we prove that it cannot happen via empirical evidence?

  13. Gibbs Free Energy by Geoffrey.landis · · Score: 2

    Meh. Information is basically tied to entropy. You can reduce entropy (which is to say, you can order information); it just takes energy to do so (and in the process releasing waste heat).

    So, basically, this says nothing more useful than "Life requires a source of free energy, and a way to reject waste heat."

    Sure, but we knew that already.

    --
    http://www.geoffreylandis.com
    1. Re:Gibbs Free Energy by gtall · · Score: 2

      No, it puts quantitative limits on what is to be expected. That's quite different from your qualitative results which we know.

    2. Re:Gibbs Free Energy by Geoffrey.landis · · Score: 2

      No, it puts quantitative limits on what is to be expected.

      Delta G = Delta H - T Delta S

      where S = k ln (omega)

      Any other quesitons?

      --
      http://www.geoffreylandis.com
    3. Re:Gibbs Free Energy by DamnOregonian · · Score: 5, Informative

      Costs more in what sense? Energy cost? Lines of code cost? Time cost? In any event, it is not something that I consider when zipping a file. Zip and unzip are treated as equivalent from the user's standpoint.

      The great thing about the universe (and information theory) is that it's flexible in how the cost be paid, but the laws of thermodynamics apply all the way down the chain. Zipping can cost more in memory, or more in CPU cycles. The fact that it's the same to you doesn't really matter. It's not the same to the things doing the work.

      The point that confuses me is: the energy on the outside lens surface can't light a fire, but the energy produced by the glass can.

      The energy hitting the outside of the glass *can* light a fire. It's simply spread over too wide of an area. In the same way that all the potential energy in the gap between the clouds and the ground doesn't immediately kill you, as it exists at all times. It requires a mechanism to focus it before it becomes fatal. The poles are cooler than the equator not because there is less sunlight passing through a square meter of space above them as opposed to the equator, but because the earth sits at a less perpendicular angle to that light, so it is spread out over more area.
      You can simulate this effect by angling your magnifying glass in such a way as the focused dot obliquely hits the object-to-be-burned enough to spread out the energy again (let entropy do its thing)

      How is the lens doing any work, in that sense?

      The lens is doing work via diffraction. Light can't just be redirected by anything but the curvature of space. While that lens looks transparent, what is actually happening is the light is being aborbed by every atom (or electron, more precisely) it hits, and then re-emitted as an all-new photon with a change of direction that follows a statistical set of rules that focuses it (based on the diffraction qualities of the lens). The absorption and re-emission has a cost, it's not free.

    4. Re:Gibbs Free Energy by Electricity+Likes+Me · · Score: 2

      Zipping a file takes energy to power the CPU. Unzipping does too. In both cases, global entropy has been increased.

  14. in other words... by buddyglass · · Score: 3, Interesting

    This is bad news for humanity.

    1. Re:in other words... by jeffb+(2.718) · · Score: 4, Interesting

      Nonsense.

      The argument seems to be that, because we don't see "evidence of technological activity" when we look out at the universe, intelligence leading to technological culture must be rare or absent. If an entity or a culture doesn't cause huge, recognizable perturbations in its environment, it must not represent "intelligence".

      Think of an electrical engineer from the 1880s studying the data cables that run through a modern city. He might cut into a cable, expecting to find a wire carrying electrical impulses. Instead, he sees a bundle of glass fibers, glowing brightly if he nicks or breaks them. No tools at his disposal would let him even detect the gigahertz-scale fluctuations in that light.

      For that matter, consider a 1960s "exobiologist" trying to decode an intercepted 2014 video stream. If you told him it was image data, he might look for periodicities that would let him determine rows, columns, and pixels. In an MPEG-compressed stream, he wouldn't get far. Heaven help him if it's DRMed.

      My point: the things we look for as evidence of technological civilization may just be evidence of insufficiently advanced technological civilization. The "filters" we fear -- nuclear annihilation, bioterror, grey goo -- may indeed claim a lot of civilizations, or they may be laughably uncommon. It seems to me most likely that, instead of trying and failing to build space-opera-scope interstellar empires, most civilizations simply grow into something that we aren't yet sophisticated enough to notice.

  15. Re:Empirical Data Trumps Information Theory by gweihir · · Score: 4, Insightful

    This is not information theory or quantum theory, this is Information Theory and Quantum Theory. It is astonishing that there are still people around that do not understand the difference and claim they are "just theories". No. They are not. Apparently the educational system is far worse then generally assumed.

    --
    Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
  16. More Complicated Than That by Baby+Duck · · Score: 2

    a key property that distinguishes living from non-living systems: their ability to store information and replicate it almost indefinitely.

    As Douglas Hofstadter pointed out, it's actually more complicated than merely indefinite replication. It has to allow variance while still retaining the ability to replicate. Sure, there are clones everywhere, especially outside the animal kingdom, and they still considered "living". So the quote is still technically true. But it doesn't capture how immensely more difficult it was for life we observe here on Earth to come about. It also raises an interesting question. Did non-varying life have to come about first, in order to saturate the environment with organic compounds? Did the varying life then come about later, piggy-backing on this enriched environment? Or can you go straight from an abiotic world to varying life?

    --

    "Love heals scars love left." -- Henry Rollins

  17. Re:Unusual in a huge system ... by sgunhouse · · Score: 2

    For some definitions of likely and usual anyway. In probability, "unlikely" generally has a specific meaning defined in the paper, hence "not unlikely" is not necessarily likely. Probably not unique anyway.

  18. Re:Empirical Data Trumps Information Theory by sudon't · · Score: 2

    There's a difference between the colloquial use of the word "theory" and the scientific use, which many people don't understand. In the colloquial use, "theory" means "hypothesis," so that the layman becomes confused when it's used in science. Hence expressions like, "only a theory." Even educated people will use expressions like, "Gravity is only a theory," as if that explained anything.

    But this is how language works. Meanings shift through use (or misuse) over time. Think of how the word "addiction" is now used to describe anything from actual addiction, to compulsive behavior, to anything you might enjoy, or do, often. The meaning has become so watered-down that I believe we may need a new word to describe actual addiction. Perhaps the same is true of "theory?"

    --
    -- sudon't

    Air-ride Equipped