Slashdot Mirror


Evolution and the 'Wisdom of Crowds'

An anonymous reader writes "An essay by a developer of recommendation systems makes a case for why so many people have trouble grasping Darwin's theory of evolution. Downplaying its conflict with religion, the essay suggests that evolution is in a specific class of "equilibrium seeking" concepts that tend to be extremely counterintuitive to most people. The hypothesis is supported by the observation that so many people reject the notion that evolution-like systems such as Wikipedia, prediction markets, and recommendation systems can actually be effective. Particularly fascinating is the description of his surprisingly simple algorithm for competing in the Netflix prize contest."

10 of 804 comments (clear)

  1. I can't wait for this meme to die. by oncehour · · Score: 5, Insightful

    As the parent mentioned, the "Wisdom of Crowds" put Bush in power. Honestly, it seems to me to be nothing more than overhyped bullshit pushed alongside "Web 2.0" and other over-hyped concepts that are filling the current bubble with hot air. People love to cite Wikipedia as proof of the wisdom of crowds, but let's stop and analyze that for a moment:

    Who controls the content of Wikipedia articles? Is it a large crowd of seemingly random contributors each imparting their own bits of wisdom? Or is it a small set of contributors providing the base of an article with a few mostly minor revisions submitted by random people passing by? In my experience, it's the latter. Usually a small set of people, no more than 3 to 5 which make the core of a Wikipedia article.

    These same people are also generally the ones that cultivate the article and keep it consistent and well editted. Occasionally these same few people come to disagreements and end up in "edit wars" in which they call in another set of few members interested in judging to judge the issue. There's no "crowd" at work here, it's a lot of small groups of vested individuals who have interest in a particular domain and an efficient way of contributing and collaborating in that domain.

    There may be hundreds of such groups, but they typically stick to their domain or they become edit whores and stick to minor revisionary work on a large amount of articles. Either way, I don't see much of a "crowd" once I break it down and look close, much less a wise crowd. Have you ever noticed that different subsections of Wikipedia have their own "feel" or "identity"? Maybe the particular manner of phrasing or the type of consistency shown throughout that sub-section which differs somewhat from another unrelated domain. This is largely a result of edits by the aforementioned small group of vested individuals. Each group leaves their own tint which colors a section and gives it life.

    Wisdom of Crowds? No. Small, intelligent groups of people focused on achieving a well defined goal? Yes. If you really want to test this "Wisdom of Crowds" concept, take a look at SomethingAwful.com or any of the various large web forums and learn of the "Wisdom of Crowds". Even there, it's generally a very few amount of people contributing intelligently with the rest just being meaningless drivel. This meme needs to die.

  2. Re:typo by vadim_t · · Score: 5, Informative

    Actually it's largely an American thing.

    I brought this subject up several times in a conversation with europeans. Those who don't follow slashdot and similar sites hadn't heard about the concept of "intelligent design" at all, and needed it explained. And all of them went "WTF?" at the explanation.

    The vast majority of the population hasn't even heard of ID. All the religious arguments I participated in (and there were quite a few) always revolved around the existence/inexistence of a deity, evolution wasn't brought up even once.

  3. He doesn't address the evolution of ideas by Chapter80 · · Score: 5, Interesting
    Interesting discussion, but the obvious missing piece is the evolution of ideas.

    Societies may have "invented" the notion of religion because religion led to ethics, which led to less killing of their neighbors. All of the sudden, it's survival of the fittest, as non-ethical tribes tended to be killed off, while religious tribes thrived.

    An obvious second example is the notion of being against birth control (or for large families). Tribes that were for large families and passed those beliefs down to their children tended to grow.

    So my question is: Even if there is no God, and you are an atheist, is it possible that a world containing religious people is actually a "better" society than a world full of atheists? The Earth's people evolved into a world of mixed beliefs (some religious, some not), which could be argued to be the survival of the fittest idea or world. The mixed-belief world appears to be the "fittest" world, as opposed to such less-fit worlds of all atheists or all Christians, as examples.

    If we evolved to be a mixed world of beliefs, as the "fittest", perhaps we should accept that, and quit trying to convert people with arguments for our favorite religious/non-religious belief.

  4. Creationism and Evolution Artificially at Odds? by Jayde+Stargunner · · Score: 5, Insightful

    "Conventional wisdom says that the primary reason why so many people do not accept Darwin's theory of evolution is that they find it threatening to their religious beliefs. There is no question that religion is a big part of the reason behind the large number of people who reject evolution. But I am convinced that just as often, the cause and effect is reversed: people hold onto their fundamentalist religious beliefs because evolution by natural selection -- the strongest argument against an Old Testament-type creator -- is so counter-intuitive to so many."

    Honestly, I find these kinds of statements to be a bit off-base. I really get the feeling that Creationism and Evolution/Darwinism are artificially pitted against each other as if one or the other has to "win."

    The interesting thing is that there is absolutely nothing in either of the standpoints that cannot coexist with the other. I would say that the consistant framing of them being exclusive is what causes resistance (from both sides, most likey) when it isn't even needed.

    If one wants to get anyone to believe in a scientific theory they are having difficulties with, framing it as, "you should believe this because what you believe is wrong and you are stupid," is not really going to win anyone over. Especially when one could easily take the stance of, "here's why this theory makes sense, and really it doesn't have anything to do with what you may or may not believe."

    I've seen no strong theology that would rule out that evolution did not happen. Creationism is about a supernatural force overseeing things--it says nothing specific about how things actually happened. (And, I think, most theologists will agree that Genesis is highly metaphorical.)

    So, bottom line is, if science-minded people want others to "see the light" on this one, stick to the facts and leave the religion-bashing alone. Making people defensive generally is not an effective way of getting an idea across.

    --
    What's a sig?
  5. Re:typo by OeLeWaPpErKe · · Score: 5, Insightful

    I do not just think that. And yes, for the moment this is not going to happen in (most of) America.

    muslims inside england use terror to avoid evolution in biology lessons :
    http://forums.muslimvillage.net/index.php?showtopic=37975

    in france:
    http://islamineurope.blogspot.com/2007/02/france-muslim-anti-evolutionist.html

    This is in Turkey, the most moderate muslim nation existing (where both islamists and atheists massacre eachother, creating a balance) :
    http://www.nytimes.com/2007/07/17/science/17book.html?_r=1&oref=slogin

    If you thought Christians are trouble when it concerns evolution, you're in for a rude awakening. Christians don't kill you. Don't threaten you. And they don't gang up on your family just because you don't "respect" creationism. Muslims do.

  6. Religion vs Darwin vs Technology vs Society by asliarun · · Score: 5, Insightful

    why so many *Americans* have trouble grasping Darwin's theory of evolution IMHO, the reason why this is so difficult is because of the awe and wonder (and fear!) we feel when we see the magnificent complexity and interconnectedness in the nature around us. We are today not very different from our cavemen ancestors in the sense that we still go through most of our lives in a state of bewilderment, and most of our efforts focus on bringing some measure of control and understanding over the complexity that is bombarding us every minute! Technological evolution for that matter is not very different from biological evolution. The only advantage we have with technological evolution is that it is evolving in our lifetime. Trying to make your grandparent understand modern technology is probably as difficult as making them understand evolution and the related nuances such as game theory and Nash equilibrium. This is merely because the said technology of our time did not evolve with our grandparents, but with us. For our grandparents, this is simply a case of trying to cope with future evolution instead of past evolution as is the case with the Darwinian/Dawkinsian theory.

    What is happening today to the common man is that he/she is getting immune to technology, which leads us to the possibly false premise that the lay person understands technology any better than say, evolution. Given this assault of seemingly illogical and complex information (which completely undermines a person's ego, mind you), religion provides a very convenient framework to make life simple, seemingly secure, and less fragile. Religion is hence, more of a survival tool for a society that shields away a person's insecurities. For that matter, that is the reason why societies and families formed in the first place, which is to increase the probability of our survival and proliferation. For the common man, religion and society practically mean the same thing, and hence interchangeably attribute the positive aspects of one with the other. This is also why they are willing to put up with the restrictions and rules of religion, just as we do for society's laws and restrictions!
    1. Re:Religion vs Darwin vs Technology vs Society by rucs_hack · · Score: 5, Interesting

      IMHO, the reason why this is so difficult is because of the awe and wonder (and fear!) we feel when we see the magnificent complexity and interconnectedness in the nature around us

      Apart from the fear thing, I have exactly that reason to explain why I have always believed in evolution (since reading about it myself in a book at 7). Even then I was struck by the vastness of the universe, and the idea that some god person had made it all seemed a bit too simple. Even then I was utterly fascinated by astronomy, and looking at the night sky, especially in Australia, where we actually had a visible star scape, was an experience that filled me not with religious conviction, but with a determination to find explanations for what I saw. 'God did it' was never an option.

      Having grown up now I realise why so many people need to believe in the biblical creation myth. Believe that and everything becomes easy, simple enough that you don't have to worry about it. Reject it and boy have you got a lot of work to do. For one thing you actually have to understand things, not pass it of as 'the work of god'.

      I find it amusing that creationists/ID'ers seem to want a stupid god, incapable of anything but focusing on one planet in the vast universe, as interested in the fall of birds (why is it always bad stuff?) then the formation of galaxies. I prefer the idea that if god exists, he was smart enough to set things in motion at some point (at the start of this universe? a previous one, no idea), and it all works without intervention. Of course this implies that there is no god, since a system that does not require a god to run doesn't need one to exist at all.

    2. Re:Religion vs Darwin vs Technology vs Society by Hognoxious · · Score: 5, Funny

      One extra thing which I thought about was why the bloody hell would a God create us?
      Have you ever drunk a lot of beer, woken up the next morning and gone through that special "I did what?" moment?
      --
      Confucius say, "Find worm in apple - bad. Find half a worm - worse."
  7. Darwin's theory of natural selection by KnightTristan · · Score: 5, Insightful

    Are you kidding me? Calling Darwin's theory a theory of random mutation show how little you understand of it, because you emphasize the wrong half of his theory. There's basically two parts about Darwin's theory: (1) mutation and (2) selection. Most people consider the first one as most important, but nothing could be further from the truth than that. It's SELECTION that is the keyword here. The mutation part is merely the "fuel" that feeds the selection "engine". In fact, the mutation doesn't even need to be random at all. Let me say that again:

    The mutation in Darwin's theory does NOT have to be random!

    Although random mutation is perhaps the most effective way compared to its complexity. It surely is the most simple way for nature to "implement" it. And most of the time it results in very good "fuel". About your example: although the mutations are made by intelligent designers, some designs are rejected and some accepted (to be built further upon). The mutations are not random, but the selection is still in place. That's good enough.

    So if you don't want to call Darwin's theory a theory of evolution, call it a THEORY OF NATURAL SELECTION instead.

    Keep in mind: you do not need DNA, big gene pools, parallel mutations, sexual mutations, ... to have a Darwinian evolution at work. It doesn't have to reflect the biological method of evolution at all. At its core you only need (1) mutation (2) selection. Once you have that, you have Darwinian evolution. I believe it was Richard Dawkins who coined the term MEME to apply Darwin's theory to cultural evolution! Though it is has entirely different mechanism than biological evolution, it still consists of mutation and selection. Not all variants work equally well though: sexual mutation seem to work better than asexual mutations , cultural evolution is much faster than biological evolution, because the latter can only pass information between generations what is very slow. The evolution of mankind in the last few thousands of years are mostly cultural driven.

  8. actually... by misanthrope101 · · Score: 5, Interesting

    Even if there is no God, and you are an atheist, is it possible that a world containing religious people is actually a "better" society than a world full of atheists?
    Well, no. Japan, Holland, Canada, and a slew of other nations have a lower instance of religious belief, and a lower rate of crime, lower infant mortality, etc. Even within the USA, the Bible Belt states (actually the Red States in general) have higher infant mortality rates, lower productivity rates, higher crime rates, worse education systems, along with being worse-off in a range of other criteria. It isn't a stark difference--I'm not saying they're in the dark ages--but the difference is easy to spot if you look at the data.

    And in one way or another, we're all atheists. Is the world worse off because people don't believe in Thor anymore?