Slashdot Mirror


Evolution and the 'Wisdom of Crowds'

An anonymous reader writes "An essay by a developer of recommendation systems makes a case for why so many people have trouble grasping Darwin's theory of evolution. Downplaying its conflict with religion, the essay suggests that evolution is in a specific class of "equilibrium seeking" concepts that tend to be extremely counterintuitive to most people. The hypothesis is supported by the observation that so many people reject the notion that evolution-like systems such as Wikipedia, prediction markets, and recommendation systems can actually be effective. Particularly fascinating is the description of his surprisingly simple algorithm for competing in the Netflix prize contest."

15 of 804 comments (clear)

  1. Eh. by Desipis · · Score: 4, Insightful

    The hypothesis is supported by the observation that so many people reject the notion that evolution-like systems such as Wikipedia, prediction markets, and recommendation systems can actually be effective.

    While there may be many that reject that these systems can be effective at all, I'd suggest that there's many more that would actual argue that while these systems do work, they aren't necessarily the best or only method that is effective.

  2. the wisdom of the crowds by jacquesm · · Score: 4, Insightful

    Is a great theoretical concept, but unfortunately it only makes sense in the context of assuming that everybody really thinks for themselves. As soon as the media enter into the equation the crowd becomes as manipulatable as the most stupid upper limit that can still be sold a bill of goods. If that's > 50% then the equation no longer holds, no matter how much the rest invests in staying educated. You'd almost have to filter out media bias somehow because otherwise anybody with an agenda and some money to burn will come out on top. Witness politics, marketing of unnecssary goods and services and so on.

  3. I can't wait for this meme to die. by oncehour · · Score: 5, Insightful

    As the parent mentioned, the "Wisdom of Crowds" put Bush in power. Honestly, it seems to me to be nothing more than overhyped bullshit pushed alongside "Web 2.0" and other over-hyped concepts that are filling the current bubble with hot air. People love to cite Wikipedia as proof of the wisdom of crowds, but let's stop and analyze that for a moment:

    Who controls the content of Wikipedia articles? Is it a large crowd of seemingly random contributors each imparting their own bits of wisdom? Or is it a small set of contributors providing the base of an article with a few mostly minor revisions submitted by random people passing by? In my experience, it's the latter. Usually a small set of people, no more than 3 to 5 which make the core of a Wikipedia article.

    These same people are also generally the ones that cultivate the article and keep it consistent and well editted. Occasionally these same few people come to disagreements and end up in "edit wars" in which they call in another set of few members interested in judging to judge the issue. There's no "crowd" at work here, it's a lot of small groups of vested individuals who have interest in a particular domain and an efficient way of contributing and collaborating in that domain.

    There may be hundreds of such groups, but they typically stick to their domain or they become edit whores and stick to minor revisionary work on a large amount of articles. Either way, I don't see much of a "crowd" once I break it down and look close, much less a wise crowd. Have you ever noticed that different subsections of Wikipedia have their own "feel" or "identity"? Maybe the particular manner of phrasing or the type of consistency shown throughout that sub-section which differs somewhat from another unrelated domain. This is largely a result of edits by the aforementioned small group of vested individuals. Each group leaves their own tint which colors a section and gives it life.

    Wisdom of Crowds? No. Small, intelligent groups of people focused on achieving a well defined goal? Yes. If you really want to test this "Wisdom of Crowds" concept, take a look at SomethingAwful.com or any of the various large web forums and learn of the "Wisdom of Crowds". Even there, it's generally a very few amount of people contributing intelligently with the rest just being meaningless drivel. This meme needs to die.

  4. Creationism and Evolution Artificially at Odds? by Jayde+Stargunner · · Score: 5, Insightful

    "Conventional wisdom says that the primary reason why so many people do not accept Darwin's theory of evolution is that they find it threatening to their religious beliefs. There is no question that religion is a big part of the reason behind the large number of people who reject evolution. But I am convinced that just as often, the cause and effect is reversed: people hold onto their fundamentalist religious beliefs because evolution by natural selection -- the strongest argument against an Old Testament-type creator -- is so counter-intuitive to so many."

    Honestly, I find these kinds of statements to be a bit off-base. I really get the feeling that Creationism and Evolution/Darwinism are artificially pitted against each other as if one or the other has to "win."

    The interesting thing is that there is absolutely nothing in either of the standpoints that cannot coexist with the other. I would say that the consistant framing of them being exclusive is what causes resistance (from both sides, most likey) when it isn't even needed.

    If one wants to get anyone to believe in a scientific theory they are having difficulties with, framing it as, "you should believe this because what you believe is wrong and you are stupid," is not really going to win anyone over. Especially when one could easily take the stance of, "here's why this theory makes sense, and really it doesn't have anything to do with what you may or may not believe."

    I've seen no strong theology that would rule out that evolution did not happen. Creationism is about a supernatural force overseeing things--it says nothing specific about how things actually happened. (And, I think, most theologists will agree that Genesis is highly metaphorical.)

    So, bottom line is, if science-minded people want others to "see the light" on this one, stick to the facts and leave the religion-bashing alone. Making people defensive generally is not an effective way of getting an idea across.

    --
    What's a sig?
  5. Re:He doesn't address the evolution of ideas by Smidge204 · · Score: 4, Insightful

    "Men never do evil so completely and cheerfully as when they do it from religious conviction."

    Historically, some of the worst atrocities have been carried out in the name of God. While your idea has merit for a very young civilizations, religion as a means of social control became obsolete as soon as secular law was invented. Since then it's only been abused to manipulate and extort people, at least on a scale that has any impact on society as a whole. (Exceptions made for those small groups who actually practice what they preach.)

    Evolution is a pretty slow process... I guess 3000 years or so isn't quite long enough to breed out the religious nutjobs.
    =Smidge=

  6. Re:typo by OeLeWaPpErKe · · Score: 5, Insightful

    I do not just think that. And yes, for the moment this is not going to happen in (most of) America.

    muslims inside england use terror to avoid evolution in biology lessons :
    http://forums.muslimvillage.net/index.php?showtopic=37975

    in france:
    http://islamineurope.blogspot.com/2007/02/france-muslim-anti-evolutionist.html

    This is in Turkey, the most moderate muslim nation existing (where both islamists and atheists massacre eachother, creating a balance) :
    http://www.nytimes.com/2007/07/17/science/17book.html?_r=1&oref=slogin

    If you thought Christians are trouble when it concerns evolution, you're in for a rude awakening. Christians don't kill you. Don't threaten you. And they don't gang up on your family just because you don't "respect" creationism. Muslims do.

  7. Randomness by pubjames · · Score: 4, Insightful


    I think the main problem with people's understanding of evolution is the fact that it is not taught very well in schools, and people get the strong idea that evolution is a random process. I also think it is a problem with the timescales involved, which are hard for the human mind to grasp.

  8. Re:typo by ultranova · · Score: 4, Insightful

    All religions seem to be awash with variations, each sure they are the One True Version and that the others are deluded.

    That's true of humans in general. Religions don't have a monopoly on arrogance.

    --

    Forget magic. Any technology distinguishable from divine power is insufficiently advanced.

  9. Religion vs Darwin vs Technology vs Society by asliarun · · Score: 5, Insightful

    why so many *Americans* have trouble grasping Darwin's theory of evolution IMHO, the reason why this is so difficult is because of the awe and wonder (and fear!) we feel when we see the magnificent complexity and interconnectedness in the nature around us. We are today not very different from our cavemen ancestors in the sense that we still go through most of our lives in a state of bewilderment, and most of our efforts focus on bringing some measure of control and understanding over the complexity that is bombarding us every minute! Technological evolution for that matter is not very different from biological evolution. The only advantage we have with technological evolution is that it is evolving in our lifetime. Trying to make your grandparent understand modern technology is probably as difficult as making them understand evolution and the related nuances such as game theory and Nash equilibrium. This is merely because the said technology of our time did not evolve with our grandparents, but with us. For our grandparents, this is simply a case of trying to cope with future evolution instead of past evolution as is the case with the Darwinian/Dawkinsian theory.

    What is happening today to the common man is that he/she is getting immune to technology, which leads us to the possibly false premise that the lay person understands technology any better than say, evolution. Given this assault of seemingly illogical and complex information (which completely undermines a person's ego, mind you), religion provides a very convenient framework to make life simple, seemingly secure, and less fragile. Religion is hence, more of a survival tool for a society that shields away a person's insecurities. For that matter, that is the reason why societies and families formed in the first place, which is to increase the probability of our survival and proliferation. For the common man, religion and society practically mean the same thing, and hence interchangeably attribute the positive aspects of one with the other. This is also why they are willing to put up with the restrictions and rules of religion, just as we do for society's laws and restrictions!
  10. Re:typo by clickclickdrone · · Score: 4, Insightful

    >Christians don't kill you. Don't threaten you
    There is a theatre production by the Reduced Shakespeare Company where they do the entire bible in 90 mins or somesuch. *Everytime* I have seen it there have been jossling, abusive Christians outside telling me I was going to hell for watching it. I've also numerous reports of people killing in the name of Christianity. I think we need to be clear on this, all religions, whether Muslim, Christian or whatever have extremist factions and that's where the problems are. the mainstream ones are generally fairly laid back.

    --
    I want a list of atrocities done in your name - Recoil
  11. Re:"Wisdom Of Crowds" by richieb · · Score: 4, Insightful
    The "Wisdom Of Crowds" put George W Bush in power, twice.

    Actually in 2000 the "wisdom of the crowds" picked Al Gore. The electoral college and the Supreme Court put GW in the Whitehouse.

    --
    ...richie - It is a good day to code.
  12. Darwin's theory of natural selection by KnightTristan · · Score: 5, Insightful

    Are you kidding me? Calling Darwin's theory a theory of random mutation show how little you understand of it, because you emphasize the wrong half of his theory. There's basically two parts about Darwin's theory: (1) mutation and (2) selection. Most people consider the first one as most important, but nothing could be further from the truth than that. It's SELECTION that is the keyword here. The mutation part is merely the "fuel" that feeds the selection "engine". In fact, the mutation doesn't even need to be random at all. Let me say that again:

    The mutation in Darwin's theory does NOT have to be random!

    Although random mutation is perhaps the most effective way compared to its complexity. It surely is the most simple way for nature to "implement" it. And most of the time it results in very good "fuel". About your example: although the mutations are made by intelligent designers, some designs are rejected and some accepted (to be built further upon). The mutations are not random, but the selection is still in place. That's good enough.

    So if you don't want to call Darwin's theory a theory of evolution, call it a THEORY OF NATURAL SELECTION instead.

    Keep in mind: you do not need DNA, big gene pools, parallel mutations, sexual mutations, ... to have a Darwinian evolution at work. It doesn't have to reflect the biological method of evolution at all. At its core you only need (1) mutation (2) selection. Once you have that, you have Darwinian evolution. I believe it was Richard Dawkins who coined the term MEME to apply Darwin's theory to cultural evolution! Though it is has entirely different mechanism than biological evolution, it still consists of mutation and selection. Not all variants work equally well though: sexual mutation seem to work better than asexual mutations , cultural evolution is much faster than biological evolution, because the latter can only pass information between generations what is very slow. The evolution of mankind in the last few thousands of years are mostly cultural driven.

  13. Re:This is a stupid conclusion by dave420 · · Score: 4, Insightful

    Evolution, in the Darwinian natural sense, is accumulative, not completely random. Richard Dawkins explains it very well in "The Blind Watch Maker". Wikipedia's content is just like evolution. Articles are first created (and as we know, the theory of evolution does not cover actual creation of life, but how it changes), and are slowly perfected, with each "edit" being a mutation/new trait in the gene pool which is carried on to the next generation. The parts of the article which are not altered are analogous to genes which are not affecting the "organism" of the article as severely (either positively or negatively) as the change which was effected. As an article reaches its most suitable state, where further edits are not required, you have an article that is completely correct, with no "genes" (edits) that need removing/adding.

    The notion of n monkeys typing randomly is used to illustrate the absurdity of evolution. It would be a great illustration if it were not intrinsically flawed from its very conception. A better analogy would be, again as Richard Dawkins again demonstrated in said documentary/book, that each change the monkeys made that took their current works of Shakespeare away from the actual works of Shakespeare were ignored, or favoured less, than changes which improved the similarity of the monkeys' work with that of Shakespeare.

    So, in a nutshell, it's similar to evolution as you clearly don't understand evolution enough to ask that question :)

  14. Re:He doesn't address the evolution of ideas by rthille · · Score: 4, Insightful

    No, you can't say that a world of atheists would be a better or worse world, since a world of people who don't believe in God isn't really different from a world of people who don't believe in pink unicorns or celestial teapots. Saying what someone doesn't believe doesn't tell you enough about what they do believe.

    --
    Awesome furniture, accessories and cabinetry in Santa Rosa, CA: http://humanity-home.com/
  15. Re:He doesn't address the evolution of ideas by mdwh2 · · Score: 4, Insightful

    1. Hitler was not an atheist. I don't know why this myth keeps coming up so often. His religious beliefs are unclear, but he referred to "God" at various times, and there seems to be no evidence of him actually being an atheist.

    2. The claim is not "some people who happened to be theists also did bad things", but rather that "people did bad things in the name of their religious belief". If you want to counter that, you need to show how someone's lack of belief caused them to do bad things.