Slashdot Mirror


Fooled by Randomness

Max Tardiveau writes "I just finished Nassim Nicholas Taleb's Fooled by Randomness. It is an enjoyable book, written engagingly by an interesting character -- the kind of book that makes you think twice about certain things (for instance, the fact that you're not dead: is that really because you're so darn good, or does dumb luck play a part?) Although written all the way back in 2001, this book is more relevant than ever, since one of its major topics is the impact of unpredictable events on markets, insurance, and our perception of life in general. In fact, Taleb makes a living from unforeseen events; these days, that seems like a rather cunning niche." Read on for the rest of his review of this book. Fooled by Randomness author Nassim Nicholas Taleb pages 220 publisher Texere rating 8 reviewer Max Tardiveau ISBN 1587990717 summary Debunking fallacies of observation, Taleb reminds us of the pervasive ineffables that complicate life at every turn.

The main topic of the book is the fact that all humans are simply terrible at judging probabilities. Taleb is a securities trader, so a lot of the book revolves around financial probabilities, but his argument is mainstream and requires absolutely no knowledge of the markets. The book details examples of people wildly misjudging risks and probabilities in many contexts. Often that misestimation is understandable in advance of certain events, but harder to excuse after they've occurred; Taleb hits pretty hard on what he calls "data snoopers," his term for people who back-fit theories to existing data.

One of the most notorious examples is the Bible code (which has been thoroughly debunked), but Taleb argues that analysts who spend their time trying to find patterns in historical market data are no different: if you try long enough and hard enough, you will unavoidably find apparent regularities, which can be extremely compelling when seen in isolation. In context, though, they dissolve into nothing but meaningless statistical anomalies. Taleb rightfully compares these searches for meaning to the famous monkeys and typewriters parable.

Taleb's best example of poor probability intuition is probably the infamous survivor bias, which is our tendency to be disproportionately impressed by success. We almost always ignore the fact that, for one success story, there are many failures. But we seldom hear about the failures (just like we never hear about the many theories that didn't fit the data). So it's all a game of numbers: out of 10,000 traders, a few are statistically bound to be successful, even if they are nothing more than lucky idiots. The fact that they succeeded does not mean anything. It doesn't mean that they are bad traders, but it doesn't mean that they are good traders either, because on average somebody had to succeed.

One of Taleb's hot buttons is that people tend to be too confident in what they know. He argues convincingly that we should take everything, including science, with a grain of salt. Writing about Karl Popper, he points out that there are only two kinds of scientific theories: those that are demonstrably false, and those that are not yet demonstrably false. An irksome (but sadly true) observation, yet most people behave as if what they know is eternal truth. One could of course argue that Popper's observation is but another kind of truth, but I tend to put a lot more trust in people who question what they know than in people who don't.

Another of Taleb's peeves is the human tendency to over-attribute every random event (the old post hoc, ergo propter hoc). For instance, a commentator saying that "the Dow went down ten points today on concerns about Iraq" is talking nonsense: there is no way anyone can tie such a small market move to any particular reason. I found this specific point (which in retrospect is blindingly obvious) especially enlightening, as I am embarrassed to admit that, until now, I just accepted those market comments at face value.

Taleb also has some fun at the expense of economists and analysts, especially those whose predictions turned out wrong, but who claim that the theories were in fact right, and that the facts simply weren't supposed to be that way. This is what he calls denial of history, and is common among investors and gamblers (the two being of course close cousins).

The style of the book is informal and funny, and often meandering. We hop from one topic to the next, which occasionally may detract from the book's continuity, but overall the author's points come through loud and clear. Ironically for a man who advocates self-doubt, Taleb is starkly self-confident, though not in an irritating way.

Taleb is an intriguing, multi-cultural, iconoclastic character that has been around Wall Street for a while, and now runs his own small firm. Malcolm Gladwell (author of The Tipping Point, an absolute must-read for anyone who owns a brain) has written an excellent article that shows how Taleb's reasoning runs counter to just about every bit of conventional Wall Street wisdom. If you're interested in the markets, especially derivatives, and how Taleb trounces most of Wall Street's voodoo doctors, this moderately technical interview from 1996 is worth reading too.

Overall, a warmly recommended book.

You can purchase Fooled by Randomness from bn.com. Slashdot welcomes readers' book reviews -- to see your own review here, read the book review guidelines, then visit the submission page.

214 comments

  1. Dumb Luck by Anonymous Coward · · Score: 3, Offtopic

    (for instance, the fact that you're not dead: is that really because you're so darn good, or does dumb luck play a part?)

    There are times where I feel like I should have died but I haven't. Falling off a ravine into a river, losing control of my car in a turn with traffic on the other side. Just dumb luck.

    1. Re:Dumb Luck by Wolfrider · · Score: 1

      Moderators on crack, parent post is NOT offtopic!!

      --
      .
      == WolfriderV6 == I'm willing to admit that *I just might* be wrong... Are you??
  2. Fooled by Randomness by Anonymous Coward · · Score: 5, Funny

    cat /dev/random > top_secret_data

    1. Re:Fooled by Randomness by Anonymous Coward · · Score: 0

      Isn't that what happens in Cryptonomicon?

  3. Good point! by Anonymous Coward · · Score: 4, Funny
    (for instance, the fact that you're not dead: is that really because you are so darn good, or does dumb luck play a part?)

    Good point. I'd say I'm that good and

    (ughhhh)

    NO CARRIER

    1. Re:Good point! by msheppard · · Score: 2, Funny

      Look, if he was dying, he wouldn't bother to carve 'aaggggh'. He'd just say it!
      Script

      M@

      --
      Krispy Cream is people
    2. Re:Good point! by Anonymous Coward · · Score: 0

      What if he was dictating?

    3. Re:Good point! by klparrot · · Score: 1
      NO CARRIER

      I wonder how many /. readers these days have actually seen this. Last time I can remember was probably at least 6 years ago.

      +++
      ATH

      NO CARRIER

  4. Conservative/Liberal take on it by SirSlud · · Score: 5, Interesting

    > (for instance, the fact that you're not dead: is that really because you're so darn good, or does dumb luck play a part?)

    Thats called the Just World mentality. Its not a Just World .. unfair things happen through dumb luck.

    I've found this is the single biggest commenality in partiasian schools of thought:

    Conservatives tend to think you are where you are because you deserved it. Dumb and lazy people are poor, smart and hard working people are rich. Dumb people get hit by trains, smart people comment on how dumb they are. Your situation is a result of your disposition.

    Liberals go the other way. Luck, circumstance, and opportunity play huge roles in where you are. Poor people are poor because of luck and circumstance. People get hit by trains because they might have just plain been unlucky. Your situation is a result of your environment, including dumb luck.

    Personally, this is the single biggest reason I can't stand conservatives. It bothers me to no end how capable they are of assuming that anybody in a bad situation is there because they deserve it.

    --
    "Old man yells at systemd"
    1. Re:Conservative/Liberal take on it by smack_attack · · Score: 4, Funny

      The only difference between liberals and conservatives these days is that they both think they can do socialism better than the other.

    2. Re:Conservative/Liberal take on it by EatHam · · Score: 4, Insightful

      I am a conservative. I don't think that *everyone* is where they are because they deserve it; just that there is a definate relation between action and reaction. So not everyone is in the position they are in because it's what they deserve, but they're not all in it because of bad luck either. I'm a firm believer that overall, hard work will improve your situation.

    3. Re:Conservative/Liberal take on it by SnowDog_2112 · · Score: 5, Insightful

      I think the truth is more complex than your cardboard liberals or conservatives would have us believe.

      The truth is that while some people may become successful or suffer terribly largely through luck, there are situations where you can drastically improve or destroy your life through your own choices.

      You can't blame everything on circumstance, but you can't take credit for every good thing that happens to you, either.

      That's why I can't stand cardboard conservatives or cardboard liberals. The world is so much more complicated than either of them give it credit for.

      (Yeah, I know, off-topic :) )

      --
      Not representing or approved by my company or anybody else.
    4. Re:Conservative/Liberal take on it by finkployd · · Score: 3, Insightful

      Conservatives tend to think you are where you are because you deserved it. Dumb and lazy people are poor, smart and hard working people are rich. Dumb people get hit by trains, smart people comment on how dumb they are. Your situation is a result of your disposition.

      Liberals go the other way. Luck, circumstance, and opportunity play huge roles in where you are. Poor people are poor because of luck and circumstance. People get hit by trains because they might have just plain been unlucky. Your situation is a result of your environment, including dumb luck.

      Personally, this is the single biggest reason I can't stand conservatives. It bothers me to no end how capable they are of assuming that anybody in a bad situation is there because they deserve it.


      This is why both hard line views annoy me. I imagine the truth is right smack in the middle of these two outlooks. It is just as much folly to assume everything is based on luck, and that hard work, skill, intelligence, whatever, have nothing to do with it.

      Finkployd

    5. Re:Conservative/Liberal take on it by CommieLib · · Score: 4, Insightful

      Thats called the Just World mentality. Its not a Just World .. unfair things happen through dumb luck.

      I've found this is the single biggest commenality in partiasian schools of thought:

      Conservatives tend to think you are where you are because you deserved it. Dumb and lazy people are poor, smart and hard working people are rich. Dumb people get hit by trains, smart people comment on how dumb they are. Your situation is a result of your disposition.


      As a conservative, I'll take the bait. I think that "deserve" is too complex an issue to really know (abused as a child, ends up as a criminal, etc.). It is a core conservative belief, however, that people's fates are in their own hands. I certainly won't sign on to that smart and hard working people automatically get rich, but I've had pretty extensive personal experience with why people end up poor:

      #1 reason: being part of a couple that gets pregnant outside of marriage. If you're the woman, you now have the financial burden of a child without the full support of a father. Additionally, you don't enjoy the economies of scale enjoyed when two or more income earners live together. If you're the father, the latter point still applies, and you have child support to pay.

      #2 Reason: not completing high school. In our society, for better or worse, this is a signal to all employers that you haven't got your shit together. There are, however, many cases where high school dropout succeed as entrepreneurs.

      #3 Reason: Drug / alcohol abuse. No explanation necessary, presumably.

      Here's the defining characterstic of a conservative: the belief that if someone works hard and consistently, they can improve their condition. Not everyone who believes this is a conservative, but if you don't believe it, you can't call yourself a conservative. To address your definition of a conservative, I would say that conservatives believe that in almost every circumstance, people are poor as a consequence of poor choices they made.

      So, I'm one of the kind of people you can't stand. I suspect that you don't know me very well. I believe that power over one's circumstances comes from persistent personal action and not from authority. Do people end up with bad luck out of no action of their own? Of course, everyday. But is that the defining circumstance of human existence, or is persistence, faith and audacity?

      --
      If your bitterest enemies are people who hack the heads off civilians, then I would say you're doing something right.
    6. Re:Conservative/Liberal take on it by avandesande · · Score: 0, Flamebait

      Liberals go the other way. Luck, circumstance, and opportunity play huge roles in where you are. Poor people are poor because of luck and circumstance. People get hit by trains because they might have just plain been unlucky. Your situation is a result of your environment, including dumb luck.

      This is why I hate liberals.

      --
      love is just extroverted narcissism
    7. Re:Conservative/Liberal take on it by Dun+Malg · · Score: 4, Insightful
      Liberals go the other way. Luck, circumstance, and opportunity play huge roles in where you are. Poor people are poor because of luck and circumstance. People get hit by trains because they might have just plain been unlucky. Your situation is a result of your environment, including dumb luck.

      So hard work does nothing, eh? It's all luck and circumstance. Pfff! Every time I've stopped worrking my situation got worse, and every time I started working again, it got better. What luck I must have had lately, since I've been doing better the whole 8 years I've been working where I am. I've even been lucky enough to have people pay me when I do side work for them on weekends!

      Are you on crack ?

      This is my favorite quote above:
      People get hit by trains because they might have just plain been unlucky

      Provably false. People get hit by trains because they're on the railroad tracks when the train goes by. This has nothing to do with luck, or circumstance. It has to do with bad decision making. Nobody's car ever "stalls out" on the tracks like in the movies. People try to "beat the train"... and fail.

      --
      If a job's not worth doing, it's not worth doing right.
    8. Re:Conservative/Liberal take on it by Anonymous Coward · · Score: 1

      And an equally good reason to hate liberals: Anyone who is in a bad situation is just a "victim", and had absolutely nothing to do with getting into their current situation.

      Successful people are just "lucky", or are just lucky over and over and over and over again, and therefore should share their "luck" with the "unlucky" unsuccessful people.

      Someone raise the BS flag--on both Conservatives *and* Liberals.

      JD

    9. Re:Conservative/Liberal take on it by Anonymous Coward · · Score: 0

      Nobody's car ever "stalls out" on the tracks like in the movies. People try to "beat the train"... and fail.

      Yes. Plus, if your car does stall out on the tracks, get the hell out of the car! If the gates were up when you drove on to the track, you will certainly have enough time.

      Also, when approaching a railroad crossing, you should open your window a bit so that you can hear the train even if the safety mechanisms are broken.

    10. Re:Conservative/Liberal take on it by Dun+Malg · · Score: 1
      Yes. Plus, if your car does stall out on the tracks, get the hell out of the car! If the gates were up when you drove on to the track, you will certainly have enough time.

      Also, when approaching a railroad crossing, you should open your window a bit so that you can hear the train even if the safety mechanisms are broken.

      Exactly! Turn down that thumpin' bass you're so dang proud of and maybe look up and down the track before you cross!

      --
      If a job's not worth doing, it's not worth doing right.
    11. Re:Conservative/Liberal take on it by wind · · Score: 1

      And you had the *luck* to be born in circumstances (be it your country, your parents, etc) that allows you to work hard and get ahead. Some people are born into circumstances where they could work 1000 times harder than you and are still stuck picking bananas/cocoa beans/whatever everyday with no savings and no hope of getting out.

      That said, I agree with one of the above posters. It's complicated and there's a mix of luck and work. Just for example, I'm really happy with my life, I've worked to get where I am, but I'm certainly willing to admit that I've been lucky, too. Lucky to have met someone that I could spend the rest of my life with in my early twenties to have support when I really needed it. Lucky that a great job became available right as I began looking for one.

    12. Re:Conservative/Liberal take on it by Lars+T. · · Score: 2, Insightful

      So all people who work three jobs and live in cardboard boxes should just work harder?

      --

      Lars T.

      To the guy who modded me down from perfect to terrible Karma - Apple haters still suck

    13. Re:Conservative/Liberal take on it by Anonymous Coward · · Score: 0

      Actually, the railroad tracks here pass through a road, and the road is slightly raised where they pass through. It is not uncommon for people's cars to get stuck on the raising; it has happened a couple times in the last few months. You may question why they never didn't get out of the car in time; but then again, you have never tried to force your door open when it was pushing into asphalt, I'll bet.
      The funny shape of the road has killed and nearly killed a few drivers. Ah, bad decision: driving.
      Yes, of course. Let's stop driving. In fact, let's never leave our homes; it's safer. Unless, of course, you mind getting hit by a crashing plane. What? Oh, sorry, well, you should dig an underground shelter and live in it.
      An underground shelter is a bad decision now, eh? Hrmm...
      When you die, I will come to your funeral, laugh, and say "What a moron! No intelligent person makes dumb decisions like that!"
      "He should never have gotten sick in the first place! Probably went out in the rain, or in the humidity! He should have never gotten old! God, what a DUMB THING TO DO! Only MORONS get old and die! Pff!"

      Okay now...

    14. Re:Conservative/Liberal take on it by Anonymous Coward · · Score: 0

      for most poor people, hard luck is what allows you to survive, not what allows you to improve your situation.

    15. Re:Conservative/Liberal take on it by dracken · · Score: 2, Interesting

      People break down into two groups when the experience something lucky. Group number one sees it as more than luck, more than coincidence. They see it as a sign, evidence, that there is someone up there, watching over them. Group number two sees it as just pure luck. Just happy chance. And surely, the people in Group number two are looking at those fourteen lights in very suspicious way. For them, the situation is fifty-fifty. Could be bad, Could be good. But deep down, they feel that whatever happens, they're on their own. And that fills them with fear. Yeah, there are those people. But there's a whole lot of people in the Group number one. When they see those fourteen lights, they're looking at a miracle. And deep down, they feel that whatever's going to happen, there will be someone their to help them. And that fills them with hope. So what you have to ask yourself is what kind of person are you: are you the kind that sees signs, sees miracles? Or do you believe that people just get lucky? Or, look at the question this way: Is it possible that there are no coincidences?

      Huh ? this seems to be a perfect plot for a movie. Wait - nevermind ;)

    16. Re:Conservative/Liberal take on it by Anonymous Coward · · Score: 0

      Louis Pasteur - yep, that one, - Chance favors the prepared mind.

    17. Re:Conservative/Liberal take on it by Anonymous Coward · · Score: 0

      Taleb's best example of poor probability intuition is probably the infamous survivor bias, which is our tendency to be disproportionately impressed by success. We almost always ignore the fact that, for one success story, there are many failures.

      and

      Nobody's car ever "stalls out" on the tracks like in the movies.

      So perhaps we just never here about the success stories? Or perhaps, unsuccess stories?

    18. Re:Conservative/Liberal take on it by phossie · · Score: 2, Interesting

      the belief that if someone works hard and consistently, they can improve their condition

      Unfortunately, a huge number of people who identify themselves as conservative don't seem to realize that condition++ doesn't necessarily meet condition >= decency, or even condition >= survival. It is easily, easily possible to be so low that incremental improvement through hard work is still not enough to get you to the point where you'll be on your own. There is a threshold below which basic 'modern' living is not possible. This is where having basic social services is really handy. If you can get someone above that threshold, they can often stay above that threshold on their own. It's kind of the modern equivalent of knowing how to make fire, or knowing how to fish...

      It's also a shame that so few people in the US have any understanding - or put any thought into - the meanings of their tidy political categories (e.g. "liberal" and "conservative"). It's sickening how often those terms are applied in total disregard to their denotations.

      Ok, that's all for now. Time for more coffee.

      --

      [|]
    19. Re:Conservative/Liberal take on it by Boronx · · Score: 1

      Work will set you free.

    20. Re:Conservative/Liberal take on it by Anonymous Coward · · Score: 0

      I think the phrase you're looking for is "Arbeit Macht Frei"

      Just think you should get your incredibly offensive anti-semetic phrases found on concentration camp walls correct.

    21. Re:Conservative/Liberal take on it by Anonymous Coward · · Score: 0

      s/work harder?/stop drinking all their money!

    22. Re:Conservative/Liberal take on it by Anonymous Coward · · Score: 0

      "Nobody's car ever "stalls out" on the tracks like in the movies. People try to "beat the train"... and fail. "

      Actually my dad's car did stall out on the railroad tracks. The fact that he took fate into his own hands and got out of the freakin' car is the reason I am here today.

    23. Re:Conservative/Liberal take on it by fain0v · · Score: 2

      You need look no further than lottery winners to understand the situation. They say that lottery winners often end up having budget problems after they win. Since most people that play the lottery are poor to begin with.... You draw your own conclusion.

    24. Re:Conservative/Liberal take on it by firewrought · · Score: 1
      Provably false. People get hit by trains because they're on the railroad tracks when the train goes by. This has nothing to do with luck, or circumstance. It has to do with bad decision making. Nobody's car ever "stalls out" on the tracks like in the movies. People try to "beat the train"... and fail.

      In general, I agree: many train accidents are the result of people wagering their future in the hopes of saving 3 or 4 minutes. But don't turn a blind eye to how design and infrastructure can influence things...

      We used to have a very akward, high-traffic, T-shaped intersection where the train crossed over the secondary road very close to the intersection (e.g., imagine drawing train tracks parallel and just below the horizontal line of the "T"). The design was very poor, and there were several aggrevating factors with height, visibility, parking lots, etc.

      One night, 4 schoolteachers got hemmed in by traffic while crossing the tracks. They were killed by an oncoming train. The driver could have been making very reasonable decisions while negotating her turn onto the secondary road... bad design is the primary culprit for that accident. Fortunately, this intersection has been heavily redone to properly handle the traffic it must support. The road is flat, everything is visible, the signaling mechanisms are obvious, and there are no adjacent parking lots to tangle up traffic flow.

      The human mind is an operational hazard. Good designs take the inevitability for error into account and provide mechanisms to prevent or mitigate such errors. Designer and operator must both be serious about what they do.

      --
      -1, Too Many Layers Of Abstraction
    25. Re:Conservative/Liberal take on it by SquadBoy · · Score: 3, Insightful

      Yes yes they should. With a couple of qualifers.

      8 years ago I was barely making minimum wage had a wife a kid and due to bad decision making had a degree that was basically worthless. Working two jobs and for all intents and purposes living in a cardboard box.

      By making a hard choice, go into the Air Force, while in I worked hard and learned everything about anything anybody would teach me. I also looked around the world and came to realize that computers and networks were *very* big and only going to get bigger I started to insert myself into every situation where they needed someone to help out with any computer related. At the same time I started to devour every book on networking that I could get from any library that I had access to. As a result of that I got out 4 years later and worked at a crappy temp job for a few months while shopping out resumes. Since I had very little experince I got a crappy job doing tech support for a medimum sized ISP. While there I continued to work my ass off and learn everything I could and read everything I could get my hands on. As a result of doing that for the past few years I've managed to go from *very* poor to be rather well off. And it was all hard work. I have yet to meet a person, myself included, who does not waste time. Put even a small perctange of that wasted time to work and you can improve your situation. So yes they should work harder and study more.

      --

      Cypherpunks: Civil Liberty Through Complex Mathematics. Those who live by the sword die by the arrow.
    26. Re:Conservative/Liberal take on it by NFNNMIDATA · · Score: 1

      OK "hit by train" is being taken too literally here, subsitute "hit by car" or even "hit by hijacked airplane while sitting at desk" and you will understand the guy's point. But then I guess you already did understand and were just being an ass.

    27. Re:Conservative/Liberal take on it by SirSlud · · Score: 1

      Unfortunately, you missed the point about perception. Your situation is a minority. Many people *do* work just has hard, but arn't smart enough to learn networking (or hate computers) .. or for whatever other reason, hard work just doesn't cut it for them.

      You almost reinforced one of the major points the author had; the few bright spots outshine the many who don't succeed, but yet, their methods are held up as being the 'simple way' to escape a situation.

      Which leaves us with:

      1. Most people must be lazy, you were one of the few who could actually force yourself to do the work.

      OR

      2. You made it, with hard work and dumb luck. Most people don't get the dumb luck, regardless of how hard they work.

      I assume you vote 1. I vote 2.

      --
      "Old man yells at systemd"
    28. Re:Conservative/Liberal take on it by SirSlud · · Score: 2, Insightful

      > Provably false. People get hit by trains because they're on the railroad tracks when the train goes by. This has nothing to do with luck, or circumstance. It has to do with bad decision making. Nobody's car ever "stalls out" on the tracks like in the movies. People try to "beat the train"... and fail.

      Way to predictably react to my statement in a way that only serves to re-inforce my point: Your perception is your truth. Check the replies, and you'll note lots of cars stall on tracks. Or get stuck on tracks through no fault of the driver.

      You simply choose to err on the side of discrediting your fellow man .. do you really think you're going to see "Mans car stalls on tracks. Man gets out of car. Man survives!" in the paper? You only hear about the times when Man bites Dog, not Dog bites Man, even though Dog bites Man is way more common. Its a junk food news society, baby, and the last thing you want to read about in the paper is boring old reality. The benifit you get out of it is that you can skew your perception of reality any which old way you choose; but a wise and compassionate person always errs on the side of doubt rather than assumption.

      --
      "Old man yells at systemd"
    29. Re:Conservative/Liberal take on it by Drakonian · · Score: 4, Insightful
      So hard work does nothing, eh? It's all luck and circumstance.

      Where did he say that? He actually said "Luck, circumstance, and opportunity play huge roles in where you are." Huge roles being the keywords. As someone else who replied to you said, how about being hit by a hijacked airplane while sitting in your office? Or being born as a woman or slave in Sudan? Keep working hard, maybe you won't get beaten as badly.

      --
      Random is the New Order.
    30. Re:Conservative/Liberal take on it by SquadBoy · · Score: 2, Insightful

      No I think that it is more complex than that. Yes to some extant I was lucky in that I got into weather which was one of the fields that relied heavily on computers and networks. But of course many other people I worked with did not take advantage of the bit of luck.

      I did not mean to present my case as being "simple" far from it and yes there was luck involved. My point in answer to the parent post, and granted I could have explained more, was that working harder, doing something diffrent, and taking advantage of luck when it happens, another example from my case a Cisco gawd who also happened to like me, can and almost always will allow you to improve your situation.

      To me the parent seemed to be saying that working harder will not help people who are in very bad situations. I gave my example to show that working harder can help and in most cases will. So I would not call it dump luck because IMO chance favors the prepared.

      And I'm not calling them lazy. But you will notice that the event that set everything in motion involved a risk and was in the short term harder than staying put would have been. People need to have the courage to change and then take advantage of the "luck" those changes can produce.

      I think most people are taught that they can't improve themselves and therefore don't even try. By pointing out that in many cases you can make your luck I hope to change that perception and to make the point that no matter how bad off you are or how hard you are working at the moment you can improve.

      --

      Cypherpunks: Civil Liberty Through Complex Mathematics. Those who live by the sword die by the arrow.
    31. Re:Conservative/Liberal take on it by firewood · · Score: 1
      Liberals go the other way. Luck, circumstance, and opportunity play huge roles in where you are. Poor people are poor because of luck and circumstance. People get hit by trains because they might have just plain been unlucky. Your situation is a result of your environment, including dumb luck.

      I tend to think the opposite about Liberals: Liberals don't seem to believe in probability distributions. They think that poor people could only be poor because rich people screwed them. That group X could only be under-represented because there's a vast conspiracy to blackball them. They also assume that probability distributions can be made to go-away simply by taking away from one tail of the distribution and giving to the other. A historical analysis of the welfare state and other policies shows that things aren't that simple.

      Conservatives tend to think you are where you are because you deserved it. ... Your situation is a result of your disposition.

      Although not stictly related, there are some correlations between how one lives (honesty, relationships, etc.) and ones situation.

    32. Re:Conservative/Liberal take on it by Anonymous Coward · · Score: 0
      Unfortunately, a huge number of people who identify themselves as conservative don't seem to realize that condition++ doesn't necessarily meet condition >= decency, or even condition >= survival.

      Wow, that was really well put.

    33. Re:Conservative/Liberal take on it by SirSlud · · Score: 2, Insightful

      > I think most people are taught that they can't improve themselves and therefore don't even try.

      I agree with most of what you say.

      I think my main beef was people always blaming the person for being taught that there was no use for trying to succeed. For me, thats something to empathize about, to try and help them out of. It's not a good reason in and of itself as for why we shouldn't care for their wellbeing. However, you seem to recognize this; I just suspect that many dont.

      --
      "Old man yells at systemd"
    34. Re:Conservative/Liberal take on it by Anonymous Coward · · Score: 0

      The glass is over-engineered.

    35. Re:Conservative/Liberal take on it by renoX · · Score: 1

      While I agree that hard work will improve your situation, this sentence maybe right for the USA and the Europe but it downplays the situation the majority of the people living in this planet where hard work is necessary to just be able to eat!

    36. Re:Conservative/Liberal take on it by linuxelf · · Score: 1

      >Personally, this is the single biggest reason I can't stand conservatives. It bothers me to no end how capable they are of assuming that anybody in a bad situation is there because they deserve it.

      And, to jump to the other extreme, this is the single biggest reason I can't stand liberals. They believe that the world owes them something, and that they don't have to work hard, or study, or avoid drugs, or avoid horrible decisions. They should be able to be rich because they are owed it.

      --
      - "That's just the kind of fuzzy-headed liberal thinking that leads to being eaten."
    37. Re:Conservative/Liberal take on it by namespan · · Score: 1

      I was thinking about this the other day. I think you could almost model it with a chain of matrices. If you start thinking of "improvement" as an iterative process, a function where you put in resources x1... xn, and random factors r1...rn, and you get out some delta of improvement/loss for each resource.

      It's not really a deep insight, it's just a (probably obvious) way of modeling a process. Starting resources and resources available at each iteration can make a huge difference to what kind of return you're able to get from each effort -- but so does fortune. And then there are the catastrophes, the "black swans" if you will: You may be an competent student with good work ethic, solid middle-class resources, and a promising future, and a track athlete to boot, and suddenly collapse one day from an inexplicable heart attack and that's it -- happened to a friend of mine in high school. I've known some financial equivalents of this, too. I've missed making $20,000 from not reading my email for a day. I've also known people who parlayed a small stake, a bright mind, and small bit of luck into a decent fortune. It's all possible, but it's a function of both starting resources and fortune.

      --
      Libertarianism is rich wolves and poor sheep playing gambler's ruin for dinner.
    38. Re:Conservative/Liberal take on it by rsborg · · Score: 1
      Ok, Mr. Conservative, #1 reason: being part of a couple that gets pregnant outside of marriage. If you're the woman, you now have the financial burden of a child without the full support of a father. Additionally, you don't enjoy the economies of scale enjoyed when two or more income earners live together. If you're the father, the latter point still applies, and you have child support to pay.

      Marriage has nothing to do with being a couple, as long as that couple plans to stay together for the benefit of the child. It's called cohabitative child-rearing, and happens regularly all over the world (and was glorified in the movie "Four Weddings And A Funeral"). I know that in France, you can take it one step further and have an official declaration of Concubinage (note: in french), which implies that, for all intents and purposes, you plan to live together for the foreeable future... and there are benefits to declaring thusly (with your French .sig, I would have thought you might have known that, but hey, maybe you're a Quebequois?)

      The problem lies with the fact that in the US, we have no real declared state of cohabitation, or even "living together but not married". It's this gap that makes the male more reticent to fully commit to marriage.

      In any case, if you're against the causes of single mothers (ie, deadbeat dads as opposed to cohabitation) then I'm with you; It's just that lots of people live happily (even with kids) without marrying, and to lump that into your anti-single mother view is rather myopic.

      --
      Make sure everyone's vote counts: Verified Voting
    39. Re:Conservative/Liberal take on it by gambit3 · · Score: 1

      Personally, this is the single biggest reason I can't stand conservatives. It bothers me to no end how capable they are of assuming that anybody in a bad situation is there because they deserve it.

      So you respond to conservatives by being uncapable to assume that not every conservative thinks that way?

      You just became guilty of the reasoning you just claimed to despise.

    40. Re:Conservative/Liberal take on it by Carbonite · · Score: 1

      So all people who work three jobs and live in cardboard boxes should just work harder?

      This is a classic example of a straw man. It would quite difficult to find someone who lives in a cardboard box and has one job. No, begging for change and collecting cans don't count. Even at minimum wage, someone working multiple jobs will be able to afford basic housing. If someone actually holds three jobs and still lives on the street, there's something far more than luck or destiny at fault.

      --
      ich muß mehr Kuhglocke haben
    41. Re:Conservative/Liberal take on it by Anonymous Coward · · Score: 1, Insightful
      in almost every circumstance, people are poor as a consequence of poor choices they made.

      I'm sorry, but that is an incredibly naïve point of view. Look at the whole forest, not just the individual trees.

      You fall into the same trap that I hear conservative pundits fall into all the time, of confusing a symptom for a cause. Single parenthood, high-school dropout rates, and drug abuse are symptoms of poverty just as much as they are causes. Perhaps even more so. You cannot say that these people are poor because a lot of them drop out of high school, and just leave it at that. There are reasons why so many of them drop out. Would the same group of people show such high dropout rates if they had been raised in $200,000 homes in the suburbs? Of course not.

      Clearly, there are social pressures that the poor have to face which the rich do not. And while it is possible for an individual to overcome these obstacles, it is self-evident that he is more likely to fail than someone who faces fewer obstacles, or none.

      Furthermore, this idea that the poor would become better off if they just worked harder is absurd. It may work for a few individuals, but it only works for them because they're the only ones doing it. Generally speaking, there is a finite amount of wealth in the world, so if you believe that the poor could collectively earn more, you have to explain whose pocket it would come out of. No matter how hard you crack the whip.

      It's like saying that anyone could grow up to become a gold-medal Olympian. All else being equal, perhaps anyone could. But most of them won't, and it's not necessarily because they didn't work hard. It's simply because there is a limit to the number of available medals.

    42. Re:Conservative/Liberal take on it by Anonymous Coward · · Score: 0

      Can't you see that someone living in a cardboard box is going to have to work harder to find a job than someone who has a home?

    43. Re:Conservative/Liberal take on it by SquadBoy · · Score: 1

      Yup I should have explained more in my first post. Just thought of a great way to sum it up. You know how some people are always going on about "life's lottery" or similar phrases. Well really my outlook on it is that life is not lottery but is more of a poker game. :)

      --

      Cypherpunks: Civil Liberty Through Complex Mathematics. Those who live by the sword die by the arrow.
    44. Re:Conservative/Liberal take on it by CommieLib · · Score: 1

      Your analysis is correct in that it is more specifically non-cohabitation that is the poverty inducer. It is simply that outside of marriage, long-standing cohabitation of this sort is rare. I cannot be sure of how it works in other cultures, I'll rely on your understanding about the French, but in American culture it seemt to be pretty much all or nothing.

      I reluctantly disagree with the assertion that males are made less eager to marry by a lack of some formal cohabitation arrangement. Most men clearly would prefer less commitment to more, so it would seem to me that introducing this idea would tend to undermine marriage further rather than bolster it by providing a bridge from singlehood.

      I am most certainly making the case of single mothers in several ways:

      1. If you are deadbeat Dad, you are a vile, disgusting dog.
      2. While we most love, support, and empower single mothers, we must at the same time realize that single motherhood is not an empowering choice.
      I am not by any means anti-single mother; God knows their burden is heavy enough without whatever weight my opinion would carry. I am, however, strongly anti-single motherhood. Even the best examples I've seen of it tend towards making the best of a bad situation.

      Finally, regarding my sig: I'm a Texas boy, believe it or not. The sig is a double-entendre on a Magritte painting of a pipe which reads "Ceci n'est pas une pipe", meaning, "this is not a pipe". The idea is that it's not a pipe, it's a painting, playing on our idea of scope, recursion, etc. Apart from poor French, my sig means "this is not a sig, it is a monitor", which you would be looking at if you're reading my sig.

      --
      If your bitterest enemies are people who hack the heads off civilians, then I would say you're doing something right.
    45. Re:Conservative/Liberal take on it by Gooba42 · · Score: 1

      What the hell is anti-Semitic about "Arbeit Macht Frei"? There's nothing Semitic or Anti about it. That's the same as implying that voting is racist because it was once used by a racist instituition.

      Turn down the sensitivity knob a little and get back down to the reality the rest of us know and love.

      --
      I just found out there's no such thing as the real world. It's just a lie you've got to rise above. - John Mayer
    46. Re:Conservative/Liberal take on it by CommieLib · · Score: 1

      You fall into the same trap that I hear conservative pundits fall into all the time, of confusing a symptom for a cause. Single parenthood, high-school dropout rates, and drug abuse are symptoms of poverty just as much as they are causes. Perhaps even more so. You cannot say that these people are poor because a lot of them drop out of high school, and just leave it at that. There are reasons why so many of them drop out. Would the same group of people show such high dropout rates if they had been raised in $200,000 homes in the suburbs? Of course not.

      Clearly, there are social pressures that the poor have to face which the rich do not. And while it is possible for an individual to overcome these obstacles, it is self-evident that he is more likely to fail than someone who faces fewer obstacles, or none.


      All true. With what that I've said have you disagreed? More specifically, how do these circumstances transform what are bad choices for the privileged to good choices for the poor?

      Generally speaking, there is a finite amount of wealth in the world

      Aha! You're asking the right questions. There is not a finite amount of wealth in the world (quickly demonstrable by the fact that there is vastly more wealth in the world today than 10,000 years ago). Wealth arises from economies that arise from combining resources in increasingly more efficient combinations. The classic economist demonstration of this thusly:

      You and I live on a desert island. You have a pile of 10 oranges, I have a pile of 10 apples. I would prefer to have some oranges, and you would prefer to have some apples, so we trade, and we are both better off. The degree to which we are better off is wealth. Where did it come from? It came from a superior combination of resources.

      Lest you think this example over-simplistic, the Soviet Union had natural resources beyond the dreams of avarice, and yet ended in bitter, grinding poverty because they improperly arranged those resources. Conversely, Japan, a small country with hardly any resources, has arranged them hyper-efficiently to create enormous wealth.

      Lastly, when someone someday invents the nano-assembler, it will be able to rearrange my pencil lead into a diamond for my wife. It's all about configurations of resources. If everyone worked harder, everyone would be better off (family time, recreation, etc. aside).

      --
      If your bitterest enemies are people who hack the heads off civilians, then I would say you're doing something right.
    47. Re:Conservative/Liberal take on it by Anonymous Coward · · Score: 0

      > I'm a firm believer that overall, hard work will improve your situation.

      As someone whose situation has improved, and who has worked hard, I have to disagree. Working hard got me and the people around me very, very little.

      In contrast, knowing the right people and having the right pedigree has been very rewarding. This extends very well to nearly everyone I've ever known. The people who work hard are the people who are doing badly. The very few cases of people who have actually improved their lot by working hard have had to go to absurd extremes -- working for years without evenings or weekends; nearly killing themselves with work. At the end of it one wonders if it was really worth it. Maybe they would have had a happier life doing something else.

    48. Re:Conservative/Liberal take on it by Gooba42 · · Score: 1

      Whoa, Reason #1 has some serious weaknesses to it. Do you automatically assume that all households should be dual income on the basis of married parents? Or that marriage makes you a viable parent? Obviously it is more legally binding but it would be assuming the worst of unmarried fathers to make the automatic decision that unmarried mothers are inevitably poor and that child support is not forthcoming.

      Personally the trend to insist on all households being dual income sickens me. I really believe that children benefit more from having a stay at home parent than they do from having money. Likewise the American view of extended family is somewhat odd as well, implying that sisters, brothers, uncles, aunts, etc. are all autonomous entitities who visit and give you presents sometimes, denying the possibility of being functioning, contributing members of a single household.

      I know single mothers who are making it and I know those who aren't making it. In all it is easier to survive with a contributing partner but it isn't vital and married or unmarried doesn't automatically imply any level of financial support.

      --
      I just found out there's no such thing as the real world. It's just a lie you've got to rise above. - John Mayer
    49. Re:Conservative/Liberal take on it by CommieLib · · Score: 1

      Here here! My own wife stays at home to raise the children. But even that has an overwhelming economic impact. It's no joke that being a housewife and mother is a fulltime job. I didn't mean to imply that benefits arise only from dual incomes; indeed, my wife watches my sister-in-law's son, being that she is a single mother and has no one to watch him.

      I further agree on the extended family point; my wife's maternal grandmother stays with us from time to time, and her wisdom and values have contributed enormously to my children. But now, talking about family and values and wisdom, I must really seem like a knuckle dragger to Slashdot.

      --
      If your bitterest enemies are people who hack the heads off civilians, then I would say you're doing something right.
    50. Re:Conservative/Liberal take on it by Anonymous Coward · · Score: 0

      IANAJ, but it is a quite famous saying that was posted at the tops of concentration camps as the Jews entered them. Not quite as anti-semetic as "Heil Hitler" or as racist as "White Power", but it's close.

    51. Re:Conservative/Liberal take on it by Dirtside · · Score: 1
      Here's the defining characterstic of a conservative: the belief that if someone works hard and consistently, they can improve their condition.
      Here's a hint: "Liberals" believe almost the same thing, except it goes like this:

      If someone works hard and consistently, they can probably improve their condition; but preexisting conditions over which they had no control can easily more than make up for their hard work, or teach them that hard work isn't going to help in the first place.

      Someone who is born in a poor neighborhood to poor parents, is going to receive a lot of negative reinforcement with regards to work, success, and achievement, long before they have the mental capacity to fight against those things and supercede them. By the time a child from the ghetto is old enough to be able to "work hard," for the most part, it's been inculcated into their bones that the best they'll ever be able to do is minimum-wage jobs, or maybe prison or an early death. Some of these people are still able to get past all that, and become "successful," but the environment works against them. As strongly as you believe that hard work can improve your lot to the point of "success," do they believe that hard work isn't going to help.

      Success is not just a matter of effort; it's also a matter of opportunity. A black child born on a plantation in Georgia in 1802 may have been highly motivated and superintelligent, but his environment would make it nigh-impossible for his lot to improve beyond the point of "house negro" -- and still a slave.

      The upshot of all this is that environment is rather important, in addition to willingness to improve your lot. Is it as important? Well, these thing are notoriously hard to quantify, but I would say it's reasonable to compare the two. That's the difference between "conservatives" and "liberals;" they each tend toward only looking at half the picture, but they look at different halves. (Although I believe that "conservatives" tend to focus more on their half than liberals do on theirs.)

      --
      "Destroy science and religion. Science would re-emerge exactly the same; but not religion." - Penn Jillette, paraphrased
    52. Re:Conservative/Liberal take on it by Dirtside · · Score: 1

      The terms "conservative" and "liberal," at least applied to American politics, no longer really have any meaning. What blurry lines there ever were have long since blurred beyond distinction. Scratch two "conservatives," and maybe you'll find some common ground -- but they won't agree on everything, even "key" issues which those with the same ideological identity often share. Same goes for liberals. There are too many issues, and too many positions, for any one word to accurately and meaningfully sum them up.

      --
      "Destroy science and religion. Science would re-emerge exactly the same; but not religion." - Penn Jillette, paraphrased
    53. Re:Conservative/Liberal take on it by Anonymous Coward · · Score: 0

      Dude, I'm reticent to fully commit to dating, let alone marrage and all that scary life stuff. Then again, I don't sleep around either.

    54. Re:Conservative/Liberal take on it by JamesOfTheDesert · · Score: 1
      Conservatives tend to think you are where you are because you deserved it.

      Maybe. Most of the conservatives I know tend to believe people are where they are because of choices people make, and would rather those choices (whether they be good or bad) be made by the individual rather than the government.

      Well, unless it concerns drugs or porn.

      --

      Java is the blue pill
      Choose the red pill
    55. Re:Conservative/Liberal take on it by canadian_right · · Score: 1
      I don't know anyone who improved their situation by becoming a drug addict. Rich friends who took up drugs were soon not rich. Poor friends stayed poor. Taking drugs is ALWAYS a bad choice if you care about your health, social life or career.

      Being a single, young, parent is very hard. It makes it very difficult to work. Modern birth control makes becoming a parent a choice more often than an accident, but once you have a child to look after that pretty much stops your education and career if you are single. I'm a single parent, but due to divorce, so I already had a well established career that allows me to pay for daycare etc... This isn't the case with young people.

      Dropping out of school rarely is a good decision. It shuts off many avenues of growth. If you want the standard Western "good life" a good education is a must.

      Not everyone is equally talented, but hard work and good choices will bring you much more success than whining about your terrible circumstances.

      One good thing about where I live is that the good and bad areas and schools are very diffuse. So most kids from even the poorest homes attend decent schools and can see what the "good" part of the world has to offer, and make friends from different parts of scociety. In college a good friend of mine lived with his parents. His rec room was bigger than my whole apartment. I had other friends who lived in places I would rather of not known existed . Knowing both people taught me many things about myself, and the world I live in.

      --
      Anarchists never rule
    56. Re:Conservative/Liberal take on it by Bush+Pig · · Score: 0

      Has it occurred to anyone that the parent post may have been sarcastic (or at least tongue-in-cheek)?

      --
      What a long, strange trip it's been.
    57. Re:Conservative/Liberal take on it by Anonymous Coward · · Score: 0

      Personally, this is the single biggest reason I can't stand conservatives. It bothers me to no end how capable they are of assuming that anybody in a bad situation is there because they deserve it.


      Hardly true of all conservatives. But I do see this mentality more often from the religious right. I've speculated that it's an outgrowth of taking too seriously the Christian doctrine of the Fall.
    58. Re:Conservative/Liberal take on it by Associate · · Score: 1

      There is no glass.

      --
      Someone hates these cans.
    59. Re:Conservative/Liberal take on it by moosemoose · · Score: 1
      i can't believe the number of people who mischaracterized or perhaps just misunderstood his comments. in any event, can we agree that perhaps the difference is that liberals believe (1) that bad luck / social disadvantage is an EXCUSE for not making an effort and (2) that government programs can overcome the 'inculcation' that you get in the ghetto.

      why is it that some people can believe society's intolerance of say something like racism actually has a positive effect ( i think this intolerance does change behavior) and yet on the other hand, the same person will turn around and say that society's intolerance of bad choices (i.e. not finishing high school or having babies while a teenager) has no effect (because they've been inculcated).

      --
      the real evil is not what people think - its how people think
    60. Re:Conservative/Liberal take on it by Anonymous Coward · · Score: 0
      All true. With what that I've said have you disagreed? More specifically, how do these circumstances transform what are bad choices for the privileged to good choices for the poor?

      Where I disagree with you is in your gross overstatement: "in almost every circumstance, people are poor as a consequence of poor choices they made." How is this compatible with the statistical fact that those who are born into poverty tend, overwhelmingly, to stay there? Was being born poor just another one of their "poor choices?"

      The truth is, people's fates are largely not in their own hands. You had no control over where you were born, who your parents were, whether or not your mother received adequate prenatal care, whether or not the dwelling you grew up in had lead paint, which school you attended, or any number of things that all could have thrown up obstacles to financial success. You yourself might have dropped out of school if you had encountered the right combination of social pressures.

      Generally speaking, there is a finite amount of wealth in the world
      Aha! You're asking the right questions. There is not a finite amount of wealth in the world

      There absolutely is a finite amount at any given moment in time, and it is effectively finite on any timescale that is relevant to this discussion. Thus the phrase "generally speaking."

      If everyone worked harder, everyone would be better off (family time, recreation, etc. aside).

      That is simply not true. The "average" quality of life would likely improve, depending on how one defines "quality of life," but will not necessarily be proportionate across all social classes. It is quite possible -- and there are many examples of this throughout history -- for the poor to get poorer during a period of economic growth. The rich have a tendency to reap all of the benefits, and then some. Consider the role that slavery has played in world history. Without a doubt, it increased the average amount of hard work being done, and probably the average quality of life as well. But surely you can see that not "everyone" was "better off" as a result.

    61. Re:Conservative/Liberal take on it by Dirtside · · Score: 1

      Well, I don't personally believe that externally imposed bad luck/social disadvantage should be an excuse for not making an effort, any more than growing up in a racist community or environment should be an excuse for being racist. The two situations are comparable, in that they are behaviors that result, in part, from external conditions that the individual cannot control (at least, not during the years of their life when the inculcation occurs). I think they are also both behaviors that are detrimental to society (although in different ways). Racists encourage discrimination and divisiveness; slackers drain social resources.

      So what do we do? Discourage those behaviors. We discourage racism by making laws preventing its application in certain areas, and by trying to teach people that getting along is better than strife. We discourage not making an effort by giving opportunities to those who have not had enough of them, and teaching them that they can improve their lives by hard work. Will these methods reach everyone? Not realistically. Does that mean we shouldn't try, in order to at least help the next generation of people pull themselves out of their rut (either the racist rut or the laziness rut)? No, of course not. A large number of people are, societally, more or less stuck in a hole that they effectively cannot pull themselves out of -- both racists and slackers. Helping them (in realistic and useful ways) seems to me a better way to improve society, than by dismissing and ignoring them.

      --
      "Destroy science and religion. Science would re-emerge exactly the same; but not religion." - Penn Jillette, paraphrased
    62. Re:Conservative/Liberal take on it by DancingSword · · Score: 1

      All right, then, what about the One Word .. DAFT .. ?

      Eh?

      .. explanation for them-of-us non-knowing me sense-of-reason: political-motivation is, to me, inherently daft.

      apparently political choices, if made from human-worth motivation, can be valid, but no politically-motivated determination can be valid.

      Neither god-itself, nor universe-itself is a political-reality, therefore no valid action can be of sooo-bogus a motivation.

      Perhaps too buddhist to make-sense to Proper/Correct people, ...

      --
      Messages to/for me ( in me journal )
  5. Slashdot lameness filter by hackwrench · · Score: 2, Insightful

    Anyone else think of the Slashdot lameness filter when reading this?

    1. Re:Slashdot lameness filter by L7_ · · Score: 0, Offtopic

      I pee sitting down.




      Where is the lameness filter?

    2. Re:Slashdot lameness filter by Anonymous Coward · · Score: 0

      I got to about the 15th thread or so above and had to smile when reminded about the original article.

  6. Complete egoism by Anonymous Coward · · Score: 5, Insightful

    I work at the crossroads between finance and technology so I eagerly read this book. I agree that many, many people in finance are particularly susceptible to making statistical errors. It is amazing how many people are heavily rewarded for dumb luck or what amounts to survivorship bias. There are some smart people in this industry, but there are more people who have had a lucky run.

    What ruined the book for me was Nassir's incessant and shameless self-promotion. He shows the same hubris that he finds reprehensible in others and he seems to be trying to settle a few old scores by maligning people.

    But the most ridiculous part of the book is when he starts drawing links between finance and neuroscience and trying to explain traders behavior based on our very preliminary understanding of brain physiology. Utter crap.

    The basic message is sound: Wall Street is full of people getting paid millions who haven't the slightest understanding of math, science or technology. But that message is clear in about 10 pages and the rest is self-serving, self-promoting tripe.

    1. Re:Complete egoism by TopShelf · · Score: 1
      The basic message is sound: Wall Street is full of people getting paid millions who haven't the slightest understanding of math, science or technology. But that message is clear in about 10 pages and the rest is self-serving, self-promoting tripe.

      It seems like personal charisma and salesmanship can become main drivers once you get to the money management level these days. Not exclusively, of course - there are a number of highly qualified and dedicated professionals who view their trade more as science than art. But the rewards are so great that the Gordon Gecko's of the world are drawn to it like moths to a flame...

      --
      Stop by my site where I write about ERP systems & more
    2. Re:Complete egoism by jesterepsilon · · Score: 2, Informative

      That was my take too. Some good content, but he seems like a pretty angry guy. Can't imagine that he'd be a lot of fun to hang out with. Also, what's with him at the gym? He must have talked about himself working out a good half-dozen times.

    3. Re:Complete egoism by b_pretender · · Score: 1
      "Malcolm Gladwell (author of The Tipping Point, an absolute must-read for anyone who owns a brain) has written an excellent article that shows how Taleb's reasoning runs counter to just about every bit of conventional Wall Street wisdom. If you're interested in the markets, especially derivatives, and how Taleb trounces most of Wall Street's voodoo doctors, this moderately technical interview from 1996 is worth reading too."
      I don't agree that his reasoning runs against conventional Wall Street wisdom. In my two years of studies at NYU's mathematics of finance program, not once have we learned anything that runs contrary to Taleb's claims. In fact, we have devoted many lectures and class projects to showing the exact points that are brought up in this review. The problem isn't convincing Wall Street of these ideas, the problem is trying to convince Joe Six-pack-investor of these ideas. I realized just how stubborn my parents are after I tried to explain some of these concepts to them with respect to their personal investments.

      Since we've recently (and hopefully) completed a big Boom-Bust cycle, many of the ideas in this book have a large effect on investing. We can't just throw money into anywhere and expect a return. Nor can we throw our money at the best performing investment strategies and expect it to outperform other strategies. Survivor bias is a big part of every type of investment strategy.

      Taleb's other book "Dynamic Hedging" is a must read for any quantitative finance specialist. Hopefully his self promotion doesn't ruin the book for me. This isn't a factor in "Dynamic Hedging" because of the more technical/analytical nature.

    4. Re:Complete egoism by TheWizardOfCheese · · Score: 5, Informative

      The parent post is accurate. Many of Taleb's stories are highly amusing, but they are also highly self-flattering. An unreasonable proportion of the book is devoted to explaining that although Taleb is an idiot, he is really a genius because he knows that he's an idiot. These excursions are accompanied by descriptions of tricks he uses to fool himself into being smart. Not all of this is entertaining.

      The book has one other serious flaw which really merits mention in a review: it is very badly written. 'Meandering' does not describe the book as well as 'completely unstructured'. Also, there is too much repetition for such a short book.

      The overall impression is that Taleb has published the notes for a book, rather than the book itself. With proper writing and editing, these notes would, of course, make an extremely brief book; but certainly there is material here for an instructive essay.

      --

      "The good reader is a rarer swan than the good writer."
    5. Re:Complete egoism by SpinyNorman · · Score: 1

      What's "survivor bias"?

  7. Good if you need it by Anonymous Coward · · Score: 1, Insightful

    Anyone who has read and understood a half-decent statistics book is already aware of selection bias. The old "post hoc ergo propter hoc" fallacy is something that everyone with a brain should know about, but unfortunately few do.

    So, in short, if you're ignorant, this book is for you. If you have a decent education, you can skip it.

    1. Re:Good if you need it by Anonymous Coward · · Score: 1, Insightful

      Most people need reminding, regardless of their statistics education. Our brains are wired to look for patterns and we inevitably find them.

  8. Yep by Anonymous Coward · · Score: 2, Interesting

    Liberals tend to think that luck, circumstance, and opportunity play huge roles in where you are. Poor people are poor because of luck and circumstance. People get hit by trains while trying to get through the tracks before the train gets there, are just plain unlucky. Your situation is a result of your environment, including dumb luck.

    Personally, this is the single biggest reason I can't stand liberals. It bothers me to no end how capable they are of assuming that anybody in a bad situation is there because of bad luck or circumstances beyond their control.

    1. Re:Yep by hondo77 · · Score: 1

      A child born to parents in a "bad situation" is not there by his or her choice. Time to use a different stereotype to hate liberals.

      --
      I live ze unknown. I love ze unknown. I am ze unknown.
    2. Re:Yep by mfrank · · Score: 2, Interesting

      It's been theorized that that is the reason why so many actors and actresses are liberal, because for them "luck, circumstance, and opportunity" play huge roles in getting them where they are, and deep down inside, they know it.

    3. Re:Yep by Anonymous Coward · · Score: 1, Insightful
      Ahh children, innocent of blame for their own circumstance. I suppose, you could say everyone is innocent of blame or credit for their own circumstance. We were born with our genes, and what happens to us after, is after all not under our control. We can have bad luck before we were born ( such as being born with three arms ) or as we are born ( such as being born to 'bad' parents ) or afterwards ( such as falling on a pair of scissors or being run over by a drunk driver ). Maybe we would have been popular in school had we not had the misfortune of attending a school whose students were all buttheads.

      Maybe had none of these things gone wrong we'd have graduated high school valedictorian and now be on our way to the olympics, but as it is misfortune has befallen us so we are a crack addict on welfare. Sure, we could have done some things but how could we be expected to persevere when our life was so hopeless to begin with. It was all dumb luck's fault. The current situation could have been predicted given events.

      But isn't that a little fatalistic? If events determine what we do completely then where is free will? To accept that events drive you like a car on a predictable course is to accept your role as a cog in a machine. To say that someone else is driven along a predictable course by events is to say that THEY are a cog in a machine. It is to say that they have no free will, no soul. Respect for people in 'bad situations' demands that you hold them accountable for their actions, and not write off bad behavior as being the fault of their environment. I could say that a child molester is not neccesarily a bad person because they were abused, but if I did, then that would also say that an abused child who DIDN'T abuse children was no better because they had it somehow 'easier' or else they would have done it themselves. Sorry, but spirit counts for something. A strong spirit can overcome or keep trying till it dies.

      This is why I hate liberals, because they don't respect people. They don't hold anyone responsible for themselves and would gladly have government assume the responsibilty for the lives of everyone who might have something go wrong in their lives ( and that's everybody ) until there is no more reason to cultivate that spirit which makes us human and which differentiates us from each other. When the worst of us are no worse off than the best of us, what is the human race but biomass?

      This is not to say that conservatives are 'all that'. They do dumbly assume that successful people are somehow 'better' than others because of their success. Much IS attributable to dumb luck. Winning big is usually only possible by taking a bad risk that happens to pay off. One horse's ass that won the lottery ( or the stock market, or ran a business ) and made it thinks he's the shiznit, while 99 other lottery ( or whatever ) players are a dollar or more poorer for their effort know they are just not very lucky.

      In the end we are all subject to reality. But reality is random and unfair. Conservatives need to not always judge a book( or people ) by it's cover and be grateful ( or hopeful ) for their own streak of luck, and liberals need to expect more from people and learn that to be free you can't live in a rubber room, and that making everyone the same exposes all of society to dangerous dumb luck. Only through diversity, by not all doing the same 'approved' thing can we be strong as a people against random chance. Without the freedom to make mistakes and take the consequences of them, nobody succeeds and everybody fails because there is no possibility of success to strive for. There is no change or evolution for anybody until dumb luck ( read reality ) strikes the terrible socialist beast down and frees individuals to strive and succeed or fail naturally once more.

    4. Re:Yep by hondo77 · · Score: 1

      This is why I hate liberals, because they don't respect people. They don't hold anyone responsible for themselves and would gladly have government assume the responsibilty for the lives of everyone who might have something go wrong in their lives ( and that's everybody ) until there is no more reason to cultivate that spirit which makes us human and which differentiates us from each other.

      Your definition of a liberal, not mine, (anonymous) coward.

      --
      I live ze unknown. I love ze unknown. I am ze unknown.
    5. Re:Yep by Anonymous Coward · · Score: 0

      three arms would be bad? Sounds like good luck to me - I could use an extra arm.

      Why, I'd probably give my...wait.

    6. Re:Yep by Anonymous Coward · · Score: 0

      That was very bad but I am still laughing.

  9. WHOA, dont let this spiral out of control by SirSlud · · Score: 2, Insightful

    Um, yes, that was a super reductionist post. Obviously, there are shades of grey, and even the most hardcore C or L doesn't look at things in a 100% absolute way that I've suggested.

    They are just generalizations, and it's too bad that I'm gunna get modded down to hell for it.

    I probably should have left off that last line. It's still a valid point, for the most part.

    --
    "Old man yells at systemd"
  10. Theories by Root+Down · · Score: 2, Insightful

    ...there are only two kinds of scientific theories: those that are demonstrably false, and those that are not yet demonstrably false.

    Well, yeah - that's why they are theories and not laws. The same sort of argument is made by fundamentalists against the "Theory" of Evolution. It can't be proven. It's only a theory (so let's go back to something infinitely less provable/disprovable such as the divine). Theories are meant to be correct in so much as there is overwhelming evidence toward their ideas.

    The book appears to make some good points, however. (Just from the synopsis provided.) The infinitude of random factors that may cause market fluctuations makes prediction completely (probably?) intractable. In CS lingo, it would appear to be NP-Complete. ;)

    1. Re:Theories by pmineiro · · Score: 2, Informative

      In CS lingo, it would appear to be NP-Complete. ;)

      Don't want to troll too badly :), so please take in good sprit ... but everybody here seems to treat NP as a synonym for "difficult to solve."

      Easy mnemonic: an NP problem has a solution that can be verified in polynomial time. Clearly, lots of problems that people casually say are NP are actually far far harder.

      The open question P=NP question is essentially whether there's a way to quickly (polynomially) find the solution to verify.

      'nuff said.

      -- p

    2. Re:Theories by Root+Down · · Score: 1

      Taken in completely good spirits - your completely non-flamable response is greatly appreciated. NP-Complete is solvable in NP, but it cannot be proven whether the problem is verifiable in P or not. This was the allusion I was making - the fact that it cannot be proven one way or another, not just that it was difficult (or not) in the first place. I do agree that people tend to associate NP with extremely difficult problems, whether this is true or not. :)

    3. Re:Theories by dracken · · Score: 5, Informative




      The infinitude of random factors that may cause market fluctuations makes prediction completely (probably?) intractable. In CS lingo, it would appear to be NP-Complete. ;)


      Okay I am a CS theory puritan and a troll. But here is the deal.

      Rant #1: Intractable problems are unsolvable problems. Even if you have infinitely powerful machines. Because our logic (the foundation of our math) has "holes" that prevent it from solving them. Halting problem (can you write a program that will verify if a program is correct)is an example. It simply cant be done.

      Rant #2: NP hard problems are hard to solve. You just need lots of time. Throw in a trillion years and a very powerful computer and heck - you have a solution. Quantum computing *may* solve these NP hard problems in polynomial time. Still Quantum computing cannot solve intractable problems.

      Rand #3: NP problems are not the most difficult to solve problems (among the solvable problems). In fact they are the easiest. There is something called polynomial hierachy of harder and harder problems and NP is at the very bottom.

      Rant #4: Only problems that have a one bit solution (yes or no, true or false) can be NP complete. Others are "hard".

      Further references to be directed at "computational complexity" by papadimitrou.

      Sorry but had to take it out on someone ;).

    4. Re:Theories by G.+W.+Bush+Junior · · Score: 1

      >> ...there are only two kinds of scientific theories: those that are demonstrably false, and those that are not yet demonstrably false.

      > Well, yeah - that's why they are theories and not laws.
      w00t?!?!
      How can you say that? You mange to contradict yourself in one sentence...
      If all theories will eventually become demonstrably false, how does a theory become a law then?

      --
      "I don't know that Atheists should be considered as citizens, nor should they be considered patriots." -George H.W. Bush
    5. Re:Theories by khallow · · Score: 1
      Well, yeah - that's why they are theories and not laws.

      There are no scientific laws. That was his point.

    6. Re:Theories by Doug+Merritt · · Score: 1
      Rant #4: Only problems that have a one bit solution (yes or no, true or false) can be NP complete. Others are "hard".

      Don't forget the class of problems that can be transformed into a one-bit solution. Traveling Salesman doesn't initially have a one bit solution, but it's still NP-complete rather than NP-hard because it can be thus transformed.

      --
      Professional Wild-Eyed Visionary
    7. Re:Theories by Anonymous Coward · · Score: 0

      Because our logic (the foundation of our math)

      --the mathematicians surely just shuttered...

    8. Re:Theories by bm_luethke · · Score: 1

      Rant #2: NP hard problems are hard to solve. You just need lots of time.

      It's also important to note that the algorithm may be well known and quite small (as in number of lines) but take a REALLY long time to run.

      One of the biggest "disappointments" of my CS carrer was seeing some of the "grand challenge" problems that takes weeks/months to code (as I have seen more of them they have now transitioned back into the "COOL" category). Some as nothing more than a simple mathematical equation and distributing that answer to many nodes at each step, it just needs done 5 billion billion times to get a good answer. Some of these are as small as 5000 lines of code.

      To a non theoretical CS person hard had always meant "took great brain power to develope algorithm", took me several classes before I realised what was meant by "hard".

      --
      ------- Sorry about the spelling, I suffer from two problems. Dyslexia makes it difficult to spell well, lazy makes it
    9. Re:Theories by HuguesT · · Score: 1

      Hi, I'm confused,

      > NP-Complete is solvable in NP, but it cannot be
      > proven whether the problem is verifiable in P or not

      I thought:

      P is the class of problems that can be solved in polynomial time.

      NP doesn't mean Non-Polynomial, it means Non-deterministic Polynomial. This refers to problems where if you could get a `computer' who could *guess* the solution (in a non-deterministic way) then you could *verify* that the solution is correct in polynomial time.

      NP-Complete is a class of problems all equivalent to one another. If you can find a solution in P for one it would work for all the others.

      Now the big open question is: is P==NP? It hasn't been proven either way, but AFAIK, it hasn't been proven either that the solution is unknowable, which you seem to imply.

      Are we talking about the same thing? Thanks.

  11. Book Report by ShelfWare · · Score: 1

    This sounds more like a book report than a review.

    1. Re:Book Report by Anonymous Coward · · Score: 0

      Get used to it. The vast majority of Slashdot book reviews are little more than book reports with a link to buy it.

  12. Another Good Book on a Similar Topic by ian+tichy · · Score: 5, Informative

    ... is Innumeracy: Mathematical Illiteracy and Its Consequences by John Allen Paulos. I read it a couple of years ago, and thoroughly enjoyed it. I think it is an excellent commentary on how probability, large numbers, and basic mathematical principles are largely misunderstood by the general public, and the effects that this phenomenon has both on lives of individuals and society as a whole (e.g. the embrace of numerology, or public policy based on sleight-of-hand statistics). All in all, a short, entertaining, and insightful book.

    --
    Life is too important to be taken seriously - Oscar Wilde
  13. Mischaracterization of conservativism by Anonymous Coward · · Score: 5, Informative

    Conservatives tend to think you are where you are because you deserved it. Dumb and lazy people are poor, smart and hard working people are rich. Dumb people get hit by trains, smart people comment on how dumb they are. Your situation is a result of your disposition.

    This viewpoint is absolutely not essential to conservativism. It is unfair to characterize conservativism as people who punish the poor because they "deserve it."

    There is a legitimate conservative idea that many well-meaning social welfare programs actually trap people in poverty by encouraging failure and discouraging success. Clinton famously "ended welfare as we know it" because he believed this kind of reform was the right thing to do.

    Of course there is also a wrong kind of conservativism (practiced by many Libertarians and Republicans), in which welfare is cut, while job training programs are cut as well.

    Centrists of both parties (such as Clinton) recognize and co-opt the good parts of conservativism and of liberalism. When you say that you can't stand conservatives, I think what you really mean is that you can't stand the self-righteous, self-promoting bigots who make a mockery of the ideology they unfortunately claim to represent.

  14. Personal Responsibility by NDPTAL85 · · Score: 1

    I don't know how you can be more angry at Conservatives and not at Liberals considering the kind of society we live in where the first response to any incident is "sue". There is no longer a concept of personal responsibility. Its always "the other guy's" fault.

    You fat? Sue McDonalds.
    You fail your classes? Sue your teachers.
    You offended by something someone has said? Sue the author.
    You want to maintain your manufacturing job that is an overpriced labor cost to your company? Sue to prevent outsourcing.....etc.

    --
    Mac OS X and Windows XP working side by side to fight back the night.
    1. Re:Personal Responsibility by Anonymous Coward · · Score: 0

      It's the american way!

    2. Re:Personal Responsibility by Anonymous Coward · · Score: 0

      actually it's the hardcore nothingismyfaultitsalwayssomeoneelses liberal way which sadly america is becoming this way...no one does any wrong anymore...you kill your kids? oh it was the drugs i was on it's not my fault...you play with a gun and shoot someone cause you are too damn bumb to check if its loaded (not that you should be playing with guns anyway)...oh it's not my fault it's the company that made the gun's fault....

      i still wanna know how guns kill people i've had a gun in my closet for years and it's never killed a single person....

    3. Re:Personal Responsibility by Anonymous Coward · · Score: 0

      yeah, and i think everyone has the right to own as many guns as they want. nuclear weapons should be regulated somehow, however. you know, there are many whackos out there.

    4. Re:Personal Responsibility by hondo77 · · Score: 1

      Terrorists crash into the building housing the brokerage firm your spouse worked for? Don't stop at suing the airlines, whine about not getting enough money from the government because he/she made a lot of money (and wasn't smart enough to have life insurance).

      Oh, I'm sorry. People at brokerage houses tend to be conservative. I was hoping to help your argument. Looks like you'll have to find another stereotype to liberal-bait.

      --
      I live ze unknown. I love ze unknown. I am ze unknown.
    5. Re:Personal Responsibility by hsidhu · · Score: 1

      I have to disagree with you on this point. A lot of people had large sums of life insurance, but the insurance companies went to the Washington and said that if they had to pay out all the policies they would go bankrupt. Hence Washington said, this was an act of terrorism people can collect on the insurance policies they had, but Washington will pay a certain amount depending on the amount of money any given person made.

      Now, this is what irks me. NO one is the media talks about this point. We are a capitalist country there for the insurance companies should have been made to make payments regardless if there is a possibility of them going bankrupt. That is the risk they took while underwriting those policies.

      Just another example of Washington being the pocket of Big Business and bailing them out one more time.

    6. Re:Personal Responsibility by hondo77 · · Score: 1

      A lot of people had large sums of life insurance, but the insurance companies went to the Washington and said that if they had to pay out all the policies they would go bankrupt.

      That's not the way I remember it.

      --
      I live ze unknown. I love ze unknown. I am ze unknown.
  15. Random walks by watchful.babbler · · Score: 4, Interesting

    As provocative as the book's thesis seems to be -- and I must admit that my information on it comes entirely from this review -- it's not new. In the 1970s, Burton Malkiel's A Random Walk Down Wall Street posited that market fluctuations are mutually independent, though the market follows a general upwards trend, and thus it's impossible (ceteris paribus) to make any bets on short-term stock performance. The upshot is that the only way to beat benchmark indexes is to assume additional risk: trying to beat the market in most cases is nothing more than gambling on an upmarket roulette wheel.

    --
    "Freedom is kind of a hobby with me, and I have disposable income that I'll spend to find out how to get people more."
    1. Re:Random walks by mghiggins · · Score: 2, Informative

      As provocative as the book's thesis seems to be -- and I must admit that my information on it comes entirely from this review -- it's not new. In the 1970s, Burton Malkiel's A Random Walk Down Wall Street posited that market fluctuations are mutually independent, though the market follows a general upwards trend, and thus it's impossible (ceteris paribus) to make any bets on short-term stock performance.

      That's a bit inaccurate in two ways:

      1) Taleb doesn't claim the market is an efficient random walk - he thinks the market inefficiently prices events that have low probability because people are bad at estimating low-prob events. He capitalizes on that mispricing by buying low-prob events, mostly losing money but occasionally scoring big (and hopefully making money on average).
      2) Even if the market *is* a random walk, you can still expect to make money in the long term because the stock market pays a better return on average than, say, the bond market. That's because investors demand a higher return in exchange for the extra risk due to stock volatility. But that only applies to investing for the long term, not day trading. Over short terms the extra return is completely swamped by the noise from volatility.

      --
      All opinions expressed herein are not my own; I haven't had free will since last year when aliens ate my brain.
    2. Re:Random walks by number6x · · Score: 1
      "... , and thus it's impossible (ceteris paribus) to make any bets on short-term stock performance."

      Its not impossible to make bets on the short term. You can place all the bets you want. You will win some and lose some.

      Malkiel makes the point that it is highly improbable that you will accurately predict the outcome of your bets. You are more likely to be able to predict the long term perfomance (over 30 + years) of the market.

    3. Re:Random walks by devonbowen · · Score: 2, Interesting

      The problem is that markets are provably not random walks. A random walk would result in a gaussian distribution of price moves but it is well known that the distribution of financial markets have "fat tails" (heteroskedasticity) when compared to a gaussian. Meaning that extreme events like crashes happen more frequently than they are supposed to. One can question whether these deviations from random are sufficient to allow any prediction. But stating that the markets are a "random walk" is really just wrong.

      Oh, and the above assumes any general "upward trend" in, for example, a stock market, is taken out of the data. Some markets (like currency, for example) don't have an upward trend.

      Devon

    4. Re:Random walks by EnlightenedDuck · · Score: 2, Informative

      Being a statistician I'd like to point out that you can define a random walk with any distribution that you want. The simple random walk is the sum of random variables that are either +1 or -1 (think flipping a coin, take a step to the left on a heads, and a step to the right on a tails). If each of your steps has a gaussian distribution, then you are observing a Brownian Motion on a lattice (i.e. at integer times). No reason why you can't use a heavy-tailed distribution to define your random walk.

      --
      Quack!Quack!.....QUACK!!
    5. Re:Random walks by richg74 · · Score: 2, Interesting

      Actually, the idea is older than that. There is another very amusing book called, Where are the Customers' Yachts?, by Fred Schwed, first published ca. 1940. In an appendix, he describes a coin-tossing championship along the lines of Hitchcock's swindler, which someone else mentioned. At the end, "there are the winners, the coin-tossing experts who have flipped ten heads in a row. They cannot lose."

      You can see a reprinted edition at Amazon:

      http://www.amazon.com/exec/obidos/ASIN/0471119784

      You might also want to have a look at Extraordinary Popular Delusions and the Madness of Crowds, by Charles Mackay.

  16. Surfing on the Noise Floor by Alien54 · · Score: 3, Interesting
    A lot of times you can see a legitimate trend in a noisy signal. The problem is to determine when you are looking at variations that are in fact noise produced, vs legit trends. And humans seem to be geared to picking out a signal from the noise in the first place, even if they often get it wrong.

    The stock market, day traders, etc are all dependant of this sort of thing. even though the possibily that their successes are often not distinguishable from random luck gives them all nightmares.

    kinda difficult to pick out signals where they are buried in the noise floor to begin with.

    --
    "It is a greater offense to steal men's labor, than their clothes"
  17. Can't be... by gmuslera · · Score: 1

    ... Murphy should be right. Is one of the more universal laws.

  18. Occam's Razor by MisterMook · · Score: 2, Funny

    I'm not dead because I'm alive.

    1. Re:Occam's Razor by Anonymous Coward · · Score: 0

      If you slit your jugular vein with Occam's Razor, you will probably die. Then you will be dead, and you will not be alive.

      This has been a friendly reminder from your friend Mr. Obvious.

    2. Re:Occam's Razor by filmsmith · · Score: 1

      Actually, you're not dead because nothing has killed you. Life (like death) is an effect, not a cause.

    3. Re:Occam's Razor by MisterMook · · Score: 1

      I suppose that's something for Biblical scholars to argue about. All I know is that it's nothing I caused and nothing that I have more than supporting evidence that anyone else had much to do with either, I'm just here.

  19. Another good book by wtarle · · Score: 3, Informative
    A very interesting read that covers more ground and covers more social misconceptions and misinterpretations is Thomas Gilovich's How We Know What Isn't So.

    Very good read.

  20. he has some good points, but also overlooks a few by AssFace · · Score: 2, Interesting

    The main issue I have with what he says is comparing Time Series analysis (a topic that is near and dear to my heart), to the people that read the bible and then find prophetic phrases in there.
    Aside from that being a bad analogy (but it sounds good if you don't know anything of time series analysis), it is also misleading in that time series analysis can be proven if it will work or not.

    There is an equation (that is f'ing driving me nuts right now that I can't recall the name of it) that will tell you if your time series data is truly random or if it leads to predictability.
    It has been shown over and over again that the stock market, were it a perfect market would in fact be random - but since there is human intervention that drives it, it is no longer truly random and there are non-linear patterns that are within the data.

    The human brain is wired to pick up on linear patterns (to the point we see them where they are in fact not really there - it is advantageous to us to see a lion in the brush and run - when in fact there isn't a lion there, than the other way around and get mauled by a lion that we never saw).
    That is more to what he speaks of, humans seeing what isn't there (there are a crapload of great books written about this - How We Know What Isn't So: The Fallibility of Human Reason in Everyday Life by Thomas Gilovich immediately comes to mind) - but the way he speaks, he also includes computational analysis in there and is wrong in his generalization.

    Now it is going to bug me all day as to what that frickin' algorithm is called - the one that shows the strength of your time series data... I know it doesn't start with an A, or a Z... and I don't think there is a C there... other than that, I'm pretty much at a total blank.

    --

    There are some odd things afoot now, in the Villa Straylight.
  21. Fooled by randomness by scotay · · Score: 1

    Well, I've never been fooled by a random ness, but once I was drunk enough that this dude did manage to pull a Crying Game on me.

    To avoid embarrassment, always check first for an expectedly large seed value before wasting any of your time.

  22. hitchcock stock scam by louabill · · Score: 5, Interesting
    Hmm... there was a Hitchcock episode about a scammer who chose 2^n folks (I think n=12 or 13), and
    1. mailed 1/2 the folks a prediction that stock X would rise, mailed the other 1/2 the opposite.
    2. threw away the 1/2 who ended up with the incorrect prediction
    3. repeated until there were a few folks left who had gotten 10 correct predictions (either 4 or 8 people, depending on n)
    4. asked the remaining folks for investments.
    5. split with the cash
    Now imagine stock analysts all making predictions. Eventually there will be a star.
    1. Re:hitchcock stock scam by KingTank · · Score: 1

      I believe his name is "Warren Buffet". Seriously, though, that is an ingenious scam. Much more easily propogated in this age of email spam, too.

    2. Re:hitchcock stock scam by Drakonian · · Score: 1

      Wow, that's a clever scheme. Sounds like a potential spam campaign, except n = 25 or so.

      --
      Random is the New Order.
    3. Re:hitchcock stock scam by fizbin · · Score: 1

      That's a pretty standard postal mail fraud scam - there was even a few episodes of the public television TV show "Square One" which dealt with a similar scam. (in the "MathNet" sketches)

  23. darwinism and the markets by EMiniShark · · Score: 1

    This is particularly concerning for those of us involved with evolutionary computation in trading stocks and futures. I havent read the book, is he claiming that optimization of trading stratgies through genetic algorithms, or that neuroevolutionary strategies wouldnt work? Jeff Katz uses GA optimization to great effect in _The Encylopedia of Trading Strategies_.

    1. Re:darwinism and the markets by Anonymous Coward · · Score: 0

      so, you 'optimise' by using back testing.

      you check that your optimisations are 'stable' , i.e you expect them to apply long enough into the future to make some money.

      so you trade.
      and you make money.
      of course you do, you've adopted a strategy that has risk, and risk means reward. but you've carefully selected your risk profile with fancy math so that most of the time you win a little, and once in a blue moon, you lose bigtime. every adjustment you make to limit the big losses eats a little more into each and every one of your gains.
      and you haven't estimated the probability of those losses happening, because your methodology cannot do that.

  24. Pretending the world is NOT random is most logical by release7 · · Score: 4, Insightful
    It's quite easy to accept the fact that life is rather meaningless and random. Nihilism has been around for a long time, even before the philosophy of nothingness had a name. However, where does that get you? If you lived and breathed every moment thinking everything was meaningless and random and that you ultimately could make no sense of it all nor had no control over it, you wouldn't get much done. After all, everything you do is meaningless and random.

    The solution is to PICK something important that may not be meaningless and random. After all, the world just might not be meaningless and random. This is kind of like Pascal's wager. If you go around believing everything is meaningeless and random and act accordingly like it is, than you gain nothing. You'd sit home and drink beers and watch Jerry Springer all day because theoretically, you aren't any worse or better off than Mother Theresa, Bill Gates, or any other "successful" person. If, however, you pick a goal or ideal to work toward and give it meaning, your life does have meaning and value. At the very least, if others around you deem your efforts worthy, you will gain the love and affection of others (which MOST people are biologically wired to need and crave). Therefore, it is possible to gain something (the pleasure of being valued) out of the void of randomness by giving your life some purpose, even if that purpose is ultimately meaningless in the big scheme of things.

    So keep playing the game of life. You've got nothing to lose and only stand to gain.

    I read it on Slashdot!

    --

    <a href="http://www.joblessjimmy.com">Work is dumb and so is Jobless Jimmy.</a>

  25. Pi by Anonymous Coward · · Score: 0

    For a sci-fi angle on finding patterns in the stockmarket, see the film Pi

  26. Wasn't there something in Ecclesiastes about this? by dpbsmith · · Score: 1, Interesting

    ...something about seeing under the sun, that the race is not to the swift, nor the battle to the strong, neither yet bread to the wise, nor yet riches to men of understanding, nor yet favour to men of skill; but time and chance happeneth to them all?

    I guess it just goes to show that there is nothing new under the sun.

  27. Re:Pretending the world is NOT random is most logi by Goronmon · · Score: 1

    I don't the point is taht you can't contriol anything in your life, I think the point is that a lot of the time good or bad things can happen regardless of any choices you have made in the past.

    I mean, all you can really do is put yourself into a situation where good/bad things could happen.

    For instance, someone who has worked hard throughout their student life, got a master's degree in engineering is much more likely to get decent job than a high school drop out, but that doesn't mean either person is garaunteed a job or never getting one. I mean, it wouldn't be uncommon for that engineer to be stuck in dead-end jobs for years while the high school drop out makes a fortune. But the chances are higher that it will be the other way around.

  28. Random? by null+etc. · · Score: 1

    I'd rather be lucky than good.

    1. Re:Random? by MaxTardiveau · · Score: 1

      That was Napoleon's opnion too -- given a choice, he'd rather have a lucky general than a good general. I think that may have something to do with the fact that he dealt mostly with extremely rare, high-risk events (i.e. battles). But then again, how do you define lucky ? And we all know that luck is not a real quality to begin with (although, when you look at e.g. De Gaulle and the number of assassination attempts he survived, you start wondering).

  29. Re:Pretending the world is NOT random is most logi by release7 · · Score: 1
    I agree with you, absolutely.

    But I wasn't necessarily commenting on the book. I haven't read it. But based on the review and the links here, the books seems only to confirm something I already felt in my bones: traders and economists sling a lot of BS around. But you know what? A little BS in a world of uncertainty and randomness can carry you a long, long way. Tha't why traders and economists are so full of BS!

    --

    <a href="http://www.joblessjimmy.com">Work is dumb and so is Jobless Jimmy.</a>

  30. Re: Randomness by Anonymous Coward · · Score: 0
  31. Jim Rogers versus Victor Niederhoffer by Heimskringla · · Score: 1

    The one thing that I didn't like in the book was how he trashed Jim Rogers because of a statement he made in 1989 in Market Wizards. Rogers said he didn't like to buy options because 80 to 90 percent of options expire worthless. He basically thinks Rogers is one of those lucky idiots who somehow made a fortune. In another part of the book, he has nothing but praise for Victor Niederhoffer, who bankrupted his company trading options. He lost a lot of credibility with me because of this. I did enjoy the book very much, except for these points.

  32. Re:Pretending the world is NOT random is most logi by kingk0ng · · Score: 1

    True, true ... but don't you find that the arbitrary nature of picking a goal like that undermines your belief in it in an insurmountably recursive way?

    What can you do. Shrug your shoulders and smile as /dev/random scrolls past.

  33. Everything is random... by tamen · · Score: 1

    So, basicly everything is random? Great, Ive been living like that for years. Havent bought a lottery ticket in as long. Its about as likely to buy a winning ticket than finding a winning ticket on the street ;)

  34. Re:Pretending the world is NOT random is most logi by release7 · · Score: 1

    Yup. Now please excuse me while I go get another beer. Jerry Springer is almost on. :)

    --

    <a href="http://www.joblessjimmy.com">Work is dumb and so is Jobless Jimmy.</a>

  35. estimation by Parsec · · Score: 2, Interesting

    Something else I've noticed people being bad at is estimating ratios. Example: back in high school an English teacher asked the class what the population ratio of blacks to whites in Michigan was. Some guessed as high as 50%, but I was the only one with the correct (lowest) answer of around 10%.

    I have always wondered what affected this the most. It could be that we were a suburb of Detroit, or that the local television stations' news programs may have featured more black people (scaring white viewers makes for good ratings), or that these kids hadn't travelled very far from the Detroit area, or that they were just really lousy at estimation of distances and population and had no concept of the size of the state.

    Certainly, some of the error may have come from cultural bias. I didn't notice any overt racism in the school, but the specter of the "dangerous negro" was/is probably still present.

    Is this still on-topic? Anyway, it seems that we need to do better in our educational system of teaching people how to get their heads around the concepts of chance and estimation. Letting any bias influence these will cause errors.

  36. Quantifying the randomness by Inflatable+Hippo · · Score: 2, Interesting

    Fantastic sounding book, I've ordered it.

    I've long since been a believer in the "largely random" nature of the world and this puts me in mind of a wonderful piece of "research" I came across in New Scientist a few years ago.

    It cut through a lot of bullshit to ask the question:

    "can you predict the longevity of a system or state if you know almost nothing about it"?

    i.e. life's pretty random and bothering to analyse the details will only get you so far :-)

    So how can we address, from a probabalistic standpoint, questions like:
    "How long will the pyramids stand"?
    "How long before my bank goes bust"?
    "How long before we're hit by an asteroid"?

    The reasoning went like this:

    Take any "thing"/"system" etc. with a finite existance and ask the question:

    "With a 95% certainty, how much time does it have left"?

    For the sake of argument lets say you plant a tree, and you know nothing about trees.

    Ten years later you come back and the tree is still alive and so you ask the above question about the tree.

    Well, the tree is clearly alive but you don't know where "now" is in it's lifespan.

    From a purely probabalistic point of view you've got a 50% chance that "now" is the middle half of it's life, i.e. you're not in the 25% of it's "youth" or the 25% of it's old age. So thats a 50% chance that it's had 75% of it's life already (middle age + youth).

    Turning this into an equation, if:
    x = current age
    y = total age
    p = probability

    then: (it helps with a diagram)
    x = py + (y-py)/2
    or, rearranging to solve for y:
    y = 2x/(p+1)

    Going back to our tree then, if it's 10 years old
    it's got:
    95% chance of making it to 10.26 years
    50% chance of making it to 13.33 years

    The magic figure I keep in my head is that if you know NOTHING about something, you've got a 95% chance that it will last 1/39th as long again.

    I find this little nugget invaluable when considering how much to spend on insurance or investments - cos I know/care NOTHING about them.

    After all, why bother with the details, life is random :-)

    1. Re:Quantifying the randomness by Anonymous Coward · · Score: 1, Interesting

      I don't know who wrote the article you read but it sounds like Richard Gott.

      If I recall correctly, this approach predicts that the demise of a thing that has lasted x years has a 95% probability of coming between x/39 and 39x years later. So if human civilization has lasted 4000 years (just to pick a number) then it should, with very high probability, last more than ~100 years, but less than 156000 years, from today. There's a 5% chance of it lasting either less than 100 years or more than 156000 years from today.

      Comment #1: That's a pretty wide span, so it isn't all that useful a prediction.

      Comment #2: At what point should the measurement of a phenomenon begin? Did civilization begin with the bronze age or the stone age? One could pick different points depending on how civilization is defined.

      Comment #3: It doesn't tell us what happens at the end. Will civilization come to a complete end at that time, or will it be replaced by something else? In other words, maybe we are only predicting the "terran phase" of civilization.

      Comment #4 (related to #3): Doesn't work with cyclic phenomena. What if civilization develops in a series of waves, with the most recent wave starting from the Renaissance and ending with another Dark Age N years from now? Perhaps you can apply it to the current wave but not to all of civilization.

      Comment #5: If there is any a priori information that is knowable (but perhaps hidden from you) then your estimate is useless. For instance, that 10-year old tree could have quite a different life expectancy if it's a fir on a Christmas tree farm, than if it's an oak, or a sequoia, or a bristlecone pine.

      So, while there's some validity in Gott's thinking, use some discretion in applying it.

    2. Re:Quantifying the randomness by Inflatable+Hippo · · Score: 1

      I have to agree with all the points you make, but bringing things (in a desperate attempt to not be marked off-topic) back to randomness, we frequently have insufficient or worse, useless/wrong information about systems.

      Referring back to the tree example, yes knowing what species of tree it was would help you predict it's longevity, so would an understanding of the soil type, local environmental laws, climate, aspect etc. etc.

      Where do you stop? How much would this data/knowledge actually improve your guess?

      I find that the 95% of lasting >x/39 is at least a good starting point that can be refined up or down as knowledge increases.

      Often in life we are trying to evaluate comparative risks of things we have a poor understanding of.

      For example I often apply it to the life of theories and assertions (however "proven" they're deemed by "experts").

      Say (as so often happens) a food that humans have been eating for decades/centuries is suddenly flagged as a dangerous (like fried foods are suddenly a lethal carcinogen), how much should I trust the longevity of that belief?

      Alternatively suppose a new "wonder non fattening oil" or G.M. wheat appears on my breakfast table, how much should I trust the assertion that it's safe?

      I'm not a biochemist but I at least have a way of approaching the problem. I'm free to refine my odds as people drop dead around me - or not.

      How I relate the CONSEQUENCES to the RISK is, as you imply, a matter of judgement.

      However, the God of Randomness only takes short vacations from my life, so far, statistically speaking...

    3. Re:Quantifying the randomness by Anonymous Coward · · Score: 0

      One of Gott's own (I think) examples was when you attend a friend's wedding. Can you use his formula to make a prediction, one hour later, about how long the marriage will last? No, because you have picked a special moment in time to do so. You'd erroneously conclude that there's a 5% chance that they will divorce within the next few minutes. Gott used this example to explain the limitations of his method.

      So if a new report comes out about food safety, you can't immediately assess the probability that that new belief will last a certain amount of time.

      How long should you wait after the wedding or the food report before you can use this method? There is no guidance for that, that I am aware of. Over time, your revised probability estimate should improve in accuracy.

      I don't mind the thought of using it as a very rough starting point, but the key, which you correctly noted, is to get more information in order to refine your odds.

      The passage of time itself can be viewed as an accumulation of information. One week after 9/11/2001, what would have been your estimate of the length of time before another attack of similar magnitude would occur? What would be your estimate today? Which estimate is more accurate? The fact that no comparable events occurred in the past 17 months is information you have now, but didn't have then.

  37. Proven with Experiments? by mikosullivan · · Score: 2, Insightful
    Are the claims that successful traders better than average proven with any kind of experimentation? Did he, for example, take 20 successful traders ("successful" being objectively determined according to some plainly stated critera) and a control group of 20 random people, had them play the market for a year, then compare the results?

    I'm just as suspicious of claims that it's all luck as I am that it's all skill.

    --
    Miko O'Sullivan
    1. Re:Proven with Experiments? by Anonymous Coward · · Score: 0

      The author never says all luck; only MORE luck than people think

    2. Re:Proven with Experiments? by cyril3 · · Score: 1
      I remember one article about the success or otherwise of individual traders which suggested that to know whether the ability of an individual trader to consistently beat the market was due to luck or something else would require about 72 years of data points. I presume that's based on the relatively few decisions they actually make.

      If that's anything like the truth then its safest to assume that its luck.

  38. More like this... by toganet · · Score: 1, Interesting

    Check out these books by Robyn M. Dawes, another heavywieght in the emerging field of 'decision science.'

    Rational Choice in an Uncertain World: The Psychology of Judgement and Decision Making

    Everyday Irrationality: How Pseudo-Scientists, Lunatics, and the Rest of Us Systematically Fail to Think Rationally

    House of Cards: Psychology and Psychotherapy Built on Myth

    1. Re:More like this... by porges · · Score: 1

      One I haven't seen mentioned yet:

      Inevitable Illusions : How Mistakes of Reason Rule Our Minds

      by Massimo Piattelli-Palmarini

  39. Re:Pretending the world is NOT random is most logi by Longfinger · · Score: 1

    bullseye!

  40. Is anything really random...? by cr0sh · · Score: 1
    Or is it just that the "universe" and everything in it is defined by a massive Turing machine cellular automata that has been running for a very, very long time?

    I know I am going to be flamed for this, but this very topic is discussed at extreme length in Stephen Wolfram's book, "A New Kind of Science". He specifically goes on end about a particular one-dimensional cellular automata, "rule 110" (IIRC), which seems to produce randomness, but which is based off of a small handful of simple rules, and a base starting condition of a single black pixel. He demonstrates in excruciating detail how, no matter how complicated you make a system, that all such systems can be brought back to the set of simple one-dimensional CAs. He demostrates how Turing machines can be set up (via initial starting conditions - not just a single pixel) which use these same CA to perform Turing machine calculations - thus these same CA can, in theory, execute (albeit very slowly) and emulate any current computer or program in existance today. He names this "the principle of computational equivalence".

    He explores at great length how systems that are seemingly random can actually be simulated by these self-same CAs, which are based on simple sets of rules - blowing away the time-held notion that complexity arises from an underlying complex ruleset. It stands to reason that given the ruleset, and a result output from the CA, one can work back to the initial starting conditions - the problem arises in that we may only have the initial conditions, figuring out that ruleset is (probably) impossible.

    He explores our current methods of perception and analysis, and shows how while our current methods of analysis show that something is random, as humans using our senses we have an affinity for picking out what look to be like patterns - he seems to make the point (unless I have misinterpreted him - which is very likely) that it isn't our senses decieving us, it is our methods of analysis that are incomplete. He also presents ideas and thoughts on how we can overcome these limitations.

    The book is much more than that, however - I have read articles dismissing the work as everything from a form of plagerism (at worse) to restating others thoughts (at best). I do not believe this is the case. While it is true many others in the past have played with CAs, what Wolfram has done is go that extra step, building on these ideas and bringing them all together under one umbrella of thought. He acknowledges this throughout the book.

    Anyone interested in these topics and others tangent to them owes it to themselves to read Wolfram's book and come to their own conclusions. I honestly believe he is on to something, which could have profound effects in the future (perhaps far in the future, but much sooner if we read it and understand it now).

    Other related links:

    Collection of Reviews on ANKOS
    Stephen Wolfram's Web Site
    ANKOS Web Site

    --
    Reason is the Path to God - Anon
  41. Re:Wasn't there something in Ecclesiastes about th by Anonymous Coward · · Score: 0

    Yeah. That's Ecclesiastes 9:11. It's the biblical equivalent of "shit happens."

  42. Two thumbs up... by Anonymous Coward · · Score: 0

    I would like to applaud the submitter of this story, and the courageous editor who approved it (despite there being no mention of how sucky Microsoft is, or how linux won 25 new computers in a Tazmanian pre-school)... It's the most interesting read I've had on slashdot in months!

  43. Another Book to Check Out by hondo77 · · Score: 2, Insightful

    I read The Fortune Sellers a few years back and it seems to be along the same lines. Basically, people who "predict" the future (be it the stock market, the weather, lifestyle trends, etc.) will highlight the year they got it right and not mention the times they got it wrong. Read it and you'll look at things differently (and never listen to long-range weather forecasts again).

    --
    I live ze unknown. I love ze unknown. I am ze unknown.
  44. Non-random factors defeat traders too by KingTank · · Score: 2, Insightful

    For instance, if every single person in the world is bullish on the stock market then you can bet that the markets will start to decline immediately because everyone who can get into the market already has, and there are no buyers left. So there are factors that tend to ensure that most people will lose money.

  45. Choices. by Lemmy+Caution · · Score: 2, Interesting
    The thing is that "choices" is bandied about in this situation as a complete black-box, without asking how people make choices, how they percieve what those choices are, and when the understand what the consequences are. Largely, the "choice-making" facility that the poor and unfortunate are failing at are failures of education to begin with (both formal - understand just what is possible and what input creates what output - and informal - understanding social patterns and behaviour outside of one's own in-group).

    It's why people from "better" backgrounds can recover from poverty quickly - why good business-people can create new businesses from catastrophes repeatedly - and why very hard working people who don't know how to work tactically can still die poor. Knowledge and social networks are what keeps one out of poverty, not hard work.

    As an aside, drug addiction exists in that gray area between choice- and not-choice, since it can be thought of practically as a "disease of the choice-making mechanisms of the mind." When drug addiction is responsible for poverty, there's little chance of escaping the poverty without addressing the addiction; likewise for mental illness.

    1. Re:Choices. by osgeek · · Score: 2, Interesting

      It's why people from "better" backgrounds can recover from poverty quickly - why good business-people can create new businesses from catastrophes repeatedly

      It could be equally argued that they were in those "better" backgrounds because of some genetic advantage. You'd really need to do a large number of controlled studies to determine the order of the cause and effect there. My suspicion is that both genetic propensities and social frameworks play a part.

      Knowledge and social networks are what keeps one out of poverty, not hard work.

      Hard work is an important element, and you can't just discount it out of hand.

      As an aside, drug addiction exists in that gray area between choice- and not-choice

      What is a choice, then? I know smart people who are "addicted" to EverQuest to the point that their work quality seriously suffers. Are they making a choice? If I go home early to watch TV or read a book, am I making a choice or just a slave to some electrochemical impulse in my brain?

    2. Re:Choices. by Lemmy+Caution · · Score: 1
      Business-sense is too complex, contextual, and culturally specific to link to genetics. There are certain types of cognitive fluency that you *can* link to genetics: resistence to distraction, low levels of social anxiety and fear of rejection, general energy and stamina, ability to maintain sophisticated mental models. But at the level of "analysis" we are talking about, looking for genetics is like trying to do literary criticism by discussing bookbinding techniques - it's just not a promising line of inquiry.

      Hard work is an important element, and you can't just discount it out of hand.

      Hard work can make a difference between levels of success. However, someone with knowledge and connections can put forth a mediocre effort (albeit backed by a good plan) and outperform someone who works much, much harder.

      What is a choice, then? I know smart people who are "addicted" to EverQuest to the point that their work quality seriously suffers. Are they making a choice? If I go home early to watch TV or read a book, am I making a choice or just a slave to some electrochemical impulse in my brain?

      A good working definition of addiction is in the displacement of normal-typical developmental goals. If taking a drug / gambling /drinking / playing a game displaces goals such as maintaining relationships / paying rent / caring for children / obtaining medical care, then there's a problem. I'm not going to profer a model for something that is still not understood, but I will suggest that different stimuli in different people can trigger such a displacement.

      I think that there are models of choice that are compatible with determinist models of cognition (and I otherwise pass on any free will v. determinism argument - I'd rather discuss cognition and social behaviour than metaphysics), that given a fairly intact set of goal states, an agent is aware of any number of strategies for achieving them, and the process of determining one of them is not unduly constrained. Addiction distorts the goal-state values, and mentall illness in general constrains throughout the system.

    3. Re:Choices. by Eric+S.+Smith · · Score: 1
      ... am I making a choice or just a slave to some electrochemical impulse ... ?

      Yes.

  46. It is impossible to prove an unrestricted negative by benzapp · · Score: 1

    Writing about Karl Popper, he points out that there are only two kinds of scientific theories: those that are demonstrably false, and those that are not yet demonstrably false.

    In fact the exact OPPOSITE is true. You can never prove an unrestricted negative.

    Some things are inherently impossible, like a married bachelor, or round square. Only contradictions are truly false.

    Anyway, here is a good discussion on the subject.

    --
    I don't read or respond to AC posts
  47. term slippage by geolane · · Score: 1

    I find it interesting when the terms "investor" and "trader" seem to be interchangable.

  48. Re:Pretending the world is NOT random is most logi by Blnky · · Score: 1

    Deep in the human unconscious is a pervasive need for a logical universe that makes sense. But the real universe is always one step beyond logic.
    --from "The Sayings of Muad'Dib" by the Princess Irulan

  49. Fooled by Nassim Nicholas Taleb by Anonymous Coward · · Score: 0

    Apparently the guy is unaware of the fact that there are today more people alive than there have ever been dead.

  50. How to beat the stock market by Drakonian · · Score: 1

    It's simple actually. Invest on sunny days!

    --
    Random is the New Order.
  51. More on Time Series by EnlightenedDuck · · Score: 1

    There is no one equation that will tell you if something is totally random or if it is predictable - predictability depends on your model. There are a number of non-linear systems that will appear completely random if analyzed with linear models (i.e. pseudo-random number generators of the WWII era). Quack!

    --
    Quack!Quack!.....QUACK!!
    1. Re:More on Time Series by AssFace · · Score: 1

      Sorry man - but there is. Specifically dealing with Time Series data. And not that it tells you if it is random, but more importantly that it isn't random. It allows you to see if given a set of data, you can then get future events from that.

      I'm at work now and don't have any of my notes here and I haven't had to use the damn thing in a few months (been working pretty much all in genetic algorithms lately) so I guess my brain just dumped it out.

      and yeah, that last part I of course agree with since that is pretty much true for all that I can think of right now - that is the whole point of using neural net analysis on time series data - it is nonlinear analysis.

      When I remember and/or look up the damn thing I will post it.

      --

      There are some odd things afoot now, in the Villa Straylight.
    2. Re:More on Time Series by EnlightenedDuck · · Score: 1

      What you might be thinking about is looking at the mutual information of the time series - that is looking the the Kullback-Leibler Divergence between the series and itself at a lag of k. The smaller the divergence, the closer the distributions are, and hence you have some measure of predictability. This does not give you any insight into what this relationship ship, only that there is a relationship. However, to the best of my knowledge (I could be mistaken) there are not yet methods of hypothesis testing developed for this - so you can say there is the least randomness at a certain lag, but that doesn't mean you can tell if it sufficeintly non-random to be considered more than chance.

      --
      Quack!Quack!.....QUACK!!
    3. Re:More on Time Series by EnlightenedDuck · · Score: 1

      After a quick websearch: There are other tests, such as examining the series of 1's and 0's representing whether a given value is above the series' mean. This can be tested against a known distribution if the data is random and identically distributed. However, a pseudo-random number generator would pass this test on reasonable sample sizes, and yet is entirely deterministic. Quack!

      --
      Quack!Quack!.....QUACK!!
    4. Re:More on Time Series by AssFace · · Score: 1

      Hurst Exponents.

      That is what I was thiking of.

      With that, you can see how if it is more than likely random non-trending data, or if there is a pattern in there.

      --

      There are some odd things afoot now, in the Villa Straylight.
    5. Re:More on Time Series by EnlightenedDuck · · Score: 1
      Thank you. Hadn't heard of Hurst Exponents before. A question:

      How far must the Hurst exponent deviate from 1/2 for you to consider something non-random? You need to be able to answer this to claim the ability to test for randomness.

      Also: Consider a random walk generated by a step of a size generated by a pseudo-random number generator. This will appear to be made of independent incremental steps of a set variance. Thus the Hurst exponent will be indistinguishable from 1/2. However, this is an entirely deterministic system. So the Hurst exponent can be tricked, and my original observation that the determination of randomness is dependent on your model holds.

      I would also like to take this opportunity to thank you for introducing me to Hurst Exponents. I found a couple of interesting sites (here and ) because of this discussion. Quack!

      --
      Quack!Quack!.....QUACK!!
    6. Re:More on Time Series by AssFace · · Score: 1

      as I understand it, you use it to determine how close it is to a random walk. you want things that distance themselves from it.
      I don't think there is such thing as one fixed point where it can always say "this is it" - but instead as things move away from 1/2.

      other sites to check out (which are pretty high on google if I recall - those are the only ones that I have in my bookmarks folder - which was what eventually reminded me of the name):
      http://www.bearcave.com/misl/misl_tech/wav elets/hu rst/
      http://www.speedderivs.com/hurst.html
      http: //www.cbi.polimi.it/glossary/Hurst.html

      --

      There are some odd things afoot now, in the Villa Straylight.
    7. Re:More on Time Series by EnlightenedDuck · · Score: 1
      So the Hurst exponent works if you are assuming that what you are looking at resembles a random walk, and you want to know how far from a random walk you are.

      What, in my opinion, this is missing, for determining randomness in a time series:

      Robustness. This only works for a small set of time series. For instance, an MA(1) series (X(t) = e(t)+e(t-1), e(t) is i.i.d. for all t) will, if I'm understanding Hurst exponents properly, have a Hurst exponent of 0. However, an MA(1) series is almost completely random - in fact, you know less about future values from the present in an MA(1) series than in a Brownian Motion.

      The ability to test a hypothesis. Sure, you can have a sense of how far your series is from a Random Walk, but how far do you have to be for it to be more than chance variation, so you can say you are (1-p)% sure it isn't a random walk?

      --
      Quack!Quack!.....QUACK!!
  52. Come, lets play Settlers of Catan by rufusdufus · · Score: 1

    Based on random dice rolls. We can play as many times as you like. If you are one who believes in luck, lets see if you can beat me.

    People who aren't good at statistics will get creamed. Its this way in real life too. Success is not dumb luck, its playing the odds. Its just an excuse when the loser blames the dice.

  53. taken a bit to far by Anonymous Coward · · Score: 1, Insightful

    He makes some good points (yes people do overvalue success, yes people in general suck at estimating probability, yes there is uncertainty in any complex system that obscures truth to the point of making it undeciferable to a certain fact, etc...)in the work but it's taken too far. It's sensationalized deconstructionist arguements that are in and of themselves false by their own premises.

    Yes an analyst talking about Iraq can't say that the market is loosing 10 points due to concerns but it takes a true idiot to believe that uncertainty over Iraq isn't affecting the market in a negative way and contributing to those 10 points. Quantifying influence is often impossible but recongnizing it is usually not that hard. It's not just about probability but also trends, and uncertainty is a bad trend in finance.

    Okay...uneducated, non-trader rant over!

  54. Re:he has some good points, but also overlooks a f by MaxTardiveau · · Score: 2, Informative
    The problem with market data is that, unlike, say, the weather, there is a feedback loop for the knowledge. So let's say you discover the Great Equation that in fact does predict the market. How long do you think it's going to work ? The answer is : not very long, because you're now going to affect the market by using this knowledge (plus it's most likely not going to remain a secret for very long). The markets are not random in the same way as rolls of dice are random, but they are chaotic and ultimately unpredictable. My contention (and Taleb's) is that anyone trying to derive meaning from the noise is fooling him/herself. The only way I will be convinced otherwise is by someone who is consistently (over a decade or more) making money using an algorithm/model/equation.

    Taleb mentions that the long-term winners like Soros tend to have a trait in common : they hold no pre-conceived ideas, and will swing with the market. In other words, they accept the facts as they are, instead of trying to fit them into theories.

  55. "another kind of truth" by ebyrob · · Score: 1

    One could of course argue that Popper's observation is but another kind of truth

    That it is me boyo, deduction (which Poper used to come to his conclusions about science and theories) is a whole different way of reasoning.

    As an example:
    2 + 2 = 4, can be arrived at by deduction completely apart from any external stimulus.
    My desk is made of wood, can only be arrived at by induction, or at least by some method relying on input to the senses.

    My personal thoughts are that yes, Poper's ideas are just another form of "truth" whatever that means, but that deduction is far more fundamental than induction...

  56. Re:he has some good points, but also overlooks a f by AssFace · · Score: 1

    very true.

    I agree with a lot of what Taleb has to say - which is why the bible code analogy bugged me. It is frustrating when someone says a series of things that are intelligent and then goes off on a tangent like that.

    the feedback loop is a problem you can't get around with stock market models. the more money you put into your model, the more you directly effect the movement of the stock and then throw off the model (I'm pretty sure I just wrote somehthing like that the other day in my journal).

    the two obvious ways around this that firms use are 1) don't talk about what you do and trade "small", and 2) continuously update that trading strategy.

    Saying to do XYZ today might not work out tomorrow, so find your model, trade using it, and then reevaluate your model again now that there is new data in there. and then trade again.
    a simplistic view - but it works.

    the reason you will never see always up (or always down for that matter, although that is technically easier) in terms of bringing in money is for exactly what Taleb says the best (and also most obvious part) - it is the unknown.
    You might have an ideal model that will work out to give you a great series of correct runs over time - but it won't (and can't) take into account another 9/11 type event.

    There are many insurance and reinsurance companies out there using neural nets to do risk assessment and are looking at data and calculating how likely a hurricane will hit Bermuda at T time on D date, or even the 5 or so firms (and schools) that are analyzing with NNs to watch for terrorist/war threats coming up.

    It would be interesting to combine the output of all of those efforts into a stock model to try to account for future unknowns... but it is impossible.
    The neural net outputs data that has some level of error even if you give it perfectly accurate data.
    But if you feed it data that already has its own data (from the NN that it came from), it will then go on to produce much larger error as it goes through the new NN.

    Anyway, the main point of contention was that Taleb made a really bad analogy that bothered me and made it sound like it was not possible to predict the market at all.
    To always get it right, nope - but to get very close over and over again - yes.

    It is then a matter of using that exactly the way he does - maximize profit and minimize loss.
    The guys that are risking it all time and time again are either stupid or cocky.

    --

    There are some odd things afoot now, in the Villa Straylight.
  57. It's so very true. by nadadogg · · Score: 1

    Heck, I've got friends who claim to know everything. After something has occurred, they paint themselves to have known the whole time. Unlike me, of course, who really *did* know it was going to happen. Well, sometimes, anyway.

    --
    i use linux and windows oh god how can i have an opinion
  58. Money by IanBevan · · Score: 2, Funny

    Taleb makes a living from unforeseen events...

    That's his job ? Doesn't that make a cashflow forecast a bit tricky ?

    Bank Manager: Mr Taleb, you're mortgage payment bounced this month

    Taleb: Oh. I never saw that coming...

  59. Bad vs Good Market News Coverage by Anonymous Coward · · Score: 0

    "For instance, a commentator saying that 'the Dow went down ten points today on concerns about Iraq' is talking nonsense: there is no way anyone can tie such a small market move to any particular reason."

    Good market news coverage almost always uses the phrase "amid concerns," indicating that the market's movements are not necessarily directly caused by a particular event. Rather, they try to give some perspective to what was happening. The only time you hear a direct link made is when news impacts a particular sector and the move is a clear response to that news. A perfect example would be the drop to NASA contractor stocks the Monday after the Columbia tragedy. The quote listed above is a good example of why you shouldn't get your market coverage from local news.

  60. Of course by cyril3 · · Score: 1
    there's a good chance that he's wrong.

    And it beats me how a trader can get any clients with the line "Heck, I don't know why this works but it has so far so just gimme the money and I'll make you rich"

  61. GEB by Anonymous Coward · · Score: 0

    All these books (its a god damn Genre now) are just pety attempts at copying Godel, Escher, Bach which every first year cs/math major should have read.

  62. Re:Conservative/Liberal take on it (OT) by Anonymous Coward · · Score: 0

    Today's french lesson:

    Ce ne pas une sig. C'est un moniteur.

    Ce n'est pas une sig. C'est un moniteur.

    and in the post to which you replied:

    maybe you are a Quebequois?

    Either you're a Quebecer, or you just are québécois(e).

  63. The most random web page on the internet by dirvish · · Score: 1
  64. You haven't taken enough flask yet for your post by Liquidrage · · Score: 1

    Are you on the voting commity that turns theories into laws?
    That fact that it got modded up at all is rather scary.

    Theory vs law is just a name.

    A very common one is the 2nd Law of Thermodynamics. Why is it a law? Because it was named as such. Commonly this law is pitted against evolution by ignortant zealots as if evolution violated the 2nd law of Thermodynamics and was therefore impossible.
    Of course, the reality is the evidence for the Theory of Evolution is so much more vast then that for the 2nd Law of Thermodynamics (which is really just a guideline and not a hard fast rule). "law" vs "theory" is just a naming convention based on what sticks.

  65. *whew* by Tyreth · · Score: 1

    I am so glad that the Bible code has been debunked. That was a potential hole for a great deal of deception, both atheists and Christians can agree (the Christians who rejected it). Off-topic, I know.

  66. financialsense.com has interview with the author by cheekyboy · · Score: 0

    Go into the weekly radio program, the NEW HOUR, and back a few weeks ago they had an interview with the guy

    more other cool stuff at http://www.financialsense.com/asktheexpert/2002.ht m

    http://www.financialsense.com/transcriptions/mai n. htm

    --
    Liberty freedom are no1, not dicks in suits.
  67. Here's a scenario for you. by edunbar93 · · Score: 1

    You're a brand-new engineer out of college. (smart) You sign up at a company that makes widgets and you come up with an idea for a new product the company can sell that's so ingenious it makes the wheel look not quite so revolutionary. (also smart) You work 80 hours a week to design and build the prototype, then you continue to work 80 hours a week getting it through the manufacturing stage. (hard working) The public just doesn't get it, and/or hates the idea. The company goes bankrupt, you're out of a job, and you're starting again at square one.

    Wow, um, all that hard work and intelligence just went to waste, now didn't it? You're just treading water, and get to go through this cycle all over again, perhaps many times over. This happens a lot by the way. Companies and projects fail all the time because of luck, bad timing, or bad moves, through no fault of your own. You might be working your ass off, but if the marketing department doesn't make good decisions, you're screwed. You might be working your ass off in marketing, but if your engineers are making bad decisions, you're screwed. Repeat as necessary for customer service, management, and support personnel. Most people spend their lives going through this cycle time and time again, and you're completely forgetting that success happens with a large component of luck.

    The formula goes something like this:
    1 part skill + 1 part hard work + 2 parts luck = success.

    Just because *you* are smart, worked hard, and succeeded, and all the people you know who have succeeded are smart and worked hard doesn't mean that that's all you need to succeed. For every 1 person like you, there are 50 just like you in every respect except that they're failures. You don't see that in your position though, because the entire experience is completely subjective for you. Equally subjective is the exposure you've had to poor people. How many of them have you actually met? How many have been your friends at one time or another? What experience do you have to judge them for anything at all, let alone ascertain reasons as to why they are where they are? I've known idiots that were rich and poor people who were graduates.

    Just look at the components of luck in your three reasons: #1 is bloody obvious, there's a chance, however small, that your contraception won't work. #2 The smarter you are the more likely you are to fail at high school. The opposite is also true, and for mostly the same reasons. It's simply not a world that either represents reality in any way shape or form, or even for the most part teaches you anything of any real worth. Smart people do their best to find a way to opt out of it and get that all-important diploma anyway. #3 I can't argue with however.

    --
    "No problem. I have the capacity to do infinite work so long as you don't mind that my quality approaches zero."-Dilbert
  68. Re:It is impossible to prove an unrestricted negat by WzDD · · Score: 1

    > You can never prove an unrestricted negative.
    > Only contradictions are truly false.

    Yes, and the whole point of proving a scientific theory wrong is to prove that it leads to a contradiction. If there is no way to demonstrate that the theory could be disproven, then it is not a scientific theory.

  69. Re:It is impossible to prove an unrestricted negat by Anonymous Coward · · Score: 0

    So it appears that you can't prove that Popper is wrong. I still think that Popper is correct on this score.

    When one implies that the first half of Popper's statement is false, one is possibly allowing a semantic drift from applied terminology to absolute terminology by implying that there is no such thing as a false "scientific theory" - on the reasoning that if it's false, then it's not a "scientific theory." That's a needless strawman rebuttal. There is no such thing as an unfalsifiable "scientific theory", and history is full of "scientific theories" proven false.

    I'm sure you know this, but I'll say it anyway: Simply because something is not falsifiable does not mean it is incorrect or correct.

  70. Re:It is impossible to prove an unrestricted negat by benzapp · · Score: 1

    Yes, and the whole point of proving a scientific theory wrong is to prove that it leads to a contradiction. If there is no way to demonstrate that the theory could be disproven, then it is not a scientific theory.

    Ok, well by all means, please share with us a scientific theory which leads to a contradiction. This cannot be a contradiction based on language semantics, like the round circle.

    --
    I don't read or respond to AC posts
  71. Re:It is impossible to prove an unrestricted negat by benzapp · · Score: 1

    I'm sure you know this, but I'll say it anyway: Simply because something is not falsifiable does not mean it is incorrect or correct.

    The problem is we have people who look at things as being absolutes. This is perhaps one of the greatest reasons quantum mechanics has such a difficult time in the scientific community. Science is about probability, not laws, and not absolutes. The purpose of science is to determine what is most likely true, given current understanding and knowledge.

    What is correct is that which is more likely to be true. What is incorrect is that which has little evidence in its favor.

    Until this simple fact becomes standard operating procedure, there science will remain stagnant and we will be stuck with imperfect "laws" like E=mc^2.

    --
    I don't read or respond to AC posts
  72. Re: Undermines Belief by A55M0NKEY · · Score: 1
    It is true that on a big enough scale, everything is meaningless.

    Though I was born and raised an athiest and still am one, the above statement is true even if there is a . Even if you and your diety(s) are in love with each other the fact remains: NOBODY ELSE CARES. The existances of you and your God are equally meaningless.

    But people don't live on an Infinite Cosmic scale. They live on earth a rather small and homely place.

    The grandparent post says that you should make a Pascal's Wager that the universe has some unseen properties that give your life meaning and have faith in that arbitrary selection of religion. The problem with that is that it supposes that people need the Entire Cosmos to be constructed so a to justify their actions or they are somehow worthless. Why follow some random faith to it's illogical logical conclusions or feel guilty to have sinned against such ideals just to have an answer to why you do something?

    If something is important to you and you want to do it, that should be enough reason to persue it even if you do not have an answer to 'Why is that important to you?'. That you feel joy/satisfaction/humor/whatever from it is justification enough. Why do you feel happy/sad/whatever about something? Who cares? You are wired to feel that way, so you do. Sure events may have helped wire you but now you are wired that way. Because they are arbitrary, you also have the freedom to change your mind if you see your habits/ideals as the cause of your unhappiness. You are not bound to them, because they are not derived from some religion's version of the supposed 'Unchangable and Eternal Fabric of Reality'.

    Everybody has a fate no matter how they try to avoid it. Some fate will eventually be the story of your life. This is a self evident truth that requires no faith. Your actions are motivated by motives that come from inside you. This is also self evident. The seeds that grow into your actions come from inside you. Duh. Instead of making a Pascal's wager on having faith in an external arbitrary and not very convincing religion to be true, why not make a different wager. Why not bet on yourself? Have faith in yourself to be a worthwhile person you are glad to be.

    --

    Eat at Joe's.

  73. The Three Rules of the Game by garyebickford · · Score: 1

    This reminds me of an old aphorism, one version of which is in my unix fortune dataset. One wonders just which Ginsberg this is:

    "Ginsberg's Theorem:
    (1) You can't win.
    (2) You can't break even.
    (3) You can't quit the game.

    Freeman's Commentary on Ginsberg's theorem:
    Every major philosophy that attempts to make life seem meaningful is based on the negation of one part of Ginsberg's Theorem. To wit:
    (1) Capitalism is based on the assumption that you can win.
    (2) Socialism is based on the assumption that you can break even.
    (3) Mysticism is based on the assumption that you can quit the game."

    --
    It's easier to be a result of the past, but more fun to be a cause of the future! http://www.spacefinancegroup.com/
    1. Re:The Three Rules of the Game by SirSlud · · Score: 1

      Thats very cool. Thank you for posting that.

      --
      "Old man yells at systemd"
  74. Re:It is impossible to prove an unrestricted negat by Anonymous Coward · · Score: 0

    Thank you for your thoughtful reply.

    I think that quantum theory should be a complete theory, and it can never be complete. Quantum uncertainty may give quantum theory the incompleteness it needs to avoid having inconsistencies such as contradiction in fact, but that is not necessarily provable and so hardly any guarantee of universal correctness.

    I do not sympathise with efforts to remove religious belief, no matter how often often any authority or individual misuses such beliefs. Religious belief is an invaluable asset to the individual because it insulates against external force. For example, nobody needs it to be scientifically proven that they should or should not exist. I don't think anybody needs science running their lives 24 hours a day, but that seems to be a likely direction of future scientific misuse. I think Lord Acton had some similar observations going a little further.

    I'm not feeling too well today so I apologize in advance for any sloppiness in these sentiments.

  75. Re:The "Dual Income" Scourge by Rushwind · · Score: 1

    Personally the trend to insist on all households being dual income sickens me. I really believe that children benefit more from having a stay at home parent than they do from having money.

    I couldn't agree with you more. One has to ask which state of affairs creates more wealth in the long run:

    a) Generation after generation of children taught by the television that being "good little consumers" is the path to happiness, or

    b) Generation after generation of children raised by loving, caring, and present parents, at least one of whom is often around to help each child understand the ever-more-complex world around them

    With only one income in our household, my wife and I may not be able to afford that SUV, because our consumer society is priced for dropping your kids in front of $199 TVs thus "allowing" both parents to work. However, it's my hope that the gain in prestige of parenting well-adjusted citizens will be worth the loss in prestige of driving the bestest gas-guzzler in existence.

    Get back to me in 30 years or so, and I'll tell you how the experiment went.

  76. Wooo eeee oooooo by A55M0NKEY · · Score: 1

    And of decievers, I am Gambling
    -- Hairy Krishna

    --

    Eat at Joe's.

  77. Re:It is impossible to prove an unrestricted negat by WzDD · · Score: 1

    Well! There are hundreds. Here's one explaining that the Sun's energy isn't the result of continual bombardment of meteorites. Lamarck's theory of evolution predicted that siblings would share the phenotype of their parents, and they could change that phenotype during their lifetime. This was fairly easily debunked.

    Literally, there are hundreds. That's how science advances, through the creation and disproval of scientific theories.

  78. statistic analysis not so random by RLiegh · · Score: 0

    since 87% of all facts are made up on the spot!