Slashdot Mirror


Visualizing False Positives In Broad Screening

AlejoHausner writes "To find one terrorist in 3000 people, using a screen that works 90% of the time, you'll end up detaining 300 people, one of whom might be your target. A BBC article asks for an effective way to communicate this clearly. 'Screening for HIV with 99.9% accuracy? Switch it around. Think also about screening the millions of non-HIV people and being wrong about one person in every 1,000.' The problem is important in any area where a less-than-perfect screen is used to detect a rare event in a population. As a recent NYTimes story notes, widespread screening for cancers (except for maybe colon cancer) does more harm than good. How can this counter-intuitive fact be communicated effectively to people unschooled in statistics?"

365 comments

  1. It's not that hard. You can smell the bleach. by dmomo · · Score: 1

    You mean.. sometimes these broads really are blond?

  2. Simple by Anonymous Coward · · Score: 5, Insightful

    How can this counter-intuitive fact be communicated effectively to people unschooled in statistics?

    Hmm, teach them statistics?

    1. Re:Simple by tixxit · · Score: 2, Insightful

      Yep, pretty basic fact in probability theory. A test for some condition must fail on less people (by an order of magnitude) then the number of people with that condition. Otherwise, you can pretty safely assume a positive is a false positive.

    2. Re:Simple by Anonymous Coward · · Score: 0

      Apparently, Darwinian evolution favors people who know statistics.

      As long as red neck's don't figure out statistics, we might still have a chance.

    3. Re:Simple by fuzzyfuzzyfungus · · Score: 1, Funny

      The problem is motivating them to learn statistics.

      I recommend accusing them of terrorism and sending them to a black site, where they'll be kept in a blank white cell with nothing but a statistics textbook. Don't release them until they can demonstrate that they are overwhelmingly likely to have been a false positive.

      That'll learn 'em.

    4. Re:Simple by interkin3tic · · Score: 1

      Hmm, teach them statistics?

      Easier yet, just say something like "Eighty percent of the time it works EVERY time." And then sex your audience up.

    5. Re:Simple by maxume · · Score: 1

      Just shoot people who don't understand statistics. Even if the test only works 90% of the time, the percentage of living people who do understand statistics will be going up most of the time.

      --
      Nerd rage is the funniest rage.
    6. Re:Simple by Red+Flayer · · Score: 2, Insightful

      Much simpler... use a Venn diagram.

      Let Circle A be the traveling public.
      Let Circle B, intersecting circle A, be terrorists.
      Let Circle C, within Circle A, but intersecting Circle B, be the set of those who the test identifies as terrorists.

      Any person in Circle C but not in Circle B is a false positive.
      Any person in Circle B but not in Circle C is a false negative.

      Vary the location and size of Circle C to demonstrate tests of varying accuracy.

      This works for terrorists, for cancer, for any test, really. Just wish I could draw it in my post instead of explaining it out.

      --
      "Trolls they were, but filled with the evil will of their master: a fell race..." -- J.R.R. Tolkien on Olog-hai
    7. Re:Simple by rxan · · Score: 1

      The problem is that the screenings mostly give one of the probabilities to the public: the amount of people who test positive. But people rarely hear about the number of false positives, the important probability. Of course people aren't going to understand that the test could be wrong if you don't tell them about the false positives.

    8. Re:Simple by Qzukk · · Score: 2, Insightful

      Let Circle C, within Circle A, but intersecting Circle B, be the set of those who the test identifies as terrorists.

      Don't forget: it's possible that B and C don't overlap at all.

      --
      If I have been able to see further than others, it is because I bought a pair of binoculars.
    9. Re:Simple by Red+Flayer · · Score: 1

      Good point. I guess that's one of the ways we need to vary the size and location of C.

      --
      "Trolls they were, but filled with the evil will of their master: a fell race..." -- J.R.R. Tolkien on Olog-hai
    10. Re:Simple by Mab_Mass · · Score: 2, Insightful

      Hmm, teach them statistics?

      Okay, so back to the main article's question - how do you teach them statistics?

      I work with a lot of biologists and other people who don't have a clear understanding of probability theory, statistics, etc. and one thing that I've found works very well is to make very clear analogies to simple probabilistic systems that they can understand.

      For example, going back to the 90% effective test, imagine that you have a wheel with an arrow on it which is the test. On this wheel, there are 10 boxes, 9 of which say "Not a terrorist" and 1 of which says "You're a terrorist." Now, hand this wheel out to 100s of people and tell them that anyone who lands on "You're a terrorist" gets locked in prison.

      A surprisingly large amount of probability theory can be expressed in simple terms like this.

    11. Re:Simple by timeOday · · Score: 1

      Wonder knowing statistics help? The assumption here is that people weigh risks and probabilities to maximize their expected return. This is only true indirectly, if at all. What motivates people to action (such as paying for and submitting to airport screenings, or getting medical checkups) is fear. It is not about running numbers, it is about assuaging an uncomfortable emotion. That is why public service announcements show an egg representing your brain sizzling on a frying pan rather than running a spreadsheet of overdose statistics across the screen.

    12. Re:Simple by Anonymous Coward · · Score: 0

      Good luck with that.

    13. Re:Simple by MozeeToby · · Score: 1

      How about this:

      Use computer graphics to draw a sand sifter with one million grains of sand on top. Explain that each grain of sand represents a single person and that the sifter will only let suspected terrorists through. Also explain that ten of the grains of sand represent terrorists.

      Then, graphically run the filter for them assuming a 10% failure rate, there will be a full 100,000 grains of sand below the filter which is still far, far to many to easily pick out the problem sand grains. Worse, there's a better than even chance that at least one of the terrorist grains of sand didn't make it through the sifter at all and is still mixed in with the general population.

    14. Re:Simple by DudeTheMath · · Score: 1

      I know! Let C = A, then we're sure to get all the B that are also A!

      If I patent this, can I make money?

      --
      You save only 59 seconds over 8 miles by going 75 instead of 65. Do you really have to pass that guy? Do the Math!
    15. Re:Simple by DavidTC · · Score: 3, Interesting

      Well, that example sorta fails because there are no actual terrorists in it.

      A more sane example might be to get a group of a few hundred people, in, say, a auditorium, give them an envelope with a sheet of instructions, and a 20-sided die.

      The instructions tell them if they're a terrorist or not, and tells them to roll the die and, depending on what it lands on, go to a specific labeled area. I.e., everyone goes to an area, differently, depending on what they rolled. You need about 20 areas.

      Terrorists, of which you have a few, have a 9/10 chance to be sent to a 'terrorist' area, and everyone else has a 1/10 chance.

      Everyone rolls, and goes to wherever, and at the end you realize which area was 'prison' and who got caught, and you ask everyone in that area to reveal their status, and you also ask all the other terrorists in other groups to step forward.

      Or you could do this with badges and colored stickers, or something. The important thing is that people who are identified as 'terrorists' don't actually know they are until they're pointed out, which is a powerful psychological effect. (Which also means they shouldn't know who is a terrorist, or they'll realize it when grouped together.)

      Could be a fairly powerful demonstration when people realize that 90% of the 'terrorist' group are innocent, and, while that group did catch most actual terrorists, there are a few still roaming around.

      --
      If corporations are people, aren't stockholders guilty of slavery?
    16. Re:Simple by DavidTC · · Score: 1

      Oh, and bonus points if you figure out a way to allow terrorists to swap their dice rolls with some other person, aka, identify theft.

      --
      If corporations are people, aren't stockholders guilty of slavery?
    17. Re:Simple by DudeTheMath · · Score: 1

      Worse, there's a better than even chance that at least one of the terrorist grains of sand didn't make it through the sifter.

      Significantly better than even. Assume all the tests are independent with success 90%. The chance of getting them all is then 0.9^10, which is less than 0.35, so there's an over 65% chance of missing at least one.

      Many such tests, though, have a far higher probability of false positive than of false negative. That's why, in medicine, there's often an (inexpensive) first screening (with a relatively high rate of false positives, maybe 5%) but almost no chance of missing. If that test is positive, they go on to the (presumably) more expensive test with a much lower rate of false positive, secure in the belief that they haven't missed someone.

      --
      You save only 59 seconds over 8 miles by going 75 instead of 65. Do you really have to pass that guy? Do the Math!
    18. Re:Simple by Anonymous Coward · · Score: 0

      Yes they do, since it's a Venn diagram.

      Or we could use an Euler diagram.

    19. Re:Simple by Anonymous Coward · · Score: 0

      Yes but widespread teaching of statistics does more harm than good...

    20. Re:Simple by improfane · · Score: 1

      Is that 64% of the time overall then?

      --
      Slashdot needs Geekcode | Can anyone recommend any good SCIFI? My tastes: Foundation, Startide Rising, CITY, Ringworld,
    21. Re:Simple by DarkOx · · Score: 1

      I find your ideas fascinating and wish to subscribe to your news letter!

      --
      Repeal the 17th Amendment TODAY! Also Please Read http://www.gnu.org/philosophy/right-to-read.html
    22. Re:Simple by FluffyWithTeeth · · Score: 1

      That isn't a Venn diagram; all the areas must be intersecting every other area.

      I think you call other similar diagrams Euler diagrams? I honestly can't remember.

    23. Re:Simple by Anonymous Coward · · Score: 0

      Circles make hard to compare intersection areas. You could also present the whole population as a square. Divide it in half vertically into proportionally sized "positive" (are terrorists, have cancer, have HIV, whatever) and "negative" groups.

      Divide it horizontally into proportionally sized "test was right" and "test was wrong" groups (this is assuming that the false negative and false positive rates are the same. If not divide the "positive" and "negative" groups each with their own horizontal line).

      You then have an illustration of all four groups---"true positive", "false positive", "true negative", "false negative". Compare areas.

    24. Re:Simple by Strilanc · · Score: 1

      That's overkill. We just need a more accurate measurement to communicate. For example we could define "trustability-ishness" to be Min(P(true | tested true), P(false | tested false)).

      So, for example, a 99.9% accurate filter for terrorists when the terrorist rate is 1 in a million:
      true positives = 0.000001*0.999 = 0.000000999
      true negatives = 0.999999*0.999 = 0.998999001
      false positives = 0.999999*0.001 = 0.000999999
      false negatives = 0.000001*0.001 = 0.00000001

      P(true | tested true) = 0.000000999 / (0.000000999 + 0.000999999) = ~0.000998
      P(false | tested false) = 0.998999001 / (0.998999001 + 0.0000001) = ~0.999999

      "trustability-ishness" = ~0.000998 = ~0.1% out of 100%

      Wow! That 0.1% sure makes things a whole lot clearer. I'm sure there are better definitions, but you get the idea.

    25. Re:Simple by Monsieur_F · · Score: 1

      B should be within A, not merely intersecting it.

      --
      McCartney fans pay bus tickets. [...] Lennon fans too, with discretion.
  3. Math ftl by Anonymous Coward · · Score: 0, Interesting

    "To find one terrorist in 3000 people, using a screen that works 90% of the time, you'll end up detaining 300 people, one of whom might be your target."

    If you have a screen that works 90% of the time, and you detain 300 people, 270 will be terrorists.

    1. Re:Math ftl by Anonymous Coward · · Score: 5, Funny

      Great! Thank you for identifying yourself as one of those "unschooled in statistics" people the summary mentioned. Now we just need to experiment with different ways to get you to understand this simple concept.

    2. Re:Math ftl by ShadowRangerRIT · · Score: 5, Informative

      Wow. Way to illustrate the point. Remember, terrorists are roughly zero percent of the population (at least, of the population going on plane trips in the U.S./U.K.). Odds are, at most one of those 3000 actually is a terrorist. So if it is 90% accurate in identifying terrorist vs. non-terrorist (and vice versa), then 10% of the non-terrorists will be identified as terrorists (or ~300), while the 0-1 terrorists will be missed 10% of the time. And of course, since you don't know for sure if there was a terrorist in the group, an in-depth search of the 300 will usually be a waste of time.

      --
      $_ = "wftedskaebjgdpjgidbsmnjgcdwatb"; tr/a-z/oh, turtleneck Phrase Jar!/; print
    3. Re:Math ftl by Nomen+Publicus · · Score: 1
      But 10% of the time it will return a false positive, so 300 people will be detained, none of whom will be terrorists. The description of the problem could be better expressed.

      This is a DOS on the security services and explains why despite much propaganda automatic face recognition systems are not in use.

    4. Re:Math ftl by amorsen · · Score: 5, Insightful

      If you have a screen that works 90% of the time, and you detain 300 people, 270 will be terrorists.

      Congratulations, you got it wrong exactly the way that is being complained about.

      The test accuracy is measured compared to the population tested. In fact, a test that consistently says "no cancer" in all cases is 99% accurate when run on the general population.

      --
      Finally! A year of moderation! Ready for 2019?
    5. Re:Math ftl by thisnamestoolong · · Score: 0, Flamebait

      You, FTL. You screen 3,000 people, one of whom is a terrorist right, right? The test is wrong 10% of the time, right? That means that 10% of the time, when you screen a non-terrorist, you will get a false positive. There is also only a 10% chance that you will get a false negative when screening the terrorist, but you then have to pick him out from a field of 300 individuals, 299 of whom are false positives. Is this simple enough for your little brain or shall I spell it out further?

      --
      To the haters: You can't win. If you mod me down, I shall become more powerful than you could possibly imagine
    6. Re:Math ftl by Anonymous Coward · · Score: 0

      If you have a screen that works 90% of the time, and you detain 300 people, 270 will be terrorists.

      No. If your screen works 90% of the time, that means when you screen 3000 people you will have 300 false classifications, which includes classifying non-terrorists as terrorists (this is called a "false positive"). With one terrorist among 3000 people, that would mean at least 299 of the people you detain as terrorists will not be terrorist, and in 10% of the cases none of your detainees would be terrorists.

    7. Re:Math ftl by tixxit · · Score: 2, Informative

      It does not mean that 90% of the time it picks out a terrorist, it means that the test has a 90% accuracy, on both terrorists and non-terrorist. That is, you can expect an error (ie. a false positive or a false negative) 10% of the time. So, even if you are not a terrorist, there is a 10% chance the test will fail and identify you as a terrorist. If there is 1 terrorist in 3000, then the test will positively identify 300 people, only one of which is the terrorist.

    8. Re:Math ftl by Demonantis · · Score: 1

      Easy explain it in terms that they will understand the theory for. Say you wanted two children in your family and you go the natural route(no adoption or gender control). The odds are close to 50-50 that it will be male or female. Most people understand that you can get two boys, one of each, or two girls. This is due to the nature of the probability. The first birth has no effect on the probability of the second birth. This simple concept is what plays into the terrorist detection device. The AC that is your parent makes a leap that the probability of detection changes as the machine is used. I don't know how the probability would change, but in the end 90% of the people that has detected are terrorists. A statistic that has nothing to do with probability. For some odd reason though people tend to have difficult recognizing how probability applies to specific situations consistently.

    9. Re:Math ftl by Anonymous Coward · · Score: 0

      You both don't quite have it right, AFAICT. The problem starts with the bogus "90% accurate" claim in the first place: you have to assume that it applies to both the false-positive and false-negative results, which is suspicious at best.

      All you can take away from such a meaningless number is that if you feed it a population size of 3000, it will probably tell you that 300 of them need additional scrutiny. It can't tell you with any certainty if the terrorist is in that group of 300, or not.

      If you knew the ACTUAL percentage of terrorists in the sample population, you might have a chance--- but nobody seems to want that number to be known. Probably because it's so ridiculously small that no convenient test could spot them.

    10. Re:Math ftl by interkin3tic · · Score: 3, Funny

      The test accuracy is measured compared to the population tested. In fact, a test that consistently says "no cancer" in all cases is 99% accurate when run on the general population.

      Wow, thanks! I was going to have this mole checked out at the doctor, you really just saved me a lot of time! I mean, I didn't understand your magic numbers, but if it means I don't have cancer, I'm for it!

    11. Re:Math ftl by noidentity · · Score: 1

      "To find one terrorist in 3000 people, using a screen that works 90% of the time, you'll end up detaining 300 people, one of whom might be your target."

      If you have a screen that works 90% of the time, and you detain 300 people, 270 will be terrorists.

      Let's say you've got no terrorists, the screening process works 90% of the time, and the other 10% it always flags people as terrorists. Then out of 3000, you'd get 300 flags that are all incorrect.

    12. Re:Math ftl by noidentity · · Score: 1

      So if it is 90% accurate in identifying terrorist vs. non-terrorist (and vice versa), then 10% of the non-terrorists will be identified as terrorists (or ~300),

      You're assuming that the 10% erroneous operation identifies people as terrorists. If the 10% was always as non-terrorists, then it would flag nobody.

    13. Re:Math ftl by thisnamestoolong · · Score: 2, Insightful

      Of course this is all true, the example given in the article is simply a classic example of statistical math. Of course it is not a real world situation, the number of terrorists could never be known that precisely, the error bars would differ for false positives and false negatives, it fails to take into account differing margins of error throughout the population (geography, gender, ethnicity, age, etc.). This is the sort of thing where a realistic example would be so complex as to defeat the purpose, so for the intents of communicating a counter-intuitive idea to people, we create an unrealistic and absurd situation such as this -- the terrorists and error bars are meaningless it is the numbers we are after here and the example is lucid and effective.

      --
      To the haters: You can't win. If you mod me down, I shall become more powerful than you could possibly imagine
    14. Re:Math ftl by Bob9113 · · Score: 1

      Odds are, at most one of those 3000 actually is a terrorist.

      I like your post, and what's more -- if 1 in 3,000 were a terrorist, that would mean we would have 100,000 terrorists here in the United States. If we have 100,000 terrorists here in the United States, well, we can't stop them from doing whatever it is they've got up their sleeves. Even if we caught 99.9%, there would still be 100 left undetected to complete the mission.

    15. Re:Math ftl by Anonymous Coward · · Score: 0

      Did you even read the fucking....

      Wait, slashdot. Never mind.

    16. Re:Math ftl by ShadowRangerRIT · · Score: 2, Informative

      Since it didn't specify false positive or false negative, and the plain English interpretation is that any given test will accurately categorize 90% of the time, you have to assume it applies to both. Any form of behavioral observation, particularly in a case where there are penalties for being put in a specific category, is going to have both (since normal people can have bad days, and terrorists can be good actors).

      --
      $_ = "wftedskaebjgdpjgidbsmnjgcdwatb"; tr/a-z/oh, turtleneck Phrase Jar!/; print
    17. Re:Math ftl by Anonymous Coward · · Score: 0

      If there is 1 terrorist in 3000, then the test will positively identify 300 people, only one of which is the terrorist.

      only one of wich MAY be the terrorist.

      the terrorist could get the 10% error too (false negative this time), so you could end with no terrorists at all.

    18. Re:Math ftl by hattig · · Score: 1

      1 in 10 times the terrorist will get through, so all 300 people aren't terrorists.

      Isn't this why detection equipment should list false positive and false negative rates?

      For something that can mess up someone's life, you probably want a really really low false positive rate, e.g., 1:100,000. For messing up someone's day, 1:10,000. For delaying someone by an hour: 1:500. For detecting people to check their bags at customs, 1:5.

      If it is imperative that you detect something, you need a really low false negative rate. "Is this person a terrorist?", for example.

      Sadly it's very hard to have both. That's why it is very hard to detect american lager is lager and not piss. "Is this piss?" is your detection question, a false negative is a disaster (vomiting and sobriety), but a false positive means you could get sober, and that's a big issue.

    19. Re:Math ftl by jonbryce · · Score: 3, Informative

      You are wrong. Lets suppose there are 60,000,010 people in the country, of which 10 are terrorists and 60,000,000 are not terrorists.

      The test will incorrectly identify 600,000 of the non-terrorists as terrorists, and 1 of the terrorists as a non-terrorists.

      What this means is that out of the 600,009 people it identifies as terrorists, only 9 actually are.

    20. Re:Math ftl by Anonymous Coward · · Score: 0

      0.9 of which is the terrorist.

    21. Re:Math ftl by Aceticon · · Score: 3, Insightful

      A broken clock is right at least twice a day.

    22. Re:Math ftl by tsstahl · · Score: 1

      But 10% of the time it will return a false positive, so 300 people will be detained, none of whom will be terrorists.

      Yet all of whom will now have a record of 'past terrorist suspicions'. All future contact with authority will be stained by a single false positive.

    23. Re:Math ftl by Anarchduke · · Score: 1

      Well, if you shoot the 600,009 you have in custody, you are guaranteed 9 terrorist deaths.

      and that is 600,009 people less likely to cause traffic jams.

      I'm surprisingly okay with that.

      --
      who prays for Satan? Who in 18 centuries has had the humanity to pray for the 1 sinner that needed it most? ~Mark Twain
    24. Re:Math ftl by Alex+Belits · · Score: 1

      On the other hand, if EVERYONE is a terrorist...

      I think, I have discovered a way to demonstrate why Laffer curve is misleading. It may be more relevant to the current problems in US, too.

      --
      Contrary to the popular belief, there indeed is no God.
    25. Re:Math ftl by oji-sama · · Score: 1

      For something that can mess up someone's life, you probably want a really really low false positive rate, e.g., 1:100,000.

      I'm not quite sure that's good enough... That would be around 3000 messed up lives in the USA if the test was widespread...

      --
      It is what it is.
    26. Re:Math ftl by TheRaven64 · · Score: 1

      You're assuming that the 3,000 were drawn from a completely random sample, and not selected from a group that had a higher ratio of terrorists to non-terrorists than the general population. If that is the case, then you're probably looking for terrorists in the wrong place...

      --
      I am TheRaven on Soylent News
    27. Re:Math ftl by TheRaven64 · · Score: 1

      And a clock that runs backwards is right three times a day - more if it runs fast as well as backwards!

      --
      I am TheRaven on Soylent News
    28. Re:Math ftl by xouumalperxe · · Score: 1

      Sheesh, with those odds I'll quote Sting and say "I don't ever want to play the part of a statistic on a government chart".

    29. Re:Math ftl by hattig · · Score: 1

      Yeah, that's more like messing up a week of someone's life. A year would be 1:1m, a lifetime, 1:100m or more.

      I'd argue that more than 1:100,000 murder trials end up imprisoning an innocent person however.

    30. Re:Math ftl by phoenix321 · · Score: 1

      100 terrorists can carry out the same amount of damage as 1,000, 100,000 or 1 million. And because we never get the last 0.1%, we should give up and stop trying. AT ALL. Talk about a binary choice fallacy...

    31. Re:Math ftl by squizzar · · Score: 1

      I was going to say that you missed the GP's point, as he said 'at least' twice a day. But then I realised that if the clock ran forwards and fast it may only be right once. And if the clock always ran an hour fast, but in time and with a +-30 minutes random error then it would never be right. I haven't yet worked out how to make the clock right a negative number of times in the day, or how to make the clock more right than a clock that is always right.

    32. Re:Math ftl by DavidTC · · Score: 1

      While the other post is right saying that, if it's not stated, the 90% will refer to both false positives and false negatives, another more relevant point is the false negative can't work that way.

      It can't falsely mark 10% of the population as non-terrorists, for the simple fact that 10% of the population isn't a terrorist.

      No, a false negative means that it would fail to mark 10% of actual terrorists as terrorists, not 10% of the population as a whole.

      Just like a 10% false positive would mean that it would would mark 10% of non-terrorists as terrorists, not 10% of everyone as terrorists. (Although, statistically, that's almost indistinguishable.)

      And a 90% success rate, or a 10% failure rate, in absence of any specifics, is assumed to be both for negative and positive results.

      --
      If corporations are people, aren't stockholders guilty of slavery?
    33. Re:Math ftl by DavidTC · · Score: 1

      You know, when you state it that way, it's insane.

      A test that always said 'not a terrorist' would have a 99.999999% success rate. It would have no false positives, and 100% false negatives, but considering how few actual positives there are, statistically, it would be a lot better than a 90% test.

      --
      If corporations are people, aren't stockholders guilty of slavery?
    34. Re:Math ftl by radtea · · Score: 1

      If you have a screen that works 90% of the time, and you detain 300 people, 270 will be terrorists.

      It is this equivocation on "works" that is at the heart of the problem. People always want to know the "accuracy" of tests, but false positives and false negatives are completely unrelated types of error, and "accuracy" is generally defined by statisticians based on the target population, not the post-selected population.

      You've assumed that a test that "works" 90% of the time will have a 0% false negative rate and a 1% false positive rate, resulting in a 90% "accuracy" in the population identified as terrorists. This is completely different from a 10% false positive rate, which is how "works 90% of the time" is apt to be interpreted by a statistician, and indeed how the phrase is typically meant when screening tests are discussed.

      For two-class tests the Matthews Coefficient is the best single figure-of-merit, but it is hard for people untutored in math to understand, and it does not properly address the ambiguity in "works" either.

      --
      Blasphemy is a human right. Blasphemophobia kills.
    35. Re:Math ftl by Anonymous Coward · · Score: 0

      If it's broken stopped, it's right exactly twice a day. If it's broken slow, it's right less than twice a day. If it's broken fast, it's right at least twice a day. So your broken clock must be running a bit fast.

    36. Re:Math ftl by SoVeryTired · · Score: 1

      Out of those 300, if you decide to retest them, even with a better test which is 99% accurate, you'll still end up with three false positives on average. This is where it gets really dangerous. This is where we get to the stage of "He tested positive twice for cancer, better start him on chemo", or "OK, this guy threw up two red flags, put him on the no-fly list".

      --
      Slashdot: news for Apple. Stuff that Apple.
    37. Re:Math ftl by david_thornley · · Score: 1

      Which is why normal screening techniques fail miserably. Some airports have hundreds of millions of passengers a year, and typically nobody flying out of them commits an act of terrorism on the plane in any given year. On such a population, any sort of statistical test will have only false positives, and the only way to make it more accurate is to reduce false positives. A simple chunk of granite, alleged to glow in rainbow colors in the presence of a terrorist, will in almost all cases be 100% accurate. It's really, really, really hard to beat that accuracy rate.

      --
      "When you have eliminated the unacceptable, whatever is left, however improbable, must be the truthiness" - Holmes
    38. Re:Math ftl by Bob9113 · · Score: 1

      not selected from a group that had a higher ratio of terrorists to non-terrorists than the general population. If that is the case, then you're probably looking for terrorists in the wrong place..

      Completely agreed, and that is precisely the point. That's why general public screening doesn't work, which is what the BBC is saying. You have to start with intel and investigation.

    39. Re:Math ftl by Bigjeff5 · · Score: 1

      Not if only 1 in 3000 are terrorists, then it is impossible for 299 of the 300 detained to be terrorists. You'll be detaining 299 innocent people and 1 terrorist. BUT! The terrorist also has a 1 in 10 chance to go undetected, so you may not have even nabbed him at all (but you probably did).

      300 out of 3,000 is already pretty unreasonable to sift through, but scale it out to 30,000 or 300,000 and you have a real problem. What do you do when 30,000 people come up as terrorists? This isn't the Middle East, obviously 30,000 out of 300,000 (a smallish city) are not terrorists. Even worse, say there were actually 1,000 terrorists to begin with, well 100 were missed completely, in addition to the ones that you caught but still need to sift through to be sure. It only took 20 terrorists to carry out the largest terrorist attack in history.

      What good is the 90% accurate screening? In this case, to bring things into manageable levels, it would need to be at least 99.9% accurate, though if it were 99.99% accurate you wouldn't have to do much sifting at all and it would be a quite reliable test.

      --
      Security is mostly a superstition... Avoiding danger is no safer in the long run than outright exposure. - Helen Keller
    40. Re:Math ftl by acohen1 · · Score: 1

      This is why the word "accuracy" no place in a discussion like this. Everyone should read http://en.wikipedia.org/wiki/Sensitivity_and_specificity to understand how a screening test should be evaluated. In your case you are describing a test with 0% sensitivity and 100% specificity (it never shows false positives but always shows false negatives). An optimal balance between these two can be selected using an ROC http://en.wikipedia.org/wiki/Receiver_operating_characteristic for a real test.

    41. Re:Math ftl by treeves · · Score: 1

      Maybe the purpose of general public screening is NOT to catch terrorists but more for deterrence (terrorists aren't good at statistics either!) and comforting the (uneducated) general public with "we're doing SOMETHING!"

      --
      ...the future crusty old bastards are already drinking the Kool-Aid.
    42. Re:Math ftl by Anonymous Coward · · Score: 0

      Please mod parent up and read the links before trying to add to the discussion. This is the first thing you learn when learning about screening tests.

    43. Re:Math ftl by Anonymous Coward · · Score: 0

      The AC that is your parent makes a leap that the probability of detection changes as the machine is used. I don't know how the probability would change, but in the end 90% of the people that has detected are terrorists. A statistic that has nothing to do with probability. For some odd reason though people tend to have difficult recognizing how probability applies to specific situations consistently.

      The GP AC is wrong, the parent AC is not, and it's hard to tell whether you understand because you state a truth seemingly orthogonal to the content of the thread and claim both ACs are wrong. The premise of the story is that you apply a 90% accurate test to a population of 2999 innocents and 1 terrorist. The test has a 90% chance of identifying the one terrorist as a terrorist and a 90% chance of identifying any innocent as innocent. If it has only a 90% chance of identifying innocents as innocent, it has a 10% chance of identifying innocents as terrorists. On average, this test will identify 299.9 innocent people as terrorists and 0.9 terrorists as terrorists. So, applying a test with "90% accuracy" to a population of 2999 innocents and 1 terrorist will identify 300.8 terrorists, 99.7% of whom are actually innocent.

      This interpretation depends on the imprecise meaning of "accurate" and the author's decision to treat "accuracy" as both the rate of false positives and the rate of false negatives. In tests for very rare events, it's very important to have an extremely low rate of false positives, or a secondary test whose outcome is not correlated with the first, or a very low economic/social cost for false positives.

    44. Re:Math ftl by AncientPC · · Score: 1

      Actually this would be a time to use Bayes' theorem.

    45. Re:Math ftl by floppycat · · Score: 1

      ROC is useful not only to choose optimal threshold, but to see how good the test is, too. They have a reason not to show it. "90% accuracy" probably seems pretty good for average person, but when everyone one that for more reasonable false acceptance rate like 1E-5 false acceptance rate is 1E-4 (wild guess), it is clearly useless.

      I asked the mathematician what is the probabilty of bomb being on the plane. He told me one in a thousand. I asked what is the probability of two bombs. He told one in a million. So I always carry a bomb with myself when I travel by plane.

    46. Re:Math ftl by Anonymous Coward · · Score: 0

      Wow, thanks! I was going to have this mole checked out at the doctor, you really just saved me a lot of time! I mean, I didn't understand your magic numbers, but if it means I don't have cancer, I'm for it!

      The problem is, if you visit your doctor every time you have a zit, and eventually he'll stop seeing you, at $100/visit, you'll end up as destitute as if you'd just ignored everything, gotten cancer 20 years down the road, and paid for chemo out of pocket. (9/11 analogy: The terrorists knocked down $1B in real estate. It took our own government to make airline travel such a pain in the ass that people stopped flying. Or to borrow from Fight Club, sometimes you really should let the Pinto's gas tank design flaw take care of itself and pay it out in lawsuits.)

      The other problem is that if you visit your doctor every time you have a zit, your doctor will get used to seeing them, and not pay attention when it really is an indication of a problem.

      "Tongue of fire out of the bottom of the SRB? Does that all the time, nothing to worry about."
      - Challenger engineer.

      "Those ice chunks going *poof* off the wing? Does that all the time, nothing to worry about."
      - Columbia engineer.

      Risk analysis is always about finding a balance between a pure cost/benefits analysis and The Boy Who Cried Wolf.

    47. Re:Math ftl by interkin3tic · · Score: 1

      The problem is, if you visit your doctor every time you have a zit, and eventually he'll stop seeing you

      Ahem, we were talking about my MOLE.... NOT my acne! Insensitive clod!

    48. Re:Math ftl by clone53421 · · Score: 1

      Since you seem to be so interested in clocks, how many times in a day do the hands point away?

      That is, from 12 midnight to 12 the next midnight, how many times do the hands form a straight (180 degree) angle?

      --
      Alexander Peter Kristopeit bought his basement from his mommy for one dollar.
  4. Lie? by cycler · · Score: 0

    There are Lies, Damned Lies and finally Statistics

    /C

  5. Rare events. by Ihlosi · · Score: 1

    The problem is important in any area where a less-than-perfect screen is used to detect a rare event in a population.

    Such as "Who's a terrorist?"?

    1. Re:Rare events. by Thanshin · · Score: 1

      Such as "Who's a terrorist?"?

      That's the first question a terrorist would ask.

    2. Re:Rare events. by Anonymous Coward · · Score: 1, Funny

      you insensitive clod - All I said was I was a Taoist and they arrested me because of my accent.

    3. Re:Rare events. by the+phantom · · Score: 1

      That's exactly what a terrorist would say to throw suspicion on someone else! O_o

    4. Re:Rare events. by Thanshin · · Score: 1

      Only a terrorist would know that.

    5. Re:Rare events. by blueskies · · Score: 1

      Only a terrorist would know what a terrorist would know...

    6. Re:Rare events. by clone53421 · · Score: 1

      What he said. I think...

      --
      Alexander Peter Kristopeit bought his basement from his mommy for one dollar.
  6. Second opinion by Gonzodoggy · · Score: 3, Informative

    While it's true that there will be false positives, as well as false negatives, you don't convict someone, or have a lung removed, without further testing. When I was diagnosed for cancer, I was tested and re-tested to verify that there was, indeed, cancer. The same goes with screening for terrorists, or anything else. Did the article mention the rate for false negatives as well? After all, if you have a five pound tumor hanging off you face, and your doctor tells you there's nothing wrong, I'd definitely want a second opinion!

    1. Re:Second opinion by mdwh2 · · Score: 5, Insightful

      There's a second opinion in the US when you're put on the no fly list? Or in the UK, when you're detained without charge for weeks (the Government wanted three months)?

      The point is that idiots as described in the article think that a "90% scanner" means 90% probability they are guilty, and use to urge action on such people without further checks. And even in a court of law, the point being made is still important: imagine the prosecution telling the jury that the fingerprint/DNA test is 99.99% accurate, therefore he must be guilty? In other words, these further checks are useless if they also fall on the same flawed statistics.

      You're okay with your medical analogy, because most doctors have an understanding of basic statisics - unlike the police, politicians, and random members of a jury.

    2. Re:Second opinion by Anonymous Coward · · Score: 0

      It depends on what your final objective is and the costs of second stage screening and further testing. So, yes, there have been times when actions with grave consequences were taken based on lousy screening.

      For more years than I care to think about, a stream of "terrorists" was sent to Gitmo because they did not pass first stage screening and the political costs of doing effective follow-up checking were deemed to be too great.

      How does TFA's statistical sense apply to Mr. Cheney's "one percent doctrine"? Finding answers to that doctrine's legacy of problems is one of the USA's critical needs. It takes a back seat only to the current fiscal mess, but there has to be progress on these issues within the next year or the USA will have drifted too far from its roots in the Constitution and rule of law to ever reconnect with those moorings.

      --
      No number of spin doctors can repair the damage that could have been prevented by listening to one statistician

    3. Re:Second opinion by shadwstalkr · · Score: 1

      imagine the prosecution telling the jury that the fingerprint/DNA test is 99.99% accurate, therefore he must be guilty

      Those are different circumstances than what is discussed in TFA. The police don't round up 10,000 random people, give them all DNA tests, then charge the people that match with the crime.

    4. Re:Second opinion by DavidTC · · Score: 1

      Convict?

      We don't convict terrorists anymore, fool. We just imprison them for years without charge, and sometimes torture them.

      If you're a lesser terrorist, we just keep you from flying on airplanes. (But, surprisingly, let you roam free.)

      --
      If corporations are people, aren't stockholders guilty of slavery?
    5. Re:Second opinion by shadowofwind · · Score: 1

      Right. The problem is that many people's jobs depend on developing tools to detect terrorists, and many people's jobs depend on using those tools. Selling the utility of the tool is far more important to most of these people than honestly facing the question of whether or not some innocent strangers are getting screwed over.

      I doubt that a large number of people have had their lives ruined by being falsely accused of terrorism, relative to the number who's lives have been harmed in other ways. But its still a very dangerous pattern, in my opinion. People who say that Stalinist Russia can't happen here (wherever here is for you) maybe don't understand the dynamic very well. Furthermore, the same kind of fallacy applied in other ways has harmed large numbers of people in every country. Consider the way black people and native Americans have been perceived and treated in the US, for instance. The same kind of stupidity has been at play there, mixed with other stupidities also of course.

    6. Re:Second opinion by cvd6262 · · Score: 1

      While it's true that there will be false positives, as well as false negatives, you don't convict someone, or have a lung removed, without further testing.

      A couple of other examples:

      1. A "99% accurate" test for banned substances in a sport where a positive test will result in a two-, four- or eight-year ban. While 99% sounds conclusive, each stage of a major cycling race (like the Tour de France) will included tests for the stage winner, the overall race leader and five other riders chosen at random. 7*21 = 147; my back-of-napkin math says that it's almost a 1-in-4 chance that there will be a false positive or negative during the race. The UCI will double-test before issuing a suspension, but the initial positive test is enough to remove someone from the race. And the second tests are not blind: They are done at the same facility with workers who new the outcome of the original test (sometime the very same technicians performing both tests). And these tests are not like litmus paper; they're more like interpreting sine curves.

      2. A recent technical report for the New York State achievement tests in English/Language Arts (Grades 3-8) claimed to have correctly classified students "pass" or "fail" 90% of the time... So 10% of the students are being miscategorized: either failing when they should have passed or passing when they should have failed. In this case, there is no "additional testing."

      A 90%+ accuracy in the instrument may sound impressive, but when it's drawn out over the intended breadth of its usage, and compared with the consequences of the results, it's not good enough.

      --

      I'd rather have someone respond than be modded up.

    7. Re:Second opinion by theCoder · · Score: 1

      Actually with huge DNA and fingerprint databases, that's exactly what they are doing.

      --
      "Save the whales, feed the hungry, free the mallocs" -- author unknown
    8. Re:Second opinion by Anonymous Coward · · Score: 0

      This is true but the further testing is in itself dangerous. For instance, for PSA testing studies have shown that the risk of bleeding out after a biopsy to 'confirm' a prostate cancer you didn't have is greater than the risk of not diagnosing the cancer to begin with. PSA testing therefore sucks and should not be used as a screening test.

    9. Re:Second opinion by Eivind · · Score: 1

      False positives is a bigger problem than false-negatives when something is rare.

      If one-in-a-million air-traveller is a terrorist, and your test has a 1% false-positive rate, then when a million people go trough, 10.001 will get stopped, and 10.000 of them will be non-terrorists. You'll inconvenience a hell of a lot of people, and cause enormous costs, and almost everyone who's stopped is innocent.

      On the other hand, a test with 10% false-negative rate would still be very useful. Sure, there's some risk a terrorist would get lucky and sneak trough, but nevertheless the test would stop 9 out of ever 10, which is certainly a good start.

  7. Don't bother explaining by Gothmolly · · Score: 0, Offtopic

    Just deny the insurance claims for the cancer screenings: "Sorry, you asked for a silly procedure. FAIL."

    --
    I want to delete my account but Slashdot doesn't allow it.
    1. Re:Don't bother explaining by Anonymous Coward · · Score: 0

      Unless you are a government health plan, in which case people will give press conferences to say that your attempt to save the cost of this procedure is killing old people, children, and kittens. Replying that it was actually a sound decision, not a blind attempt to save money, will just get stories about how a private plan would have covered it (and spending money is always better than not spending money, so that means those private plans were also more effective). From the statements I'm hearing on the news lately, it sounds like no private plan has ever denied anybody the opportunity to receive any procedure they wanted. Therefore, no plan (public or private) could deny the screening just for being silly and counterproductive Q.E.D. Nice idea though.

  8. Wrose than Vegas by Gutierrez · · Score: 1

    I'd say there's a one in a billion chance.

  9. using a screen that works 90% of the time by hakey · · Score: 1

    Not very clear wording. I would interpret that as 90% of those detained are terrorists. Which doesn't tell you anything about your false positive rate.

    1. Re:using a screen that works 90% of the time by MyLongNickName · · Score: 1

      Exactly. So, someone who doesn't have a grasp on the terminology wants to educate folks who don't have a grasp on it either.

      --
      See my journal for slashdot ID's by year. Mine created in 2005. http://slashdot.org/journal/289875/slashdot-ids-by-year
    2. Re:using a screen that works 90% of the time by noundi · · Score: 5, Insightful

      Exactly. So, someone who doesn't have a grasp on the terminology wants to educate folks who don't have a grasp on it either.

      And this kids -- we call journalism.

      --
      I am the lawn!
    3. Re:using a screen that works 90% of the time by ShadowRangerRIT · · Score: 1, Insightful
      At the risk of being modded flamebait, this puts you squarely with the group "unschooled in the English language." "Using a screen that works 90% of the time" would clearly mean:
      1. A terrorist will be correctly identified 90% of the time (and missed 10% of the time)
      2. A non-terrorist will be correctly identified 90% of the time (and identified as a terrorist 10% of the time)

      As you can see, for each potential target, it works 90% of the time. Any other interpretation would be ambiguous.

      --
      $_ = "wftedskaebjgdpjgidbsmnjgcdwatb"; tr/a-z/oh, turtleneck Phrase Jar!/; print
    4. Re:using a screen that works 90% of the time by mdwh2 · · Score: 1

      "works 90% of the time" is only equivalent to "90% of those detained are terrorists" if you only test it on terrorists.

      Since a test would be tested on people in general, not just terrorists (obviously - if you already knew who they were, the test wouldn't be needed!), the two statements aren't equivalent.

      Which doesn't tell you anything about your false positive rate.

      To be exact, we should give both false positives and false negative rates, and I agree that using language like "90% accurate" should be avoided.

    5. Re:using a screen that works 90% of the time by kinnell · · Score: 1

      Not very clear wording. I would interpret that as 90% of those detained are terrorists

      That's like saying if you toss a coin and get heads, the next toss will be tails. If the test works 90% of the time, each of the people who tests positive has a 90% chance of being a terrorist, but it's entirely possible that none of them are.

      --
      If I seem short sighted, it is because I stand on the shoulders of midgets
    6. Re:using a screen that works 90% of the time by MyLongNickName · · Score: 3, Informative

      And here, silly statisticians use two numbers, alpha and beta to represent failure rates. Someone needs to educate them that they really only need one number

      --
      See my journal for slashdot ID's by year. Mine created in 2005. http://slashdot.org/journal/289875/slashdot-ids-by-year
    7. Re:using a screen that works 90% of the time by ShadowRangerRIT · · Score: 1

      Technically, it would mean testing it on an evenly mixed population: 50% terrorist, 50% non-terrorist. And if we've reached that point, I think it's time to give up.

      --
      $_ = "wftedskaebjgdpjgidbsmnjgcdwatb"; tr/a-z/oh, turtleneck Phrase Jar!/; print
    8. Re:using a screen that works 90% of the time by blueg3 · · Score: 1

      Last I checked, "works 90% of the time" is not the terminology actually used. Since what they're talking about is false-positive rate, they should use the term false-positive rate.

    9. Re:using a screen that works 90% of the time by ShadowRangerRIT · · Score: 1

      Note, I did not chide him for failing statistics. English, without recourse to domain specific language, can still be fairly unambiguous. The example given illustrates a simplified case, so plain English was sufficient to express the gist of the statement.

      --
      $_ = "wftedskaebjgdpjgidbsmnjgcdwatb"; tr/a-z/oh, turtleneck Phrase Jar!/; print
    10. Re:using a screen that works 90% of the time by Anonymous Coward · · Score: 0

      Since you seem to be a smart one, I'll let you in on a little secret.

      If the test works by comparing a measurement with a threshold, you can choose the threshold so that the false positive rate equals the false negative rate. Suppose when you make them equal the rates are both 10%, then you use that threshold and can call your test 90% accurate.

    11. Re:using a screen that works 90% of the time by MyLongNickName · · Score: 1

      But the whole point of the topic is that the journalist needs to explain his vast understanding of statistics to the unwashed masses. 90% accuracy is meaningless. You may find an interpretation to what the journalist is saying, but no matter what, it is inaccurate. You cannot use a single number to represent the accuracy of a model.

      Lemme give you an example.

      Here is my machine. It simply returns "Not a terrorist". My machine is 99.999% accurate as 99.999% of the population is not a terrorist. I beat the hell out of anything else out there. I am perfect at getting no false positives and am perfectly ineffective at getting accurate positives.

      --
      See my journal for slashdot ID's by year. Mine created in 2005. http://slashdot.org/journal/289875/slashdot-ids-by-year
    12. Re:using a screen that works 90% of the time by nedlohs · · Score: 1

      The article uses the word "accurate" which has a precise definition already. It is the percentage of correct answers. And yes it doesn't tell you anything about the false positive rate and false negative rates. Though in this case since you are dealing with a very small chance event it implies enough to reach the conclusions the article does.

      If 1% of the population are terrorists then to get a 90% accuracy the false positive rate must be between 9.1% and 10.1%, so just using 10% is good enough for this back of the envelope stuff. As the percentage of actual terrorists goes up the range widens, but as it goes down it narrows. Orders or magnitude less than 1% of air travelers hijack or blow up the plane. If the percentage is actually 0.1% our range gets to 9.91% to 10.01%.

      Which makes it seems to me that just using the accuracy as the false positive rate for an article like that is perfectly acceptable.

    13. Re:using a screen that works 90% of the time by noidentity · · Score: 1

      Nope, there are other possibilities. For example, if 100% of the people screened aren't terrorists, then we don't know how well it works on terrorists, and do know that it identifies 10% of non-terrorists as terrorists. Buf if the people being screened are say 50% terrorists, then 90% correct result could mean it identifies all the non-terrorists correctly, and 80% of the terrorists, mis-identifying 20% of the terrorists (10% of the total people screened) as non-terrorists. etc. you get the idea. What we really want to know is what % of non-terrorists it flags as terrorists, and what % of terrorists if flags as non-terrorists (false-positive and false-negative, respectively).

    14. Re:using a screen that works 90% of the time by clone53421 · · Score: 1

      It tells you everything about the false positive rate. Call the people detained "x" and the people screened "y". According to your interpretation, 90% of the detained, ".9x", are terrorists. 10% of the detained, ".1x", are not. If "y" is "all the people screened", then the false positive rate is ".1x / y": the number detained who were not terrorists compared to the total number screened.

      I, on the other hand, would interpret it to mean that the test accurately caught 90% of the terrorists, which would say nothing about the false positive rate. It would, however, indicate that 10% of the terrorists were not flagged by the test.

      Since TFS is not really clear, it's not evident which interpretation is correct. As others have noted, the "correct" interpretation is "90% of terrorists are correctly identified and 90% of non-terrorists are correctly identified", but there's also no guarantee that TFA used it in the "correct" sense. (No, I didn't RTFA.)

      --
      Alexander Peter Kristopeit bought his basement from his mommy for one dollar.
    15. Re:using a screen that works 90% of the time by DavidTC · · Score: 1

      Just because the two numbers can be different doesn't mean you shouldn't assume someone is talking about them both when they use one number. That is the only sane way to parse '90% correct', that it is correct 90% of the time regardless of whom it is testing.

      --
      If corporations are people, aren't stockholders guilty of slavery?
    16. Re:using a screen that works 90% of the time by MyLongNickName · · Score: 1

      The odds of that are incredibly remote.

      --
      See my journal for slashdot ID's by year. Mine created in 2005. http://slashdot.org/journal/289875/slashdot-ids-by-year
    17. Re:using a screen that works 90% of the time by DavidTC · · Score: 1

      The 'odds' are meaningless when it's done deliberately, like it often is.

      If you are measuring something, or a bunch of things adding them together, to determine if something is X or not, there has to be a point where the percentage of false positives and false negatives are the same.

      It is fairly easy to draw the trigger line at exactly that point. Y% of X score on one side of the line, and the same Y% of not-X score on the other side.

      This is often, in fact, actually done. It's how they set the line when there's no obvious better way.

      --
      If corporations are people, aren't stockholders guilty of slavery?
    18. Re:using a screen that works 90% of the time by Bob9113 · · Score: 1

      >> Exactly. So, someone who doesn't have a grasp on the terminology wants to educate folks who don't have a grasp on it either.

      > And this kids -- we call journalism.

      While I like the point you are making, I would like to precise the term a bit.

      What the OP describes is what we call advertainment. Journalism died years ago. It is being reborn on blogs, YouTube, and Twitter, but I think it unlikely that it will ever again be a frequent guest in the traditional media.

  10. Speech Recognition by mepperpint · · Score: 4, Insightful

    That's easy, just tell them that the screenings work about as well as speech recognition. It's 95% accurate and everyone knows how much it sucks.

    1. Re:Speech Recognition by Thanshin · · Score: 3, Funny

      That's easy, just tell them that the screenings work about as well as speech recognition. It's 95% accurate and everyone knows how much it sucks.

      What R you toking about, Is peach recognitions the best since sly St.Bread?

    2. Re:Speech Recognition by clone53421 · · Score: 1

      I see that "is-less-than quote is-greater-than" was just too much to even bother trying...

      --
      Alexander Peter Kristopeit bought his basement from his mommy for one dollar.
    3. Re:Speech Recognition by Thanshin · · Score: 1

      I see that "is-less-than quote is-greater-than" was just too much to even bother trying...

      There you go.

    4. Re:Speech Recognition by Anonymous Coward · · Score: 0

      Dear Aunt, letâ(TM)s set so double the killer delete select all.

  11. Not possible, at least for now by Rob+the+Bold · · Score: 1

    How can this counter-intuitive fact be communicated effectively to people unschooled in statistics?

    You'll know when your people are ready for statistics. . . don't even bother trying until state-run lotteries go broke for lack of players.

    --
    I am not a crackpot.
    1. Re:Not possible, at least for now by Daniel+Dvorkin · · Score: 3, Insightful

      You'll know when your people are ready for statistics. . . don't even bother trying until state-run lotteries go broke for lack of players.

      Er, not really. The usual cost-benefit, expected-payoff analysis doesn't really work when you're talking about extreme examples like winning the lottery, at least not with huge payoffs measured in tens or hundreds of millions of dollars. You can know, perfectly well, that the ROI on a lottery ticket is less than the cost of the ticket, and still consider it a perfectly rational investment.

      If I buy $150 worth of groceries and throw in a $1 lottery ticket on top of it, the effective cost to me is zero. I'm never going to notice that dollar being gone. Not having that dollar is going to make no difference to my life. But in the (exceedingly unlikely, yes) event that I win a $100 million jackpot, the payoff is damn near infinite. Having that kind of money can't really be compared to, say, getting a raise, or seeing your stocks go up in the market. It's just on a whole different scale.

      So in short: infinity - (0 * 10^-9) = infinity. Don't assume that everyone who buys a lottery ticket is ignorant. Actually, I suspect most people who buy lottery tickets are making this kind of calculation, even if they're not doing the numbers quite as explicitly.

      Here's an example in the opposite direction, which I think will make things a little more clear. Suppose I were to set up a "reverse lottery," which works as follows. You have, let's say, a net worth of $100,000. If you sign up for my lottery, I pay you a dollar. Then you pick six numbers between 1 and 10, I draw six balls out of urns, and if the numbers match ... I take everything you own. Your house, your car, your computer, the clothes off your back. You're turned out on the street.

      In probabilistic terms, it would make perfect sense for you to play. 1 - (100000 * 10^-6) = 0.9, which means that the game has a positive expected payoff. In fact, it would make sense for you to play a lot, up to whatever limit is allowed, let's say once a day. But would you do it? I kind of doubt you would, because every day, you'd be looking at that one-in-a-million chance of having your life shattered. Most people would consider that a bad risk, no matter what the raw numbers say. And people who play the lottery consider it a pretty good risk for the same reason.

      --
      The correlation between ignorance of statistics and using "correlation is not causation" as an argument is close to 1.
    2. Re:Not possible, at least for now by ConfusedVorlon · · Score: 1

      If you think people who buy lottery tickets are idiots, then you should probably conclude that people who buy insurance for rare events are idiots.

      It's a similar setup - just avoiding an unlikely large negative, rather than creating a possibility for an unlikely large positive

      Insurance company:
      probably pays out ~50% of the cash it takes (sure, this varies massively)
      you are very unlikely to 'win' but if you do, they could cover a very large expense like your house burning down
      average return to the user ~50%

      Lottery:
      probably pays out ~50% of the cash it takes (sure, this varies massively)
      you are very unlikely to 'win' but if you do, it could be a life-changing ammount of money
      average return to the user ~50%

      which one is the idot?
      probably pa

    3. Re:Not possible, at least for now by umghhh · · Score: 1

      Let us take your second example bit further - if I play with somebody else's property here i.e. risking losing everything that does not belong to me but in case of success winning some small sum of money (small comparing with the actual liquidity being base for the bet) then we have a situation that annoyingly resembles something completly different. In this completly different and one would hope not realistic situation the bets were in fact so huge that the national states that did not forbid such games could go bankrupt or bought by Chinese government (if it saw it fit).

    4. Re:Not possible, at least for now by Rob+the+Bold · · Score: 1

      If you think people who buy lottery tickets are idiots, then you should probably conclude that people who buy insurance for rare events are idiots.

      I didn't call people who buy lottery tickets anything. Rather, you are reading something into my comment that I didn't say. A person who makes a bad decision is not necessarily mentally challenged. For that matter, a person who makes a good decision isn't necessarily a genius.

      As to the case of Lottery vs. Insurance, lottery tickets are a completely voluntary purchase. Insurance is less so. Homeowners insurance is mandated by the bank that finances one's mortgage. Car insurance is mandated by the government and by one's financier (if bought on time). Most health insurance (in the US) is provided by one's job, and doesn't just pay out in case of emergency but also qualifies the holder for reduced rates for services and greatly increases the odds of hospital admission when needed. It's considerably more difficult to get medical care without it, even if one has the means to self-pay. Employers don't usually allow employees to opt-out of insurance, and they almost never comp the optee for the unused benefit.

      As to which one's the "idot" -- I've got no idea.

      --
      I am not a crackpot.
    5. Re:Not possible, at least for now by DavidTC · · Score: 1

      You can play roulette as a reverse lottery.

      Start with, say, $100,000. The more the better. Pick a color, let's say red.

      Put $1 on red. Spin.

      If it wins, take it off, start over at $1.

      If it loses, put $2 on that color, spin. If that loses, put $4 on that color, $8, etc.

      Feel free to change colors or odd/even, that's not actually important. Just keep betting on something with 50/50 odds, when you win, take the dollar, when you lose, double the last bet.

      As long as that 50% (Well, 95% chance in roulette because of the 0 and 00.) chance happens before you run out of money, you made exactly $1.

      If it does not happen, you lose all your money. If you start with $1023 dollars, you can go 9 times before you're out of money, which gives you a 1/1024 chance of losing it all. (Of course, that chance applies every time you start over at $1.

      Also I was pretending it was a 50/50 chance, but it's not because of the aforementioned 0 and 00. So it's a reverse lottery, but slanted away from you, just like a normal lottery. The odds are, most spins, you'll win exactly $1, but there's a slight chance you'll run out of money and lose your entire investment.

      --
      If corporations are people, aren't stockholders guilty of slavery?
    6. Re:Not possible, at least for now by schon · · Score: 1

      You'll know when your people are ready for statistics. . . don't even bother trying until state-run lotteries go broke for lack of players.

      A statistics professor was being interviewed by a local radio station on probabilities of winning the lottery. He came up with a bunch of statistics on how unlikely it was for anyone to win, and was very convincing that it was a waste of time.

      At the end of the interview, the host asked him if he ever bought a ticket. His response: "every week."

      Not everyone who plays the lottery is ignorant of statistics and mathematics. Some people gamble because it's fun.

    7. Re:Not possible, at least for now by Rob+the+Bold · · Score: 1

      If I buy $150 worth of groceries and throw in a $1 lottery ticket on top of it, the effective cost to me is zero. I'm never going to notice that dollar being gone. Not having that dollar is going to make no difference to my life. But in the (exceedingly unlikely, yes) event that I win a $100 million jackpot, the payoff is damn near infinite. Having that kind of money can't really be compared to, say, getting a raise, or seeing your stocks go up in the market. It's just on a whole different scale.

      So in short: infinity - (0 * 10^-9) = infinity. Don't assume that everyone who buys a lottery ticket is ignorant. Actually, I suspect most people who buy lottery tickets are making this kind of calculation, even if they're not doing the numbers quite as explicitly.

      I don't think I could have illustrated this any better.

      --
      I am not a crackpot.
    8. Re:Not possible, at least for now by Morkano · · Score: 1

      Another factor usually overlooked is that lotteries can be FUN. You spend a dollar, and you can the thrill of comparing the numbers, getting a few right, that sort of thing. On that dollar, how much is accounted for by the entertainment value alone? When I spend $50 on a computer game, that's just money down a hole. At least with a lottery ticket you're having fun and potentially changing your life.

      --
      Victory or awesome!
    9. Re:Not possible, at least for now by mcgrew · · Score: 1

      don't even bother trying until state-run lotteries go broke for lack of players

      Why buy a lottery ticket when your chance of buying a winning ticket is infinitessimally greater than finding a winning ticket on the ground?

    10. Re:Not possible, at least for now by CokeBear · · Score: 1

      This is the reason I play. I recognize the virtual impossibility of winning the jackpot, but between the time I buy the ticket and the time of the draw (or whenever I get around to checking my numbers) I get significant pleasure (far more than $1 worth) imagining what I would do if I won the jackpot.

      However, giving this reason for playing, perhaps the most rational course of action would be to only buy one ticket, and simply never check the numbers...

      --
      Reality has a liberal bias
    11. Re:Not possible, at least for now by E++99 · · Score: 1

      If I buy $150 worth of groceries and throw in a $1 lottery ticket on top of it, the effective cost to me is zero. I'm never going to notice that dollar being gone.

      No... the net effective cost to you is $1. The fact that you play a psychological game with yourself to make yourself "not notice" it, is really irrelevant to the actual cost to you.

      Not having that dollar is going to make no difference to my life.

      It's going to make a $1 difference in your life. If you do it every time you go shopping, it's going to make a significant cumulative difference in your life. If that dollar was really not going to make a difference to your life, maybe you should have dropped it in a donation box instead.

      But in the (exceedingly unlikely, yes) event that I win a $100 million jackpot, the payoff is damn near infinite. Having that kind of money can't really be compared to, say, getting a raise, or seeing your stocks go up in the market. It's just on a whole different scale.

      That's another psychological illusion. $100 million seems "damn near infinite" until you actually have it... after which you give half to the government, then generally buy a mansion you can't afford and end up in bankruptcy.

      So in short: infinity - (0 * 10^-9) = infinity. Don't assume that everyone who buys a lottery ticket is ignorant. Actually, I suspect most people who buy lottery tickets are making this kind of calculation, even if they're not doing the numbers quite as explicitly.

      Exactly, that's the equation. They are spending their money because of a psychological exploit which makes that appear to be the equation when it is not actually. That is exactly why people who play the lottery are ignorant.

      Here's an example in the opposite direction, which I think will make things a little more clear. Suppose I were to set up a "reverse lottery," which works as follows. You have, let's say, a net worth of $100,000. If you sign up for my lottery, I pay you a dollar. Then you pick six numbers between 1 and 10, I draw six balls out of urns, and if the numbers match ... I take everything you own. Your house, your car, your computer, the clothes off your back. You're turned out on the street.

      In probabilistic terms, it would make perfect sense for you to play. 1 - (100000 * 10^-6) = 0.9, which means that the game has a positive expected payoff. In fact, it would make sense for you to play a lot, up to whatever limit is allowed, let's say once a day. But would you do it? I kind of doubt you would, because every day, you'd be looking at that one-in-a-million chance of having your life shattered. Most people would consider that a bad risk, no matter what the raw numbers say. And people who play the lottery consider it a pretty good risk for the same reason.

      The problem with this scenario is that the payoff automatically increases too quickly, since you have to give up all your proceeds from selling tickets whenever someone wins. If you had to give up just the initial net worth of $100,000 if someone won, you'd be a fool not to do this. You'd have the most profitable casino in history, if you had customers stupid enough to pay. If someone happened to hit the number before you made $100,000 on tickets, you could easily get a loan to tide you over, with that kind of business model.

    12. Re:Not possible, at least for now by E++99 · · Score: 1

      Insurance premiums are cost-effective. There's a competitive market. There's nothing stupid about buying a correctly-priced insurance policy.

      Lotteries are legally enforced state monopolies, instituted for the purpose of being able to sell massively overpriced tickets to morons. If lotteries were competitive, the tickets would cost half the price or less, and it would be a more justifiable thing to buy one.

    13. Re:Not possible, at least for now by orkysoft · · Score: 1

      In probabilistic terms, it would make perfect sense for you to play. 1 - (100000 * 10^-6) = 0.9, which means that the game has a positive expected payoff. In fact, it would make sense for you to play a lot, up to whatever limit is allowed, let's say once a day. But would you do it? I kind of doubt you would, because every day, you'd be looking at that one-in-a-million chance of having your life shattered. Most people would consider that a bad risk, no matter what the raw numbers say. And people who play the lottery consider it a pretty good risk for the same reason.

      Still, millions of people drive to work daily. Positive expected payoff, but a small chance of having your life shattered.

      --

      I suffer from attention surplus disorder.
    14. Re:Not possible, at least for now by jonadab · · Score: 1

      > If I buy $150 worth of groceries and throw in a $1 lottery ticket on
      > top of it, the effective cost to me is zero. I'm never going to notice
      > that dollar being gone.

      You won't *notice*, and that individual dollar isn't much by itself, but if this is characteristic of how you make your spending decisions, you'll be out hundreds or even thousands of dollars a year on a whole lot of stupid little worthless purchases. A lotto ticket here, an overpriced coffee there, and pretty soon 20% of your income will be going to stuff you don't even think about buying, with nothing to show for it. Some day you'll be sixty and not own a home and not know why, because you never noticed where your money was going.

      > But in the (exceedingly unlikely, yes) event that I win
      > a $100 million jackpot, the payoff is damn near infinite.

      Actually, statistically, it comes out negative. The average big lotto winner ends up worse off than he started, just a few months later. The reasons for this are complicated, but it boils down to this: people who buy lottery tickets are, ipso facto, not very good at handling money.

      > If you sign up for my lottery, I pay you a dollar. Then you pick
      > six numbers between 1 and 10, I draw six balls out of urns, and
      > if the numbers match ... I take everything you own.

      The big-money lotteries have more combinations than that. A lot more. And the jackpot is rigged to max out at significantly less than 100% of the take, so if we set up the reverse lottery like the forward ones, only in reverse, you wouldn't ever take 100% of what I own, even if I lose. More like 70%, tops. So even if I lost after playing only a hundred thousand times (which would be so unlikely most people would round the probability to zero), I'd still be ahead. I could play as many times as you let me, and I would never EVER end up with less money than I started with (and even if I did, I could just play some more and get it all back).

      The only reason I *wouldn't* play your reverse lottery is because it would be wrong for me to exploit your stupidity in that way.

      --
      Cut that out, or I will ship you to Norilsk in a box.
    15. Re:Not possible, at least for now by QuestionsNotAnswers · · Score: 1

      Thousands of "Lloyd's names" were signed up for a reinsurance reverse lottery, and lost. They lost the game in the 90's, and there is still fallout thirty years later. The important point is that people signed up to play (even if the game turned out to be rigged).

      --
      Happy moony
    16. Re:Not possible, at least for now by Anonymous Coward · · Score: 0

      I think there is something to be said for cheap thrills. Instead of a lottery ticket, I might pay $1 for a candy bar. Now, I don't need a candy bar. It's not nutritious; actually, it's a bit bad for my health. There's certainly no $100 million dollar payoff hiding inside a Butterfinger. But, so long as I'm not eating them frequently, its effects on both my health and my wallet will be functionally negligible. It's a simple little pleasure; yum yum, it's chocolate.

      On the other hand, there is a psychological downside: while I'm aware of the effects of that candy bar, I'm also aware that many people are not aware of or are actively ignoring the negative effects of that candy bar, and are wasting money and ruining their health by purchasing too many candy bars. I'm aware that there's an industry making bank on candy bars, and I'm aware that over-indulgers are their best customers.

      In the case of candy bars, I'm mostly not that inclined to worry. Soda pop (and, more and more, sweetened tea) being offered as the standard beverage in lower-class restaurants (and school cafeterias!) troubles me much more, but that's another tangent. To get back to the case of lottery tickets, it's a hair more troublesome, especially since it's a governmental revenue stream; nevertheless, I'm not about to criticize someone who buys one now and again for kicks. It's the people whose purchases fill out the bulk of those grand payoffs that bother me. Having seen a trucker walk up to a gas station counter and ask for the entire roll of tickets to go with their jumbo crappychino, I'm aware that they're out there. Heck, the teller didn't even blink, much less comment, he just popped the door and started counting, whereas the experience was novel enough for me that I didn't even think to be annoyed at the wait.

      On that note, maybe I need to get out more; as dumb as college students can be, entry exams and tuition do serve to filter the crowds in the college district. Just don't ask me to guess how efficient those filters are -- I'm not a statistician.

    17. Re:Not possible, at least for now by Anonymous Coward · · Score: 0

      Without impugning your initial defense of the Cost-Benefit of playing the lotto, your use of the reverse lottery as an example is flawed because humans value losses differentially from gains. That is to say even though losing everything an gaining a massive amount of money are both radical changes from the status quo, people tend to view losing everything as much more radical than gaining 'everything'.

    18. Re:Not possible, at least for now by clone53421 · · Score: 1

      If you think people who buy lottery tickets are idiots, then you should probably conclude that people who buy insurance for rare events are idiots.

      Sure. If you take out an insurance policy against being struck by lightning, you're just as much an idiot as someone who plays the lottery against million-to-one odds. Except that the person playing the lotto at least gets some entertainment value out of the purchase. It's doubtful that your entertainment value from the insurance policy is worth the money you spent, although your friends' entertainment might be worth something when you tell them.

      --
      Alexander Peter Kristopeit bought his basement from his mommy for one dollar.
  12. Education education education by VShael · · Score: 1

    Quick fixes for overweight people, or diet and exercise? Which do you think works?

    What makes you think there's a quick fix for ignorance?

    People who are not educated in statistics have only one solution which will work: Get educated in statistics.
    That doesn't mean taking a maths degree. Any number of books or basic courses could help.

    The problem is that most ignorant people don't want education.
    And the really ignorant ones don't even believe that there's such a thing as being smart.

    Just look at the number of people who play the lottery. Think any of them have the vaguest notion about statistics?
    Think any of them WANT to learn?

    1. Re:Education education education by Blade · · Score: 1

      I call bullshit. The problem with statistics specifically is that it can very often be non-intuitive. The Monte Hall problem being one of the best examples. It's not just about ignorance or a lack of education. It's about presentation as well. I'm not stupid and I play the lottery. I know the chances of winning are approx. 1 in 14 million. Which means I have to play for some insane number of millennia before I'm ensured a win. But I also know that most weeks, someone somewhere does win. So the pound I place on it each week is a bit of fun.

    2. Re:Education education education by Thanshin · · Score: 0, Troll

      Actually, there's a pretty quick solution to both overweight and ignorance.

      However, it has bad effects on public health.

      And you spend a lot of bullets.

    3. Re:Education education education by vitatyranni · · Score: 1

      I agree-as according to statistics even were you to play for some insane number of millennium you're still not ensured to win. Knowing that a test works 99.9% of the time is one thing, understanding that if tested positive there's still a ~30% chance it was a false positive (iirc) is another and quite unintuitive.

    4. Re:Education education education by mdwh2 · · Score: 1

      But I also know that most weeks, someone somewhere does win. So the pound I place on it each week is a bit of fun.

      I get that same fun without paying a pound. I know that someone somewhere does win, and I'm a pound richer! (Over 700 pounds richer by now, in fact.)

    5. Re:Education education education by BitHive · · Score: 1

      Yes, and the most insecure of the ignorant not only do not want education, they have all sorts of ideas why it's not just not for them, it's unnecessary in general. Try to disabuse them of this notion and they'll accuse you of being an "ivory tower elitist" even if they are an upper middle class person talking to a lower middle class one whose parents cared enough to make them go to school.

  13. Just tell the truth by space_in_your_face · · Score: 1

    Instead of giving a binary answer ("You are (not) a terrorist"), just communicate the probability ("There's one chance in three hundred that you are a terrorist. As this is higher than in the general population, we will investigate further to know for sure."). The same apply for medical exams. You can tell someone "The test tells us you have one chance in one hundred to have lupus. It's low, but higher than normal. We need to do more tests to know for sure".

    1. Re:Just tell the truth by Anonymous Coward · · Score: 0

      If test A says you might have lupus, but more tests say you don't, you'll never take test A again.

      If test B says you might be a terrorist, more tests say you aren't, but you end up missing your fight. The question is: will they really put you on an exception list for test B, or will they keep using test B on you each time you go to the airport and make you systematically miss all your flights?

    2. Re:Just tell the truth by nedlohs · · Score: 1

      Because it's harder to sell people on a terrorist scanner which will identify 10,000 non-terrorists for the full body cavity search room for every terrorist, plus will let some terrorists through anyway.

      Much easier to sell if you say it is 99% accurate.

  14. I can offer up a nice book on that by Shivetya · · Score: 4, Interesting

    http://www.amazon.com/Manga-Guide-Statistics-Shin-Takahashi/dp/1593271891

    I hate math, always did. I was good at it but just could not stand it. As such I skipped out on about anything math related beyond algebra (college level). Didn't impede my programming ability at all.

    Still there are times where I like to learn how stuff works and honestly this series of books, Manga Guide to ......, has given me a quick leg up on a few subjects I would never have gained from traditional text books.

    --
    * Winners compare their achievements to their goals, losers compare theirs to that of others.
    1. Re:I can offer up a nice book on that by improfane · · Score: 1

      What is the most complex algorithm you have used and what language is it in?

      I suck at mathematics and barely passed in in CS and also program to a reasonable standard.

      However mathematics WILL make you a better programmer.

      --
      Slashdot needs Geekcode | Can anyone recommend any good SCIFI? My tastes: Foundation, Startide Rising, CITY, Ringworld,
  15. Statistics by Joce640k · · Score: 1

    It's obvious that the person telling us about statistics doesn't understand statistics.

     

    On the subject of terrorism, why not simply arrest everybody, just to be sure...?

    --
    No sig today...
  16. Not the first time this has been done. by N1tr0u5 · · Score: 2, Interesting

    Though it may be the first time that people are trying to draw general population attention to it. I believe the first place I saw this sort of concept revealed was by Cory Doctorow. Though the below article isn't necessarily where I saw it, it recants the same message.

    http://www.guardian.co.uk/technology/2008/may/20/rare.events

  17. How to do it? Easy by davidwr · · Score: 1

    Charts. Big pretty colorful charts.

    Chart one: Without this screening
    # of this type of cancer found in last year, including false positives.
    # of initial screenings determined to be a false positive in the last year, and number who were falsely diagnoses with this cancer after a false positive with a followup test.
    # of deaths in the last year from the cancer.
    # of deaths in last year from complications of treatment of people who were false positives.
    # of man-years of productivity lost in past year lost to screening - typically 1-8 working hours per person.
    # of man-years of productivity lost in past year lost to illness, and treatment, etc. from initial symptoms until person declared cancer-free or dies.
    # of man-years of productivity lost in past year for treatment, side-effects, etc. for people who are false positives.
    $ in direct costs for each of the above.
    $ in lost productivity in the past year for each of the above.

    Chart two: Same chart, but with numbers showing estimates if we had been using screening for the past 5 years

    Chart three: Estimated annual increase or decrease in everyone's medical insurance and life insurance if we start using these tests per life saved.

    People can decide for themselves if they are willing to trade lives saved for increased medical costs, assuming they go up. How much is a human life worth? $0.50? $500? $500,000? $500,000,000?

    The moral of the charts:

    Tests with a high false positive rate should be treated as initial screens only, not as a diagnosis. If a screen says "the general population has a 1 in 50,000 chance of having this cancer, but your chances are 50/50" or even "...your chances are 1 in 300" that's very useful information but not a diagnosis. A test that narrows things down to 50/50 might be worth spending real time and money on, a test that narrows things down to 1 in 300 may not be cost-effective by itself.

    --
    Knowledge is how to play a game, intelligence is how to win, wisdom is knowing what game to play.
    1. Re:How to do it? Easy by Thanshin · · Score: 1

      Expected public response.

      "tl;dr"

      "Chart? What's a chart. Oh, the fugly colored thing?"

  18. A box by bzzfzz · · Score: 4, Informative

    Back during the TQM fad they'd make this point by giving everyone a clear plastic box with 10,000 little balls in it. There was a cribbage board like affair in it, with 1,000 holes, such that by inverting and shaking the box, then turning it upright, 1,000 of the balls would settle into the holes more or less at random, but still be visible through the clear box. The balls were color coded -- 10 red balls, 40 black ones, 50 blue ones, and the rest white. The odds of getting no red and no black are lower than 1%, contrary to most people's expectations.

    This was used to drive home a point about the difficulty of "testing in quality" (quality tests suffer false negatives and if there are, say, 1000 such individual measurements on a piece of machinery it's nearly impossible to ship a machine without at least one thing wrong unless the tolerances are well controlled at the point of manufacture). The same idea works any time you want to illustrate the effects of low-incidence events on a large population.

    I've always wondered how much injustice is perpetrated by drug screening on large populations, since false positives do occur and statistically must occur twice in a row at least some of the time, which is the threshold considered conclusive proof of abuse by most employers and the courts.

    1. Re:A box by 7-Vodka · · Score: 1

      I've always wondered how much injustice is perpetrated by drug screening on large populations

      Phew! For a minute there I thought you were talking about drug screening of professional athletes for performance enhancing drugs. In that case there are so many juicers, it's the false negatives you have to worry about :)

      --

      Liberty.

    2. Re:A box by bitt3n · · Score: 3, Informative

      I've always wondered how much injustice is perpetrated by drug screening on large populations, since false positives do occur and statistically must occur twice in a row at least some of the time, which is the threshold considered conclusive proof of abuse by most employers and the courts.

      this very problem came up in England a while ago, but for SIDS deaths. If I recall correctly, some statistician testified at a murder trial as to the infinitesimal chance that a mother would have two infants die from SIDS separately. In fact, granted the size of the population, it is not unlikely for two SIDS deaths to happen to some mother somewhere in the country. Perhaps someone else can remember the details. here's an article but it's not free: http://bjps.oxfordjournals.org/cgi/content/abstract/axm015v1

    3. Re:A box by Timmmm · · Score: 2, Interesting

      I read the court documents for the trial a while ago. There were two issues:

      1. They quoted the statistics assuming the deaths were independent (i.e. the squared the probability of one SIDS death). The error of this was pointed out.
      2. No one mentioned the prosecutors fallacy.

      In the end the jury were won over by an argument along the lines of: "Ignore the statistics. You *know* it's really unlikely that these were two SIDS deaths.".

      http://en.wikipedia.org/wiki/Sally_Clark

    4. Re:A box by nbauman · · Score: 1
      Actually, I wrote a story on that. http://just-say-know.com:16080/articles/NS/JustSayNoWar.html

      I tried to get the best figures I could for the false positive rate of those employment drug tests. It seemed to be around 1% to 3%.

      There were (cheap) screening tests with a false positive rate of about 1%, under ideal circumstances. Positives were supposed to be confirmed with (expensive) gas chromatography/mass spectroscopy. A lot of companies saved money by skipping the confirmation tests, especially for screening job applicants.

      Poppy seed bagels actually can give a false positive.

      A few employees sued, but it was difficult to fight a false positive.

      The U.S. military seemed to have a good program. But when you're regularly screening a million and a half people, a lot of one-in-a-million situations will come up. (And false positives are a lot more than one in a million.)

      There was one lab where a GC/MS unit was giving false positives for amphetamine, as I recall. They took apart the machine, examined it, but they never figured out why it was giving false positives. People got fired. Then one supervisor absolutely refused to believe that one of his employees was lying, so they checked it out more carefully. The employee was finally vindicated.

    5. Re:A box by avandesande · · Score: 1

      If there is a positive with a drug test they will do additional rounds of analysis that will bring the accuracy out to several more decimal points.

      --
      love is just extroverted narcissism
    6. Re:A box by radtea · · Score: 2, Interesting

      The same idea works any time you want to illustrate the effects of low-incidence events on a large population.

      XKCD can be used to illustrate this too

      Mouse-over: "You can do this one in every 30 times and still have 97% positive feedback."

      --
      Blasphemy is a human right. Blasphemophobia kills.
    7. Re:A box by DavidTC · · Score: 1

      And the really stupid thing is, since we don't know the cause of many case of SIDS (beyond, obviously, 'stopped breathing'), even if the deaths weren't unrelated...it's entirely likely the mother had nothing to do with them.

      It could easily be some genetic thing, or it could be some environmental factor, or it could even be some parenting mistake that is not realized to be a mistake, like a certain posture while feeding causing death hours later. (Which certainly isn't murder, and isn't even manslaughter if no one knew any better.)

      I.e., even if it was not a coincidence, which statistically, it certainly could be, doesn't mean the slightest amount of fault should attach to the mother whatsoever. 'Hello, we've decided to send you to jail because you have a gene making SIDS more like to happen.'

      Of course, it was eventually determined that her second child died of a staphylococcus aureus infection, and she was released from jail.

      --
      If corporations are people, aren't stockholders guilty of slavery?
    8. Re:A box by bzzfzz · · Score: 1

      With drug tests, they typically have a low-dollar hourly person collect a urine sample which is then split into two containers. There is some likelihood of sample contamination affecting both samples.

      Then they test one sample using economical methods that are not more than, say, 99% reliable. If there is a positive, they will generally use a gas chromatograph, which as you point out is much more accurate, with false positives in the .01 % area. Then they'll sometimes run a test at another lab on the other side of the split. The problem is that that isn't really an independent test, because of the potential for cross contamination, and because of the possibility of a positive result for reasons unrelated to abuse (try a web search on the two-bagel breakfast, for an example). In many cases there's really no appeal beyond this point and people get sent to mandatory treatment, fired, reassigned, whatever. One in 10,000, one in 100,000, who knows for sure.

    9. Re:A box by Anonymous Coward · · Score: 0

      This was indeed the Sally Clark case. Unfortunately, for Sally the prosecutor brought in a Pediatrician to do the statistics and the defense attorney wasn't savvy enough to get a statistician to check the work/assumptions.

      As a side note: I teach statistics and we just used this example today in class.

  19. the covering of asses by castironpigeon · · Score: 1

    Not sure about other places so I'll speak for the US here. If you could have detected something (terrorist, cancer, etc), but didn't, you'll get taken to court for it. If you run tests you're covered no matter what the results. If you didn't, you're negligent and will spend the rest of your life selling paperclips out of a cardboard box. As an off-topic aside, these ridiculous lawsuits are why healthcare in the US is as bad as it is and no administration is going to admit that or fix it because putting lawyers out of work is the last thing any politician wants to do.

    --
    mmmm...forbidden donut
  20. Give up by Bemopolis · · Score: 0, Troll

    How can this counter-intuitive fact be communicated effectively to people unschooled in statistics?

    It can't. People are stupid; Americans doubly so. We live in a country where half the people believe that a talking snake catered the wedding between a naked man and a naked woman made out of his rib, which enraged the upstairs landlord so much he evicted them. They also believe some guy sitting on a sky chair gives a shit how a high school football game ends. They believe that the Honolulu paper printed a fake birth announcement in 1961 so that 48 years later a socialist elected to take away their guns. And those that don't? They think that Kennedy was shot by aliens hired by the Illuminati and that a president blew up some office buildings in 2001 to steal the gold in the basement. Idiots all.

    You want these idiots to understand how statistics works? Then you need to write a Java program that demonstrates it so simply that a retarded chihuahua could understand it. Oh, and it has to be colored red, white, and blue, cause this is 'Merica!. And it has to have tits in it somewhere.

    --
    "I guess the moral of the story is, don't paint your airship with rocket fuel." -- Addison Bain
    1. Re:Give up by Thanshin · · Score: 1

      And it has to have tits in it somewhere.

      Wow! You almost lost me there, but your last point convinced me of the absolute necessity of having such a... whatever you were talking about.

    2. Re:Give up by Anonymous Coward · · Score: 0

      Still bitter about the Revolutionary War, I see.

  21. Understanding efficiency by Kainaw · · Score: 1

    Better yet, how can efficiency be explained to wannabe nerds? If a test is very fast, non-intrusive, and cheap with a 90% accuracy, it is a great test. Those 10% may be sent to a further test that is longer, more intrusive, and more expensive with a 99.999999999% accuracy. This applies throughout testing of all kinds. There is no reason screening for terrorists should be a magical area of testing separate from the rules that govern all other areas of testing.

    --
    The previous comment is purposely vague and generalized, but all of the facts are completely true.
    1. Re:Understanding efficiency by blueg3 · · Score: 2, Informative

      Please do not simply press the "9" key until you get bored when it is more readable and more accurate to use words like "very accurate".

      For example, it would be difficult to empirically measure the stated accuracy of your test, since it's inaccurate 1 time in 100 billion.

      This message has been brought to you by the Society for the Elimination of Superfluous Quantification.

    2. Re:Understanding efficiency by ElSupreme · · Score: 1

      Except 10% of the people take the 'longer' and 'more intrusive' test and have their privacy invaded, and miss their flight. Is catching a terrorist worth all that cost?

      --
      My addiction: Arguing with idiots. AKA Slashdot!
    3. Re:Understanding efficiency by DavidTC · · Score: 1

      What the hell is a terrorist going to do on an airplane, anyway? Rage ineffectually at the cockpit door until people bum rush him?

      I think a more useful attack would be to detonate a bomb in the screening line.

      --
      If corporations are people, aren't stockholders guilty of slavery?
    4. Re:Understanding efficiency by dido · · Score: 1

      Some 100,000 passengers pass through a major airport like Heathrow or JFK every day. If you had a test that was capable of detecting terrorists with 90% accuracy and applied them to every passenger going through such an airport, you'd be flagging ten thousand people a day as possible terrorists, and applying the more expensive test of detaining and investigating them all, according to your logic. I wonder how much it would cost to maintain all of the security personnel to do that. Put another way, it also means that if you flew ten times a year, the test would likely flag you at least once a year. The worthlessness of such a test as applied the way you propose should thus be obvious./p

      --
      Qu'on me donne six lignes écrites de la main du plus honnête homme, j'y trouverai de quoi le faire pendre.
    5. Re:Understanding efficiency by Kainaw · · Score: 1

      You are making some wild and crazy assumptions there. Suppose there is a test - something as simple as a metal detector - that flagged 10% of the people. If the light on this test turns red, the person deviates from the main line of people and walks through a second detector that costs a little more to run. Also, being a second detector, it would create a second bottleneck if everyone had to walk through it. This second detector only flags 10% of the 10% that go through it. So, the "more expensive" and "more intrusive" test isn't what you are assuming it to be. It is not a complete strip search. If the second test flags a person, then the person goes to a more precise test. This continues by only expending security where it is needed.

      It is also a wild and crazy assumption that walking through a detector 10 times will cause it to pop positive at least once. I have never ever caused a metal detector to go off. I fly very often. I work in a secure building. I do a lot of government contract work in other government buildings. So, I figure that I walk through metal detectors at least 20 times a week. A friend of mine had them go off on him a lot. They would baton him and let him go. He finally checked into it and found that his tie clip would set it off if it was oriented just right. So, he tossed out the tie clip and hasn't set one off since. If you trigger the terrorist test, you should ask why. Once you know why, you can decide if it is worth changing. It could be something as simple as replacing a tie clip.

      --
      The previous comment is purposely vague and generalized, but all of the facts are completely true.
  22. Someone has already done this by Fuzuli · · Score: 1

    Here you go: http://www.bmj.com/cgi/content/short/327/7417/716?fmr It is titled: "Understanding sensitivity and specificity with the right side of the brain "
    Exactly written for the purpose. PDF should be available freely.

  23. Article perpetuates the problem by darthwader · · Score: 5, Insightful

    The article itself started out by oversimplifying the test. It would be an astounding coincidence if the test had both a 10% false-positive and a 10% false-negative rate. In fact, any normal test has a very different false-positive and false-negative rate. People who describe the test should mention both, not this meaningless "90% accurate" number.

    The BBC article, while claiming to want to reduce confusion, actually perpetuates the problem by using the meaningless "90%" number instead of the specific positive and negative failure rates. If every article describing tests would quote both failure rates, that would go a long way to getting people to understanding the situation.

    --
    I hate it when I make a joke and I get modded "+5 insightful". Mod the stupid comments "funny", not "insightful", pleas
    1. Re:Article perpetuates the problem by Anonymous Coward · · Score: 0

      It would be an astounding coincidence if the test had both a 10% false-positive and a 10% false-negative rate.

      Unless...

    2. Re:Article perpetuates the problem by Anonymous Coward · · Score: 0

      YES - I think at least 99% of the public has not got a clue about what stats actually mean :-)

      For any detection system there will be BOTH false positives and false negatives. Stats should show the AVERAGE rate of each of these as well as the standard deviation or the variance. Them at least the people that do understand could explain it to others. At the moment I still wouldn't have a clue what this information really says.

      However, keeping to the point - normally (in my experience) the news misses the point and provides misleading information.

      Goverments are experts at fiddling stats - like unemployed people suddenly turing into 'job seekers'- presto Labour reduced the number of unemployed people.

    3. Re:Article perpetuates the problem by Anonymous Coward · · Score: 0

      Remember, they're trying to dumb this down to the lowest common denominator of the public. Be glad they even used the term "percent", since that'll likely strain many of the general public's mind.

    4. Re:Article perpetuates the problem by Anonymous Coward · · Score: 0

      All tests that output a number measuring the likelihood of match (which most statistical tests do,) can trivially be adjusted to get "Equal Error rate", by adding the appropriate bias to the output. Indeed the technical term in the Pattern Recognition field for this oft quoted single error figure is the "Equal error rate."

      There are more robust measures of classifier accuracy that account for the arbitrary choice in the bias, for example the area under the ROC curve.

    5. Re:Article perpetuates the problem by Yetihehe · · Score: 1

      They can't tell you how much false negatives there is for terrorist tests, because they couldn't get enough terrorists to check those tests...

      --
      Extreme Programming - Redundant Array of Inexpensive Developers
    6. Re:Article perpetuates the problem by LunaticTippy · · Score: 1

      It is pretty hard to do this. How many terrorists have been accurately identified by any such system? Very very close to or equal to zero. That makes your sensitivity and specificity numbers just about meaningless. For many systems EVERY positive is false, EVERY negative is true.

      --
      Man, you really need that seminar!
  24. Screenings do more harm than good? by DarrenBaker · · Score: 1

    Yeah, and seatbelts cost more lives than they save.

    It may cost more money to institute screening programs and chase false positives, but cancer survivability numbers have been increasing steadily for the last forty years BECAUSE of early detection, not in spite of it. In fact, I remember a statistic from a few years ago that showed more people were surviving all cancers in straight numbers, not just per capita. That's some increase!

    I'll take the possible side-effects of false positives over the known repercussions of no positives any day.

    1. Re:Screenings do more harm than good? by puck01 · · Score: 1

      It depends on the screening test. Some are very good - like colonoscopy. Others can cause more harm than good on average - PSA is a great example.

      Early detection is absolutely the way to go, how to do it for any given condition is the hard part. Many cancers have no screening tests because it is a hard to develop good, quality tests (good sensitivity and specificity). Just testing because it can be done is usually a very bad idea.

    2. Re:Screenings do more harm than good? by abigsmurf · · Score: 1

      Putting on a seatbelt doesn't make you think there's a good chance of you dying for months on end and have to undergo lots of unpleasant examinations and tests.

      A positive cancer test has major implications and ultimately, the average well being of a patient is as important a factor as the lives saved.

      To use a theoretical example. Imagine a doctor discovers that if they tell a mother giving birth that the baby has died in the womb, the reaction from the woman giving birth somehow lowers the chance of a miscarriage by 0.1%. Over the course of a year this could save 10 babies but it would come at the cost of severe mental trauma for every mother (and father). No doctor would do this because it's immoral.

      Likewise, if you give them the results of a test which will make the patient feel they're living on borrowed time, despite knowing the chances of the test result being accurate is slim, that'll make lots of doctors unhappy.

    3. Re:Screenings do more harm than good? by raymansean · · Score: 1

      Yep you make perfect sense, up until the time that someone takes their life because they have been diagnosed with cancer, quits their job to live the rest of their life, or does anything they would not have done that adversely affects the rest of their life if they did not have cancer. If you apply this 90% accuracy to screenings at airports, or the RIAA then chances are you wold outraged that your rights are being trampled on. Don't get me wrong I think that there is good in screenings, but we must educate people about possibility and probability of false positives, with knowledge comes responsibility.

      --
      insert inflammatory comment here!
    4. Re:Screenings do more harm than good? by DarrenBaker · · Score: 1

      I don't think that's a salient example, since knowing that a child is stillborn in the womb can be determined with certainty. Cancer cannot, usually, and I think 100 false positives - where in most cases the doctors and technicians will be somewhat cagey in their language with the patient - in order to get 1 actual positive is worth it.

      To put it another way... Yeah, and if my aunt had balls, she'd be my uncle.

    5. Re:Screenings do more harm than good? by Anonymous Coward · · Score: 0

      RTFA.
      It clearly states that for most cancers, early detection either doesn't do anything or just causes more problems for more people then those people it saves. Yes I know reading the article, "GASP! What strange things will be suggested next!" The increase of surviving all cancers comes from an increased understanding, better treatments, more specific treatments and not from early detection. Look at the thyroid cancer case, only about 2000 people get it a year (from TFA), which means I have a better chance of dieing from food poisoning. Since I have no history of cancer in my family should I worry about it? Nope.
      You are right there are a few tests and they even mention it but screening for every known cancer out there? I don't think so. Why waste my time? Why waste the doctor's time? And why waste the money so I can waste my time and the doctor's time?

    6. Re:Screenings do more harm than good? by DarrenBaker · · Score: 1

      I'm not advocating for testing unnecessarily, just that some bad results will always happen.

      And I would put forth that someone who takes their life because a doctor has told them they *may* have cancer probably had some underlying issues to begin with.

      The incidence of false positives should not preclude testing altogether, that's all I'm saying.

    7. Re:Screenings do more harm than good? by DarrenBaker · · Score: 1

      Did read TFA.

      So, basically, you're suggesting that early detection has not caused a reduction in the number of cancer deaths? Are you serious? Clearly not, since you're posting anonymously.

      Testing for cancers that are common, and for cancers to which a person would be predisposed, is a damn good idea. Early detection saves lives.

    8. Re:Screenings do more harm than good? by Anonymous Coward · · Score: 0

      Reducing the speed limit on highways to 20 mph would also save lives. Since you'll "take the possible side-effects of false positives over the known repercussions of no positives any day", I guess you'll also accept the side-effect of delaying everyone on the highway in order to save x people/year from highway car crashes. Why don't you start campaigning for 20-mph highways right away?

    9. Re:Screenings do more harm than good? by DarrenBaker · · Score: 1

      Let's break that down for a second:

      1000 people get a concerned call from their doctor, telling them that their test came back with a possible positive for a certain type of cancer. These 1000 people are inconvenienced somewhat, becoming nervous, concerned, and worried, as do their friends and family members. They go in for further, more specific testing, and 995 find out that they do not, in fact, have cancer. They are relieved and continue about their lives. 5 of these people do have cancer, and have their lives possibly saved as a result of having it detected. You believe that the moderate discomfort and cumulative worrying of those 995 people outweighs the life-saving potential for those 5? I think nearly all 995 people would agree that it was worth the inconvenience, since one of those 5 positives could have been them.

      Speed limits are a spurious example, since speeding does not kill. Bad driving kills, and I would be very much in favour of banning all poor drivers to save lives.

  25. Simple numbers by Anonymous Coward · · Score: 0

    I'd give the unschooled massed a table like this:

    For every 1000 people you scan, you will have:
    20 innocent people who are identified as a terrorist.
    1 terrorist who is identified as a terrorist.
    1 terrorist who is not identified at all.

    Simple, can be read quickly, very easy to understand.

    Of course, the unschooled masses will still do stupid things like, "Hmm, the first 19 people were innocent. This guy must be a terrorist."

    1. Re:Simple numbers by Anonymous Coward · · Score: 0

      Or most people are easy to spot as none terrorist.
      Odd people musicians etc are harder to decided so we have to spend more time finding them out.

      Terrorists - depends if they are currently on our side or not.

      The following are none terrorists but shut should be classified as such and dealt with.

      None USA Citizens.
      Republicans / Democrats * - insert your slashdot preference.

  26. Not math, interpretation by Toy+G · · Score: 3, Informative

    "Works 90% of the time" here means that it will correctly identify a person as terrorist or not-terrorist in 90% of tests.

    On a sample of 3000 with accuracy 90%, you will end up with 300 results guaranteed to be wrong or ambiguous, which may or may NOT mean the subject is a terrorist. To be safe, obviously you have to detain these "ambiguous" subjects.

    Considering that we know the number of terrorists is incredibly small (from a UK perspective, I'd say something like 100 in 70 millions, or 1 in 700.000, probably even less), we can deduce that these tools are guaranteed to victimize thousands of innocents (at least 69.999) for each "terrorist" ever caught.

    --
    -- Let's go Viridian.
    1. Re:Not math, interpretation by Anonymous Coward · · Score: 0

      we can deduce that these tools are guaranteed to victimize thousands of innocents (at least 69.999) for each "terrorist" ever caught.

      So? I don't get the impression that the UK government has any problems with such huge collateral damage. Basically every "modern western" government is moving in a direction that says 99,9% of citizens are suspicious and prone to terrorist behaviour.

    2. Re:Not math, interpretation by Toy+G · · Score: 1

      So? I don't get the impression that the UK government has any problems with such huge collateral damage.

      After more than 5 years of this sh*t, the government (i.e. the New Labour party) is going to feel the pain at the polls next year. Even the Tories (historically, the party of "law & order") decried some of the most egregiously stupid tools implemented by the current lot (i.e. ID cards).

      --
      -- Let's go Viridian.
  27. Easy... by ak3ldama · · Score: 1

    To find one terrorist in 3000 people, using a screen that works 90% of the time, you'll end up detaining 300 people, one of whom might be your target. A BBC article asks for an effective way to communicate this clearly.

    Innocent until proven guilty. As in, you're not a terrorist until you do it. I suppose there's some lame, "with intent to blow himself up" garbage in law, but that's irrelevant IMHO.

    --
    "but money is the God of Algiers & Mahomet their prophet." - Rich. O'Bryen June 8th 1786
  28. Two accuracy numbers required by davidwr · · Score: 0

    Screening tests should not be called "90% accurate."

    They should be specific: "This tool's declaration that you are not a terrorist is 99.99999%+ accurate, it's declaration that you are a terrorist is 0.3% accurate."

    Compare this to the "control test" that declares everyone a non-terrorist: its 99.9%+ accurate in identifying non-terrorists and 0% accurate in identifying terrorists.

    The other "control test" which identifies everyone as a terrorist is 0% accurate at identifying non-terrorist and 0.00...001% accurate in identifying a terrorist.

    What we need is a green/yellow/red system:
    Green means we are much more sure you are clean than if we did nothing AND we are at least 99.9%* sure you are clean.
    Red means we are are much more sure you are not clean than if we did nothing and we are 99.9%* sure you are a terrorist.
    Yellow means something in between, with a specific level of confidence assigned to everyone in the yellow group. Those with higher confidence of being clear would undergo less additional scrutiny than those who have a higher confidence of being a terrorist.

    *The numbers should be tweaked to suit the needs of the test. For terrorism screenings, where you don't want to outright ban anyone from flying who isn't a danger, the red level should be high. For cancer, it might need to be lower, or higher, depending on the specific patient needs. The yellow discretionary band should be very wide for most applications.

    --
    Knowledge is how to play a game, intelligence is how to win, wisdom is knowing what game to play.
    1. Re:Two accuracy numbers required by Anonymous Coward · · Score: 0

      The other "control test" which identifies everyone as a terrorist is [...] 0.00...001% accurate in identifying a terrorist.

      Fail. Thanks for trying!

    2. Re:Two accuracy numbers required by noidentity · · Score: 1

      The other "control test" which identifies everyone as a terrorist is [...] 0.00...001% accurate in identifying a terrorist.

      Fail. Thanks for trying!

      Millions of people who aren't terrorists, a few who are. A test that flags everyone as terrorists is therefore few/millions = 0.0000.....001% accurate. What is he missing?

  29. The Positive Benchmark Is: +1, Seditious by Anonymous Coward · · Score: 0

    former President-VICE Richard B. Cheney.

    I hope this helps the legal effort for prosecution at The Hague.

    Yours In Justice,
    Kilgore Trout

    1. Re:The Positive Benchmark Is: +1, Seditious by maxume · · Score: 2, Insightful

      Please stop pissing on Vonnegut.

      And yes, pretending to speak for him is pissing on him, regardless of how likely it is that he would agree.

      --
      Nerd rage is the funniest rage.
  30. Been doing it for over 50 years! by Anonymous Coward · · Score: 0

    Combined with AUC (Area under the curve plots), this is the point of ROC curves, and confusion matricies: they are ways of comparing True to False positives
    http://en.wikipedia.org/wiki/Receiver_operating_characteristic

    This is covered in any decent stats book since the 60s'...

  31. Re:Come On by Ash+Vince · · Score: 4, Insightful

    Anyone can write software to look for a turban

    This sort of racist bollocks is what has been getting people attacked in the US for wearing them, despite them being an optional part of the Muslim faith so most turban wearers are from entirely different religions which actually require them.

    http://en.wikipedia.org/wiki/Turban

    Please educate yourself before posting such drivel.

    --
    I dont read /. to RTFA, I read /. to offend people in ignorance.
  32. Its quite simple really... by Zantac69 · · Score: 1

    ...you cant! A populace that (for the most part) relies on intuition for day to day operations dismisses counter-intuitive facts with ignorance ("That does not make sense") or arrogance ("It will save more lives that it hurts, so quit twisting the numbers around!"). People all too often forsake science for "cereal box science."

    --
    1331461 is only semiprime *sigh* Alas - I am just short of 1337.
  33. Granted by Dunbal · · Score: 5, Insightful

    The given version of "terrorist" is arbitrary and thus subject to change over time - from people who hijack planes with guns and explosives, to apparently nowadays, Iceland, however I think that if you're starting with a number of 1 in 3000 you are so far from reality anyway that what you really want to do is harass innocent people.

    Let's look at ALL the hijackings from 1970 to 2000, a total of 924 hijackings. I couldn't find more recent figures quickly, but let's assume that hijackings have continued at a rate of around 30 per year (the average from 1970-2000), that would add another 30 * 9 = 270 hijackings, for a total of 1194 ok I will be generous 1200 hijackings.

    Now let's assume (and this is a BIG assumption - I am again going to be very generous) that TEN people, (the terrorists), board the plane for EACH hijacking event. So now we have 12,000 terrorists.

    Now let's just look at the passenger data for the LAST YEAR ALONE for the top 5 airlines. They carried last year 420 million people. LAST YEAR. Now assuming that since 1970 till today there have been a total of 12000 "terrorists" (a VERY generous number), when you divide 420 million by that, you would be looking at 1:35,000 people being a "potential terrorist". However do remember that I am only including passenger data for ONE SINGLE YEAR. Assuming again a 90% accuracy, you are still wrongly intimidating well over 3500 people.

    If I was to go through year by year and gouge up the billions of people that have been transported by air, the actual chances of the person being screened actually being a terrorist drops to almost zero.

    I will not argue against the value of security as a deterrent. However I think that airport security employees should be well aware that they are, more likely than not, harassing innocent people. Therefore all the excessive bullying, posturing, abuse, privacy and rights violations are completely unnecessary in this context. Airline terrorism is NOT a real threat, be it ever so dramatic on the few times when it does happen. Use technology to screen for the obvious, and lock the god damned cockpit door with a solid lock, for the not so obvious.

    --
    Seven puppies were harmed during the making of this post.
    1. Re:Granted by Dunbal · · Score: 3, Interesting

      addendum - I shouldn't have hit submit yet sorry

            Where it says "Assuming again a 90% accuracy, you are still wrongly intimidating well over 3500 people." I should add "per group of 35,000". 10% of 420 million passengers per year is 42 million people per year being harangued for no reason at all.

      --
      Seven puppies were harmed during the making of this post.
    2. Re:Granted by E++99 · · Score: 1

      42 million people per year being harangued for no reason at all."

      If by "harangued," you mean detained for further screening, 42 million people per year are harangued so that other people are not able to blow up airliners -- not for no reason at all.

      Airline terrorism is NOT a real threat, be it ever so dramatic on the few times when it does happen.

      I think you miss the point. The "drama" produced is as much the threat -- and the payoff to the terrorists -- as the actual deaths incurred. The importance of preventing a terrorist from blowing up an airliner is far greater on many fronts -- including such things as the recruitment and fundraising abilities for that terrorist group, the inspiration for new terrorist groups, and morale and economy of the victimized society -- than, say, prevent an equivalent number of accidental deaths through enforcing speed limits.

    3. Re:Granted by sjames · · Score: 1

      Put a different way, assuming all 12K of those terrorists are still out there (unlikely) and they all decide to blow up a plane this year (more unlikely), the 90% accurate test will falsely accuse 42 million people of terrorism and allow 1,200 actual terrorists on the plane.

      Put yet another way, if we assume that it only takes 1 terrorist to carry out the objective, you will detain 25 people out of every typical flight. IF the flight was targeted, you will typically allow 1 terrorist to board. That is, the 90% accurate test will always hassle innocents and always allow the terrorists to carry out their mission. That is, it accomplishes nothing at all. I know it's really nearly always allow them to carry out their mission, but we're simplifying and dumbing down. People understand that 90% of 10 people is 9 people.

      If your car is 90% reliable, you have to call a tow truck 48 times a year even if you only drive to and from work. You'd trade that lemon in in a heartbeat.

    4. Re:Granted by Dunbal · · Score: 1

      so that other people are not able to blow up airliners

            But "other people" have STILL managed to get weapons and explosives onto aircraft - even in the US. Fortunately they have almost all been undercover agents testing out how effective security is.

            As I said before - I agree with the concept of deterrence. Aircraft are high profile, high value, potentially devastating weapons. They are choice targets in an asymmetric warfare system because you only need a handful of people to do the sort of damage that was done in 2001. That being said, I have watched my 14 year old daughter detained because she was wearing a necklace with a small design that resembles a pair of handcuffs. People have been thrown in jail for making inappropriate jokes about bombs - inappropriate, but JOKES nonetheless. And if you've ever flown through Atlanta, you will know just how snotty TSA workers can be. And you thought AIRLINES treated people like cattle.

            I insist that there has to be a screening method that is as or more effective than getting mothers to pour soft drinks or baby milk into plastic bags.

      --
      Seven puppies were harmed during the making of this post.
    5. Re:Granted by AlejoHausner · · Score: 1
      > airport security employees should be well aware that they are, more likely than not, harassing innocent people.

      That is a very key point. That's why terrorism works! That's why terrorists strike at random. Let me elaborate: suppose you belong to a group of powerless people. How can you weaken the government? You don't have any military power. What can you do?

      This is the scenario you would like to see happen:

      1. 1. Kill some innocent civilians, at random.
      2. 2. The authorities must appear be doing SOMETHING. So, they impose measures that reduce people's freedom. Maybe they imprison many innocent people who are guilty by association.
      3. 3. The government's measures don't work, because they're trying to find one grain of sand in a beach. So, they are applied with even more force.
      4. 4. People grow to hate the government.
      5. 5. Two possible outcomes ensue, depending on the type of government:
        1. a. (democracy) the government is voted out of office.
        2. b. (dictatorship) the government is overthrown through revolution.

      Either way, you (the terrorist) got what you wanted. I would posit that 5a) is what has happened in the USA. Bin Laden got what he wanted: a more moderate government in Washington, one which may oppose Israel more often, and perhaps might help the downtrodden living in corrupt dictatorial countries like Egypt and Saudi Arabia.

      Bush got it all wrong. Osama did not "hate the USA". He was not simply lashing out at America. The 9/11 hijackings were a calculated move.

      Alejo

    6. Re:Granted by clone53421 · · Score: 1

      I'm not sure I agree, but you make an interesting point. (insert oblig. "and I'd like to subscribe to your newsletter" quip here)

      --
      Alexander Peter Kristopeit bought his basement from his mommy for one dollar.
  34. screening tests in medicine by puck01 · · Score: 2, Insightful

    "The problem is important in any area where a less-than-perfect screen is used to detect a rare event in a population"

    Unfortunately, there is no such thing as a perfect screening test for anything in medicine. Some are better than others, but none are perfect. This is a very difficult concept for most people, unfortunately, and for many insurance companies.

    It is not such an issue for the better screening tests such as colonoscopy but it is very difficult for things like PSA where there is a large body of evidence it can do more harm than good on average if used routinely even within the recommended ages. For a patient, you're lucky if you can have a meaningful discussion in 5-10 minutes which is an awful large chunk of an office visit that usually has >4 talking points.

    It is a problem for doctors and insurance companies because some well intended person with the insurance company will decide to measure the quality of its doctors (which I support in theory) by measuring, for instance, the percentage of age and gender appropriate patients under the care of a given physician that have their PSA checked annually. The problem is, there is absolutely no concensus in medicine that it should be checked regularly as a screening test. I'm not sure I want mine tested when the time comes around unless my family history changes between now and then. So to measure a physician by this marker or other screening tests is fraught with problems, since many patients might opt out for very good reasons. Also, I'm not going to recommend any test because an insurance company wants me to, only if it is right for any given patient.

    Bottom line is there are no perfect tests and testing is not always the right thing to do. Most people do not understand that because it is a hard concept to grasp.

    1. Re:screening tests in medicine by Anonymous Coward · · Score: 0

      At least in America, the bigger problem with talking about screening with your doctor is that he has a massive incentive to encourage you to get every possible screening test, or at the very least not talk you out of getting any test you ask for. The reason: litigation. Suppose you come into my office and ask about PSA screening for prostate cancer. I can do one of two things: engage in a 5-30 minute discussion about the risks and benefits of this test and the consequences of a positive screen or I can just order the test for you and follow up the results.

      If you have cancer and I didn't order the test, I potentially face a massive lawsuit. It won't matter if I line up dozens of experts who will testify that there was no evidence based reason I should have ordered the test for you, the plaintiff's lawyer will find one urologist who insists everyone and their uncle needs one and then he'll hold up a picture of a dead patient or wheel the patient in in a wheel chair and I'm sunk.

      If you had prostate cancer and I ordered the screen, it is great that you got treatment, but the reality is that if you do population wide screening (at least in western countries) only about 1 in 50 men who goes for treatment after screening poisitive for prostate cancer by PSA will actually improve his lifespan as a consequence of treatment (most prostate cancer detected by the PSA is so inconsequential it will not be the ultimate cause of death).

      If, on the other hand, you don't have cancer and I order the test, what's the worst that happens? You get a false positive screen and a full cancer workup. Maybe you're scared for a while, maybe there are some minor complications from the biopsy, but more likely than not, you and your family will thank me 'for being careful'.

      In America, where the consumer is king, patients don't care about false positives.

  35. 0 out of 300 by Anonymous Coward · · Score: 0

    """To find one terrorist in 3000 people, using a screening that works 90% of the time, you'll end up detaining 300 people, one of whom might be your target."""
    Does that mean that the terrorist has a 1 in 10 chance of not getting flagged? If it works 90% of the time that means it doesn't work 10% of the time. And we all know that, 'enter some dudes name which I very coinsidently forgot right when I needed it!!!'s law ,dictates that 10% happening when the terrorrist passes.

    That means you detain 300 people, and none of them is a terrorrist. Added to the fact that Americans are paranoid as shit, and there's not even a terrorist in 3 million people, you just found a way to create many jobs in 'Homeland Security'. And ofcourse a new way to piss many people off.

    At least I know that my taxeuros are being used to fix space toilets.

    P.S.: the guys name is Murphy, now I remember.

  36. Re:Come On by Verdatum · · Score: 1

    I'm so glad you posted this. First I was neutral about turbans. Then I read that guy's post and I immediately concluded that turbans are worn only by terrorists. Luckily, I then read your post, and was thankfully corrected. Good save.

  37. samples by hitnrunrambler · · Score: 1

    Maybe a new slogan:
    Precede with an explanatory: "Accuracy ratings for screenings are not based on how many of your target you find, but on how many false positives you avoid."
    then hit em with: "This screen is 90% accurate! 90% of the people who pass through here will not even be considered for waterboarding and sexual humiliation!"

    or maybe an illustration:
    "You live in a town of 3000 houses, 911 receives a call reporting a fire at your house number. There are 30 houses (1% of the total) with the same number. The fire company breaks down the doors and smashes the windows of all 30 in random order. All valuables are destroyed by water damage, and just by coincidence your house burns to the ground.Their screening method was 99% accurate, and in fact their method of finding your home was 100% accurate."

    or a simple ascii of 2999 zeroes with a 1 hidden among them..... I actually made this and the 90% and 99% and 99.9% versions; but slashdot won't let me post that many repeating characters.

    1. Re:samples by hitnrunrambler · · Score: 1

      Thanks Slashdot, your imposed limitation on my ascii art prompted me to make a Gif that I'm very happy with.

      I believe this link should work.
      http://picasaweb.google.com/H.R.Rambler/MyCreations#slideshow/5361370357908348434 [google.com]

      This is the alternate, but you have to click on the magnifying glass to get it to start playing.
      http://picasaweb.google.com/lh/photo/wi54UGVjyvlFubM5SuJ7Eg?feat=directlink [google.com]

  38. Infographics to the rescue by foniksonik · · Score: 2, Informative

    Draw a picture. People's visual intelligence is much higher than their literary/verbal intelligence. Descriptions in words are difficult to understand when the meaning of the words being used is not clear, uses domain specific jargon (such as 90% accuracy in relation to statistics) and especially when it requires that the recipient of knowledge perform a mental calculation or solve a mental equation.

    An effective picture would be one of a thousand people (stick figures or silhouettes will do) with 10 positioned in front. A caption over the 900 in the big group would say "Tested Negative (These people are NOT Terrorists), the caption under the 10 in front would say "Tested Positive (These people may or may not be Terrorists - We don't know)".

    Then ask people how they would feel if they were in the group of 10 and were going to be shipped off to a military holding cell to await further investigations.

    --
    A fool throws a stone into a well and a thousand sages can not remove it.
    1. Re:Infographics to the rescue by foniksonik · · Score: 1

      BTW I didn't do any math... I'm bad at math, so someone who knows the actual numbers should provide them to someone who can make an infographic ;-p

      --
      A fool throws a stone into a well and a thousand sages can not remove it.
    2. Re:Infographics to the rescue by hitnrunrambler · · Score: 1

      I created an animated infographic (gif) that does the trick, it's a bit more elaborate than what you had in mind... but I like it.

      This is completely work safe, unless you happen to work for fascists who may be offended by their own similarity to the mentality portrayed.

      I believe this link should work.
      http://picasaweb.google.com/H.R.Rambler/MyCreations#slideshow/5361370357908348434

      This is the alternate, but you have to click on the magnifying glass to get it to start playing.
      http://picasaweb.google.com/lh/photo/wi54UGVjyvlFubM5SuJ7Eg?feat=directlink

  39. Visualizing a false positive is easy... by clone53421 · · Score: 1

    He's dark-skinned and his name is Mohammad.

    (Wait, are we talking about airport screening or HIV testing?)

    --
    Alexander Peter Kristopeit bought his basement from his mommy for one dollar.
  40. Broad Screening... by CopaceticOpus · · Score: 2, Funny

    I think they prefer the term "mammogram".

    1. Re:Broad Screening... by redbeardcanada · · Score: 1

      When I am screening broads I am really hoping to avoid false positives where she is really a dude...

  41. Second opinions can be costly by davidwr · · Score: 1

    Say there is a cancer that affects 1 in a million people. Say its typical symptoms could mean cancer or one of several other diseases. Say the currently available test is highly accurate, with few false positives and negatives, but it is highly invasive, highly costly, damages healthy tissue, and has a high risk of complications. Say there is another cause of the symptoms which is non-progressive and non-fatal but which there is no test for. The standard treatment is to test for everything you can test for, then if all other causes come up clear, watch to see if things get worse, and if it gets worse, do the cancer test. Statistically, about 25% of the people with these symptoms have the cancer. If you start treatment now, the 5-year survival rate is 90%, if treatment is delayed until symptoms get worse, it's 80%.

    Now say someone comes along with a cheap, highly accurate blood test that can say with a 50/50 chance that you carry the gene for this type of cancer. Let's say those without the gene almost never get this cancer, and those that do have a 10% lifetime risk. Hurray, it's a no-brainer. You take the test, if you do not have the gene, you breath a sigh of relief. If you do, you decide if you want to do the invasive test, knowing there's a significant chance it will be positive, but you can begin treatment now with confidence you are doing the right thing.

    But what if the new test is not cheap, easy, and highly reliable? What then? That is the crux of this issue.

    --
    Knowledge is how to play a game, intelligence is how to win, wisdom is knowing what game to play.
  42. Nice article. -ish by Fuzzums · · Score: 4, Informative

    I think they totally forget that there is ALSO a 10% possibility that you _don't_ detect the terrorist...

    Watch this TED : http://www.ted.com/talks/peter_donnelly_shows_how_stats_fool_juries.html

    --
    Privacy is terrorism.
    1. Re:Nice article. -ish by Fuzzums · · Score: 1

      Be sure to watch http://www.ted.com/talks/arthur_benjamin_does_mathemagic.html too.
      It's rather amazing :)

      --
      Privacy is terrorism.
    2. Re:Nice article. -ish by misexistentialist · · Score: 1

      And minuscule odds of success for a suicidal terrorist are worth it, while minuscule odds of being condemned to security hell for a innocent person are probably not. It's better to stay home. When the only people traveling or walking the streets are terrorists, the false positive rate decreases dramatically!...except the terrorists won't be traveling either, so the government will need to screen people in their homes.

    3. Re:Nice article. -ish by sootman · · Score: 1

      Cory Doctorw explains it pretty well.

      If you ever decide to do something as stupid as build an automatic terrorism detector, here's a math lesson you need to learn first. It's called "the paradox of the false positive," and it's a doozy.

      Say you have a new disease, called Super-AIDS. Only one in a million people gets Super-AIDS. You develop a test for Super-AIDS that's 99 percent accurate. I mean, 99 percent of the time, it gives the correct result -- true if the subject is infected, and false if the subject is healthy. You give the test to a million people.

      One in a million people have Super-AIDS. One in a hundred people that you test will generate a "false positive" -- the test will say he has Super-AIDS even though he doesn't. That's what "99 percent accurate" means: one percent wrong.

      What's one percent of one million?

      1,000,000/100 = 10,000

      One in a million people has Super-AIDS. If you test a million random people, you'll probably only find one case of real Super-AIDS. But your test won't identify one person as having Super-AIDS. It will identify 10,000 people as having it.

      Your 99 percent accurate test will perform with 99.99 percent inaccuracy.

      That's the paradox of the false positive. When you try to find something really rare, your test's accuracy has to match the rarity of the thing you're looking for. If you're trying to point at a single pixel on your screen, a sharp pencil is a good pointer: the pencil-tip is a lot smaller (more accurate) than the pixels. But a pencil-tip is no good at pointing at a single atom in your screen. For that, you need a pointer -- a test -- that's one atom wide or less at the tip.

      This is the paradox of the false positive, and here's how it applies to terrorism:

      Terrorists are really rare. In a city of twenty million like New York, there might be one or two terrorists. Maybe ten of them at the outside. 10/20,000,000 = 0.00005 percent. One twenty-thousandth of a percent.

      That's pretty rare all right. Now, say you've got some software that can sift through all the bank-records, or toll-pass records, or public transit records, or phone-call records in the city and catch terrorists 99 percent of the time.

      In a pool of twenty million people, a 99 percent accurate test will identify two hundred thousand people as being terrorists. But only ten of them are terrorists. To catch ten bad guys, you have to haul in and investigate two hundred thousand innocent people.

      --
      Dear Slashdot: next time you want to mess with the site, add a rich-text editor for comments.
    4. Re:Nice article. -ish by Fuzzums · · Score: 1

      Terrorism is definitely frightening. No doubt about that. But more people die in car accidents, yet we're still using cars every day...

      --
      Privacy is terrorism.
  43. Knowing Their Ass from Their Al Qaeda by Doc+Ruby · · Score: 1

    How can this counter-intuitive fact be communicated effectively to people unschooled in statistics?

    Just anal-probe every American at football games and airports, then tell a random 9.99% of them they've got AIDS from the procedure (though they don't).

    We'll develop an intuitive sense of empathy for falsely accused Muslims, other turban-wearers and lots of other people "with nothing to hide".

    --

    --
    make install -not war

  44. Hand Waving, Pointing, Shouting, Shoving by mindbrane · · Score: 1

    Where do you start? What do you start with? We're foveated animals with brains that seem to have much to do with 'where' and 'what', or, 'object' and 'place'. That's a ridiculously broad epistemology to try whittling down to a point and click understanding of statistics. Do people not understand statistics, or, do they not understand sampling and false positives; or, do they just not understand being detained, strip searched and subjected to a body cavity search, no matter the underlying science. Statistics is fairly intuitive and, as such, is amenable to the fundamental maths' concept of inspection. Inspection as I understand it is alot like Yogi Berra saying you can observe alot just by watching. If you buy fresh, bagged vegetables you pretty much understand sampling the visible attributes and inferring the nonvisible ones, and, anyone whose done so has gotten home and found at least one bad apple (fruit, vegetable, whatever). Buy the same brand of bagged vegetables and discover what you consider to be a disproportionate number of unseen, unwanted attributes and you'll switch brands. The hidden problem maybe that people think they're being flagged by a machine, by an AI, and, maybe they are, but they'll most likely be apprehended by a person and it may be that the point and method of apprehension is where a quick explanation needs to be inserted, like being Mirandized, only explaining "the computer" has selected them based upon yada yada... Maths, to most people is anathema (anathemathtic). I recently undertook a review of maths via, Jason Gibson, NASA rocket scientist, and his MathTutorDVD stuff plus a bunch of other stuff. How do you explain maths is mostly straight forward to people who have what amounts to a mental block against abstracted symbol manipulation? The human limbic system incorporates our reward system and that system is pretty wet stuff, not too interested in abstract logic. Recently intelligence has been liked to networked neurons in the association pathways. This may indicate that most healthy, normal people intuitively and rightly avoid intelligent explanations and intelligent people in favour of wet, warm, limbic, puppy love. I hold we're formulating a new mythology wherein the old Dionysian way of ecstasy most famously iconographed by the Dionysian sacred, disease of epilepsy is being replaced by the new sacred of Asperger's Syndrome exhibited by dry, maths types. It's just a matter of a few thousands of years of evolution.

    --
    ideopath @ play
  45. Re:Come On by bickerdyke · · Score: 1

    Lol.

    Who said something about muslims?

    You've been trapped by the same fallacy as that other guy. You're scolding him for using the turban wearing terrorist stereotype, but using the equally narrow minded muslim terrorist stereotype.

    Plus, completle ignoring that it was an obvious joke about (drumroll) stereotypes!

    --
    bickerdyke
  46. subject by Legion303 · · Score: 1

    "How can this counter-intuitive fact be communicated effectively to people unschooled in statistics?"

    With a baseball bat?

  47. People will pay out of pocket by davidwr · · Score: 1

    If the cancer screening is less than a couple month's pay and the illness runs in the family, many people will pay out of pocket.

    If it's less than a day's pay a lot more people will pay out of pocket even if they are at nearly zero risk to start with.

    --
    Knowledge is how to play a game, intelligence is how to win, wisdom is knowing what game to play.
  48. One possible solution by A+beautiful+mind · · Score: 2, Interesting

    Switch around what the percentage means: instead of 90% meaning there is 90% chance to successfully ascertain whatever you're screening for, make 90% stand for the analogy of LD50 (Lethal dose for 50%+ of the population). So the screening method would be SE50 (screening effective 50%) if the number of positive cases correctly detected are 50%+ of all positive cases detected.

    --
    It takes a man to suffer ignorance and smile
    Be yourself no matter what they say
  49. Re:Come On by Doc+Ruby · · Score: 1

    Yet you failed to learn from that post that making insulting jokes about how anyone wearing a turban in the US can be beaten senseless "because they're a Muslim terrorist" is unacceptable in public (and probably in private, depending on the quality of the company you keep).

    --

    --
    make install -not war

  50. DNA and fingerprints by davidwr · · Score: 1

    Barring twins and clones, when done properly and with a very good sample, a complete DNA test has a lot higher than 99.99% correct-positive rate and except in cases where a person has multiple DNAs due to an organ or tissue transplant or congenital factors, a 100% correct-negative rate.

    When done improperly or with a corrupted or planted sample, all bets are off.

    Unfortunately, the DNA tests done in court are far from complete. They are still better than 99.99% when done under ideal circumstances, but are less accurate than a complete test.

    Fingerprints done under ideal circumstances are quite good at pinpointing a suspect, especially if the list of people who had access to the crime scene is in the thousands or lower a "planted" fingerprint is ruled out. If your fingerprint is found in the blood spatter of last night's murder, you better be able to explain why you were there after the blood was.

    --
    Knowledge is how to play a game, intelligence is how to win, wisdom is knowing what game to play.
    1. Re:DNA and fingerprints by clone53421 · · Score: 2, Funny

      Barring twins and clones

      Hey, I resent that!

      --
      Alexander Peter Kristopeit bought his basement from his mommy for one dollar.
    2. Re:DNA and fingerprints by JCSoRocks · · Score: 1

      Pipe down clone! You're unnatural!

      --
      You are using English. Please learn the difference between loose and lose; they're, there, and their; your and you're.
    3. Re:DNA and fingerprints by koxkoxkox · · Score: 1

      Were the tests 100% accurate, the blind faith of the justice concerning DNA is still rather disturbing. I heard a trial where a clever rapist first collected some semen of another guy in a used condom, then let it at the crime scene. The guy was identified, and lucky for him he had a very good explanation of where he was this day, because otherwise I would not have heard this story and he would still be in jail ... Hearing a police officer describing investigation, it is almost as if they stop once they have some DNA of the culprit.

    4. Re:DNA and fingerprints by Anonymous Coward · · Score: 0

      forensic witness:
      The DNA test is 99.99% accurate.

      defense attorney:
      So, you're saying that, in addition to the defendant, there could easily be 200 or 300 people in the city at the time that would match this DNA profile?

    5. Re:DNA and fingerprints by davidwr · · Score: 1

      forensic witness:
      The DNA test is 99.99% accurate.

      defense attorney:
      So, you're saying that, in addition to the defendant, there could easily be 200 or 300 people in the city at the time that would match this DNA profile?

      Forensic witness: Yes.

      Prosecutor, in cross, "Prior evidence has shown that only 20 people had access to the crime scene at the time of the crime, and that the DNA evidence was placed at the crime scene during the crime, not before or after. Excluding the 3 who have already known to be not a DNA match and the defendant, this leaves 16. What are the odds that any of these 16 are a match for this DNA?"

      Forensic witness: Less than 1 in 100.

      Prosecutor, to judge, in sidebar: We have identified 11 of those 16 people, 5 we only know from surveillance photographs. We do not object to any defense motion to compel DNA testing of these individuals. Unless the defense is willing to stipulate that they are not the guilty parties, we recommend the court order its own motion compelling DNA tests.

      Later, after DNA test come back exonerating the 11:

      Prosector, to forensic witness, who has been recalled to the stand: We now know that the crime was committed by one of 6 people. What are the odds that the DNA matches one of the 5 unidentified people on the survellance video?
      Forensic witness: Less than 1 in 1000.

      Prosecutor, in closing arguments:

      Ladies and gentlemen of the jury, we have shown that the defendant had the means, motive, and opportunity to commit the crime. Furthermore, a person which could be him appears on the surveillance video. We can't be sure it is his, but it is possible. We do know this: DNA evidence was left at the crime scene. It was collected, preserved, and tested in a professional manner as not to taint the results. The DNA matched the defendant, and the odds of it matching any of the other people who were at the crime scene is less than 1 in 1,000. There is also a noticeable lack of any claim that the DNA was planted at the crime scene by a third party or the police. You are all intelligent people. You know that we will never know with absolute certainty who committed this crime. However, our Founding Fathers wisely did not demand absolute certainty in courts of law. If they did, very few crimes could be prosecuted and people like the defendant could routinely commit serious crimes and get away with it. Instead, they demanded the very high but slightly lower bar of reasonable doubt. Ladies and gentlemen of the jury, I submit to you that the state has met is burden of proof that, beyond a REASONABLE doubt, the crime was committed by the defendant. It is your sworn duty to weigh the evidence before you. If you agree with me that the defendant is guilty beyond a reasonable doubt it is your sworn duty to vote for a conviction.

      --
      Knowledge is how to play a game, intelligence is how to win, wisdom is knowing what game to play.
    6. Re:DNA and fingerprints by Anonymous Coward · · Score: 0

      collected some semen of another guy in a used condom

      And there you have your problem. You won't find ME being so careless with MY DNA!

  51. Think you understand these things? Try this... by ColonelPanic · · Score: 1

    A family with two children is chosen at random from a large population.

    If I tell you only that they have at least one daughter, what is the probability that both children are girls?

    Most people can get that one (it's 1/3), but fail miserably on this question:

    If I tell you only that they have at least one child named Mary, what is the probability that both children are girls?

    Assume the obvious: the boy/girl ratio is 50-50 and only girls are named Mary.

    Most people insist that this is the same question with the same answer, but no, it's not, and the answer is actually 50%.

    If you don't get this puzzle, you don't understand conditional probability.

    --
    "Skill shows through where genius wears thin." -Wittgenstein || Religion: uniting aviation and architecture.
  52. Re:Come On by A+Pancake · · Score: 4, Insightful

    You'd have a really good point if there weren't actually bigoted assholes and/or ignorant people in the world who agree with the great-grand-parent. Earlier in my life I may have been one of them.

    I remember painting Muslims with a very broad and unfair brush. People would tell me that all Muslims aren't bad and most want the same thing I do, peace and prosperity. Why don't they speak out against the bigoted extremist representatives then? I would ask.

    I didn't have the slightest understanding of the culture and environment those types of ideas breed in and probably still don't. However, I can come out of my own bubble enough to ask myself the question - What motivation would I have to speak out against wrongs being done against a culture who shows repeated disrespect and ignorance for my own?

    I'm not suggesting we adopt sharia law and that all North American women start wearing burqa as a sign of respect. There is a very thick line between embracing and adopting a culture and respecting it.

  53. Let me get this straight by Anonymous Coward · · Score: 0

    So China's population is 1,331,950,000 according to Wikipedia today.
    Also from Wikipedia, the world's population is estimated to be 6,773,000,000.
    This means that about 19%, or nearly one in five people in the world, is Chinese.
    There are six people in my family, so clearly at least one of us is Chinese.

  54. Re:Come On by jonbryce · · Score: 4, Informative

    Turbans are worn by Sikhs. This is a completely different religion to Islam which is alleged to harbour these terrorists.

  55. How it fits in with an overall decision strategy? by ponos · · Score: 1

    Well, I wouldn't expect most people to intuitively grasp Bayesian statistics without some formal introduction to the subject. Nevertheless, it must be remembered that as part of a decision algorithm for detecting terrorists/cancer/whatever, a not-so-accurate test can be useful as a first step. Specifically, if said test is minimally bothersome, cheap and permits us to apply a more costly and accurate strategy to a limited number of individuals at a further stage. For example, a metal detector stops about 30-50% of passengers, very few of which are terrorists. Subsequently, some will get strip searched, some will be detained and some will enjoy a free anal probe. Although failing a metal detector is not catastrophic, failing all subsequent (progressively "invasive") examinations is highly suspect (accumulated evidence).

    So, a 90% specific (false positive) test is not worthless if it is sufficiently sensitive: it protects 90% of the population from further tests and saves money.

    P.

  56. "Unschooled" in security by Scratch-O-Matic · · Score: 1

    It's good to inform people who don't understand statistics. On the flipside, here are two points for people unfamiliar with security:

    1. A broad screening for "terrorists" is not made with the expectation that every person flagged is a terrorist. Rather, it identifies behaviors that make a person worth giving a second look. If properly conducted, the flagged person is not treated or considered a threat during the second or even the third look. The 300 people you mentioned would almost certainly be treated politely and sent on their way (I myself have received a second or third look several times. No problem.)

    2. Perhaps the most important purpose of a broad security screening is to discourage criminals from using that avenue in the first place. If I have several dozen potential means of attack, for example, the ones that involve getting a weapon onto an airplane are going to be near the bottom of the list. Not because I can't do it, but because, why bother?

    --


    Evil is the money of root.
  57. Re:Come On by jimbolauski · · Score: 3, Insightful

    This sort of racist bollocks is what has been getting people attacked in the US for wearing them

    What a load of crap, back in 2006 NBC dateline had a bunch of muslims go to a Nascar race and see if they were harassed, guess what they were NOT bothered at all. This sort of idiotic bollocks is what perpetuates the myth that the US is full of racists.

    --
    Knowledge = Power
    P= W/t
    t=Money
    Money = Work/Knowledge so the less you know the more you make
  58. Re:Come On by Thanshin · · Score: 1

    I'm not suggesting we adopt sharia law and that all North American women start wearing burqa as a sign of respect

    Of course not. They should wear turbans.

  59. Re:Come On by networkBoy · · Score: 0, Flamebait

    that's because it's a well known fact* that ter'rists hate Nascar. It's also a well known fact** that ter'rists won't pay to get in to blow someone up. thus we can deduce with 100%*** accuracy that these guys could only be ter'rists in the breif period from when they left their car in the parking lot and walked to the gate. Furthermore, that they parked their car means they likely were not ter'rists because all ter'rists**** blow their cars up.
    -nB

    * And I'll put it on the internet if you ask me to quote it, and since it's on the net it must be true+
    ** again, if you call me out on this I'll just post it somewhere to quote it.
    *** selective sample set (lies, damned lies, and statistics, right?)
    **** just seemed good

    + I saw it on the internet somewhere, seriously.
    -nB

    --
    whois gawk date unzip strip find touch finger mount join nice man top fsck grep eject more yes exit umount sleep dump
  60. frame it as haystack reduction by sorak · · Score: 1

    One way to do it is to frame it not as accuracy, but simply as candidate reduction. It reduces the size of the haystack by 90%. We're still looking for a needle in a haystack, but now the haystack is one tenth the size it originally was.

  61. Re:Come On by somersault · · Score: 2, Funny

    guess what they were NOT bothered at all

    Yep, no hassle at all - in fact most people didn't even get closer than the blast radius from a decent sized stick of dynamite!

    --
    which is totally what she said
  62. Re:Come On by siloko · · Score: 0, Troll

    Why don't they speak out against the bigoted extremist representatives then?

    The same reason huge swathes of the U.S. population didn't speak out against the bigotted extremist representing them between 2000 and 2008.

  63. Re:Come On by Anonymous Coward · · Score: 0

    They're dressing like Sikhs to throw us off the scent! But us americans are smarter than that, we see the turbans and know!

    Fooled me can't get fooled again!

  64. "Shit Happens" by Maxo-Texas · · Score: 1

    There you go... no charge.

    --
    She was like chocolate when she drank... semi-sweet at first and then increasingly bitter.
  65. Re:Come On by xouumalperxe · · Score: 1

    To find one terrorist in 3000 people, using a screen that works 90% of the time, you'll end up detaining 300 people, one of whom might be your target.

    Anyone can write software to look for a turban

    Let me see if I got this straight. If I write a piece of code that detects turbans, I'll pick 300 out of every 3000 people, of which 1 might be a terrorist? I'm confused now.

  66. Sample size is too small by petes_PoV · · Score: 1
    Rather than one terrorist in 3,000 how about one in a million - or one in a billion fliers?

    The basic problem is not with the screening process, but simply knowing how many "actuals" there are out there to be caught - or deterred. To put it another way: how do you know when to stop? All these security measures assume that there are still terrorists with malevolent intentions trying to get on airplanes. As a concerned passenger, I am all for stopping them provided they still exist. However if I am being put through the whole circus of intrusive and inconvenient security restrictions when the threat disappeared long ago, I would like them to stop. Merely having some official who's job, budget and political power rests on prolonging and talking-up the level of threat, saying "Trust me, I'm in the government" is not sufficient and not credible. We need to know actual facts: who was caught, what were they trying to do, what would have actually happened if they had succeeded.

    I have a sneaking suspicion that even the people in security don't know the answer to this. While they may read reports to say "X number of people were detained last month" and assume from that, that the threat is real or increasing or that they're "winning", there are no hard, auditable facts available to back up these hypotheses. If that is the case, then the measures they have put in place are probably not even the best response to the level of threat. It seems that they are basing the level of security needed (which is also variable from place to place: flights entering a country are subject to vastly different security checks from flights leaving a country) on guesswork and the probably incorrect assumption that it's working since there haven't been any more September-11 type incidents. This attitude just plays into the hands of the baddies, as they continue to strike fear into people with little or no effort on their part - while still being able to come up with new and novel strategies as the established security measures are still fighting last year's war.

    --
    politicians are like babies' nappies: they should both be changed regularly and for the same reasons
  67. Re:Come On by Anonymous Coward · · Score: 0

    Of course we should not beat up people wearing turbans of all colors. Remember muslims only wear white or black turbans. If they are of any other color, they're not muslims, probably sikhs.

  68. Re:Come On by Anonymous Coward · · Score: 0

    What a load of crap, back in 2006 NBC dateline had a bunch of muslims go to a Nascar race and see if they were harassed, guess what they were NOT bothered at all.

    So you think the following disproves the existence or danger of grizzly bears?

    What a load of crap, back in 2006 I took my kids on a camping trip to see if they would be eaten by grizzly bears, guess what they were NOT bothered at all.

    To quote Bugs Bunny, "You, sir, are a maroon!"

  69. Stupid innumerate BBC article by nbauman · · Score: 1
    This BBC article fails to distinguish between sensitivity and specificity.

    There's a difference between a test that identifies 99% of all terrorists, and a test that identifies people as terrorists, 99% of whom are really terrorists.

    Perhaps a good way to teach statistics would be to start by teaching it to BBC reporters.

    It's a non-problem. There are math teachers who know how to explain this very clearly. And there's a lot of research on how to communicate the results of medical tests to patients.

  70. Bayesian thinking by chamo · · Score: 1

    There's a brilliant article that discusses this problem here: http://yudkowsky.net/rational/bayes. About a quarter of the way in there's a look at a few different ways of expressing the quantities. It seems frequencies are good (3 in every 1000 innocent people will be IDed as a terroist or 299 in every 300 people identified as a terrorist are innocent). People intuitively focus on the expected outcome - postive test result == terrorist and negative == not a terrorist. Maybe the way to make it clear is to tell them the non-intuitive statistics (299 in 300 that appear guilty are innocent while 1 in 30,000 that appear innocent are guilty). The issue is that if you tell someone "Q given P" (positive-result given is-terrorist) they always fall into the trap of thinking "P given Q" (is-terrorist given positive-result). Saying the test is 90% accurate is saying "Q given P 90% of the time". No one understands prior probability yet figures like this always ignore it.

  71. Bayes Theorum by BadBlood · · Score: 1

    http://en.wikipedia.org/wiki/Bayes_theorum

    See the section on drug testing.

    --


    Praying for the end of your wide-awake nightmare.
  72. Another example... climate events by herrlich_98 · · Score: 1

    How about evacuting a city several times because of a hurricane but it misses?

    How about spending a lot to avoid global climate change that never happens or does not turn out to be as bad as predicted by our current understanding?

    The only way I can think to explain this to the "general public" is to make the analogy with insurance. A cost you incur but probably never get any benefit from.

  73. I think you just did by pturley · · Score: 1

    I thought the text you offered just then was pretty good.

  74. Re:Come On by somersault · · Score: 2, Informative

    The 9/11 and 7/7 attacks etc were instigated by self proclaimed Muslims. There's no "alleged" about it, it's just a fact. Note that I don't believe that all Muslims are terrorists, or that all terrorists are Muslim, that's just stupid. But the most widely publicised and recent terrorist attacks have been strongly linked with Islam. That doesn't mean that Islam "harbours" terrorists, a lot of Muslims don't agree with these violent attacks. But it's pretty safe to say that the majority of attempted terrorist attacks within the next few years are likely to be instigated by Muslim fanatic groups who are pissed off about the whole invasion situation in Aghanistan/Iraq/Iran. The 7/7 attacks here in the UK were "carried out by 4 British Muslim men who were motivated by Britain's involvement in the Iraq War" according to Wikipedia.

    --
    which is totally what she said
  75. Re:Simple - the power of celebrity by petes_PoV · · Score: 2, Insightful
    Too hard, you can't even teach most of ''em basic arithmetic - let alone something abstract.

    The simplest way to get a message across to the "masses" is simply to have a celebrity deliver it. No explanations, no demonstrations. Simply a script that says: "you know me, I'm that nice, trustworthy person from <name of popular programme> so you know when I speak, I'm telling the truth ..."

    People tend to trust individuals they know, they "know" the characters on TV - even though they are actors and probably nothing like that in real-life. It doesn't matter, just think about all the causes that get a celeb on board and then effect political change, even though it's a tiny (but vocal) minority of the population involved and therefore about as non-democratic as it's possible to get.

    --
    politicians are like babies' nappies: they should both be changed regularly and for the same reasons
  76. What are the odds by petes_PoV · · Score: 1
    Just put your own terrorist on the plane, first.

    I mean there are so few, incalculably few, terrorists that the chances of getting two, unconnected ones on the same flight are vanishingly small. The chances are probably less than for the whole plane to be abducted by aliens. So if you supply one, the odds of a "real" one drop to nothing, in practical terms. Problem solved!

    p.s. for the comically inept, this is not meant as a serious suggestion. I suggest you start breathing again before you turn blue, or purple, or republican.

    --
    politicians are like babies' nappies: they should both be changed regularly and for the same reasons
  77. Decision theory by starfishsystems · · Score: 1

    There is a branch of statistics called Decision Theory which uses expected values which have a subjective weight. Thus the value of a dollar, say, may not be the same at two points in the equation.

    --
    Parity: What to do when the weekend comes.
  78. Spam filtering. by DdJ · · Score: 1

    Compare the test result accuracy to the accuracy of typical spam filters.

    People get spam, and understand the problem with false positives and false negatives.

    If you say "if your spam filter was as accurate as this test, you'd have an XX% chance to lose mail from your bank or your spouse, and a YY% chance to get Z pieces of spam anyway", I think that would make the numbers considerably more meaningful for a lot more people.

  79. The answer by YourExperiment · · Score: 1

    How can this counter-intuitive fact be communicated effectively to people unschooled in statistics?

    Screening for HIV with 99.9% accuracy? Switch it around. Think also about screening the millions of non-HIV people and being wrong about one person in every 1,000.

  80. Re:Think you understand these things? Try this... by Scratch-O-Matic · · Score: 1

    I wonder if it's possible you mis-stated the problem? If you tell me they have two children and that at least one is a daughter, the tested condition ("both children are girls") comes down to the other child also being a girl, with a probability of 50%. If the other child is a boy, then the condition is not true, and if the other child is a girl, the condition is true. The condition will be true in 50% of the cases. Am I missing something?

    Put another way, "In all families with exactly two children, both children will be girls in 50% of families who have at least one girl."

    I'm assuming, as you stated, that any given child has an equal chance of being a boy or a girl.

    --


    Evil is the money of root.
  81. But they don't know the success rate by petes_PoV · · Score: 1
    While they might claim a 90% rate of success, there are so few terrorists - real ones, not people accused of it, that they'd have to scan everyone for years to get a statistically accurate sample size of "real" terrorists who they've actually caught. As it is, the number of terrorists who would try to use the tactic (of blowing up a plane in flight) is not constant. Once they've done it once, and succeeded in their goal of instilling fear and uncertainty, there's nothing to be gained from continuing the same sort of attack. They just move on to a different strategy: one that the security people haven't considered yet.

    So even if the security people who make these bald, and unsupportable claims *did* have a large enough number of caught terrorists in, say, 2002 - the chances are that the number has dropped significantly now. Of course, once you start to reduce the level of security, the number of "incidents" will probably rise - although as said, not in the way that the security people are prepared for. All this tells yo is that the statistics are meaningless - however you view them. All they can do apply a level of security / restrictions that people, en-masse are willing to tolerate and hope that's enough.

    --
    politicians are like babies' nappies: they should both be changed regularly and for the same reasons
  82. Start with the basics by RationalRoot · · Score: 2, Funny

    A nurse recently told me a test was never wrong, it was 99% accurate. I asked how many people she had used the test on this week, she said about 50 a day. Without any knowledge of the population % of positives, and making the gross assumption that it was 99% false positive and 99% false negative, that would lead one to believe that she seeing incorrect results about 2-3 times a week. This had simply never occurred to her. Never mind the population statistic, nor the possible difference between false positive and false negative, but she understood 99% accurate to be - "never wrong". It never even occurred to her that if she was testing hundreds of people a week that some results would be just plain wrong. I didn't ever bother trying to explain the effect of population statistics.

    --
    http://davesboat.blogspot.com/
    1. Re:Start with the basics by clone53421 · · Score: 1

      This is moderated funny for some reason, but it's so true...

      --
      Alexander Peter Kristopeit bought his basement from his mommy for one dollar.
  83. Re:Come On by Anonymous Coward · · Score: 0

    *WHOOSH!!!*

  84. Bruce Schneier writes about false positives by Anonymous Coward · · Score: 0
  85. Re:Think you understand these things? Try this... by mkanoap · · Score: 1

    Please explain this assertion. I'm having problems getting past "since only girls are named Mary, 'at least one child named Mary'=='at least one daughter'". I understand that the converse is not true.

  86. Re:Come On by radtea · · Score: 3, Insightful

    Yet you failed to learn from that post that making insulting jokes about how anyone wearing a turban in the US can be beaten senseless "because they're a Muslim terrorist" is unacceptable in public

    Unacceptable to whom? And why?

    As I read the joke, it is making fun of ignorant American rednecks. While I guess some people might find painting such people with such a broad brush insulting or offensive, I don't see it, myself.

    Apparently you a) have a different interpretation of the joke and b) feel that your interpretation justifies declaring the joke "unacceptable in public." I don't get your logic, and I certainly don't appreciate your arbitrary and unjustified declaration regarding what is or is not acceptable behaviour "in public".

    This is particularly true since /. has a significant world-wide readership--if you clowns can't control your bigots that's your problem, not justification for declaring, in typically American imperialist fashion, what is and is not acceptable here in this international, albeit US-dominated, forum.

    Ok, the problem with this comment is that it is now a) exactly what I feel and b) -1 flamebait. Oh well.

    --
    Blasphemy is a human right. Blasphemophobia kills.
  87. Should you be tolerant to the KKK too ? by Anonymous Coward · · Score: 1, Insightful

    After all, "not all KKK members are terrorists" is certainly a truth.

    Please tell me, should one be tolerant against people who have an intolerant ideology, as indicated by said ideology prohibiting inter-group relations and promoting attacks against outsiders, like the KKK does ... or islam does ?

    Anyone who believes

    O you who believe, do not take Jews and Christians as friends; these are friends of one another alone. Those among you who ally themselves with these belong with them. GOD does not guide the transgressors.

    (quran 5:51) is not a tolerant individual. Any muslim who treats any non-muslim in a friendly manner commits treason. In a number of nations this will get you the death penalty, especially for women, due to islam specifying it.

    Since this is part of the most essential part of islam, anyone who does NOT believe this is not a muslim.

    Ergo one is either religiously intolerant Xor one is not a muslim.

    Being a tolerant muslim is like being an innocent murderer, a vegan game barbecue : a contradiction by itself.

    Should you be tolerant against people who believe this is the way to live ?

    Of course, since racism and religious intolerance is a core part of islam itself, that is the exact same question as, should you tolerate muslim ideology ?

    So, please tell me, which of these is true :
    1) we do not allow for religious intolerance, and therefore we do not allow muslims and/or islam
    2) we allow for intolerance, in a non-racist way, and we show the same respect to KKK members as to muslims
    3) we allow intolerance in a racist way : some groups get to be racist, others get punished

    Obviously 3, your choice, is the worst of all in the effect it'll have on racism. It both makes you yourself a racist and encourages racism in others.

    Needless to say, we have apparently chosen the dumbest of these options, number 3. Of course, before 1941 there was no politician in public office who dared call Hitler anything but the "champion of the poor".

    The ideology of islam is as much an enemy of human rights, of equality and of tolerance as nazism. Please treat it as such.

    1. Re:Should you be tolerant to the KKK too ? by Anonymous Coward · · Score: 0

      Tolerance != Respect. Even though I tolerate your retarded post, I have no respect for it.

    2. Re:Should you be tolerant to the KKK too ? by Anonymous Coward · · Score: 0

      That means nothing other than that you hate it's content, but can't make any valid argument against it.

    3. Re:Should you be tolerant to the KKK too ? by clone53421 · · Score: 1

      Nobody is persecuted for their beliefs, no matter how racist they are. They're allowed to believe whatever they want. It's when they start doing things that are illegal that we have a problem and we put a stop to whatever that may be.

      --
      Alexander Peter Kristopeit bought his basement from his mommy for one dollar.
  88. Re:Think you understand these things? Try this... by T+Murphy · · Score: 1

    To those who don't see the 1/3, consider 2-child families with children listed oldest first:
    1/4 have Boy, Boy
    1/4 have Boy, Girl
    1/4 have Girl, Boy
    1/4 have Girl, Girl
    You know there is at least one girl, leaving 3 options. One of those has two girls, so you have 1/3.

    As for the Mary thing, the best I understand is if you say the FIRST one is named Mary, since only two options have a girl first, making it 1/2 for having two girls. If I am missing something please correct me, but I honestly cannot see how you get 1/2 without specifying which child is Mary.

  89. Whoosh!! by paimin · · Score: 1

    That was the sound of a joke going over your turban.

    --
    Facebook is the new AOL
  90. Re:Think you understand these things? Try this... by Scratch-O-Matic · · Score: 1

    Um, yeah, forget what I said about 50:50 in the first case. But I too am having trouble seeing the difference between the first case and the second case.

    --


    Evil is the money of root.
  91. Re:Come On by misexistentialist · · Score: 1

    Yes, the software should analyze skin color and accent.

  92. Re:Think you understand these things? Try this... by XSpud · · Score: 1

    Your second example is only true if you add an additional assumption: that a family never has 2 children with the same name, in which case your question is better expressed as "If I tell you only that they have exactly one child named Mary, what is the probability that both children are girls?". In this case the probability is 50% as you point out.

    However, if a family can have 2 children with the same name the probability will depend on the proportion of Marys amongst girls. For example if all girls are called Mary, your second question *is* the same as the first one and the probability is 1/3. If Mary is a rare name (as in the real world), the probability will be slightly less than 50%.

  93. How to explain the discrepancy? by MoxFulder · · Score: 1

    It's a matter of precision and recall, a very elementary and important concept of statistics.

    Basically, anyone who designs or uses any kind of test designed to find the proverbial needle-in-a-haystack ought to learn some basic fscking statistics and how they apply to this situation. And yes, that includes police officers and screening personnel in the field, in my opinion.

    1. Re:How to explain the discrepancy? by RockDoctor · · Score: 1

      anyone who designs or uses any kind of test designed to find the proverbial needle-in-a-haystack ought to learn some basic fscking statistics and how they apply to this situation. And yes, that includes police officers and screening personnel in the field, in my opinion.

      Should happen.
      Won't happen.
      By the time that you've selected out applicants with the appropriate educational background, you won't have enough warm bodies to fill your roster. People with the appropriate level of training will be away to better paying jobs, except for a vanishingly small proportion who can afford to put their society ahead of themselves and any family they choose to procreate.

      --
      Birds are not dinosaur descendants;birds are dinosaurs, for all useful meanings of "birds", "are" and "dinosaurs"
  94. Time for more Statistics in High School? by magisterx · · Score: 1

    This seems like a good argument to get at least an overview of statistics into the standard high school curriculum in America.

  95. Re:Think you understand these things? Try this... by ColonelPanic · · Score: 1

    Okay, if you don't get the problem (and yes it is correctly stated), there are three things you can do to improve your understanding.

    1) Write a simple computer program in your language of choice to generate a billion random two-children families and count the ones that meet the conditions.
    2) Draw a Venn diagram.
    3) Read up on Bayes' theorem.

    --
    "Skill shows through where genius wears thin." -Wittgenstein || Religion: uniting aviation and architecture.
  96. well studied in the clinical literature by cinnamon+colbert · · Score: 1

    if you read about how medical tests are done, there is ahuge literature on this, and it makes the point of the article, that teaching this stuff, is not easy
    see the wiki article on negative predictive value - its all there, just not clear

  97. Astroturfing. by C10H14N2 · · Score: 1

    This is astroturfing. It is no accident that the South Capitol Metro station (beneath the U.S. House offices) in Washington DC is currently wallpapered with PRO-Cancer-Screening posters.

    Considering a $100 test, a $1k treatment and a 5% actual frequency in the population, per $1K you're spending about $50k on +/+, $100K on -/- and an inconsequential amount on BOTH false positives AND false negatives.

    HOWEVER, outside of that you have untested treatment, often prophylactic. This happens a lot with my insurance carrier. Diagnostic testing denied coverage almost 100%, treatment denied without diagnostic testing or overt presentation of symptoms. Now, given the same frequency, uncovered, untested conditions would account for about the same $50K in expenditure for +/+ and if just 10% opted to go ahead with treatment prior to becoming symptomatic, it would generate the same $100K in prophylactic treatment -- out of pocket. The false-negatives in that case become VERY cheap indeed, being, well, dead.

    Is it any wonder they are discouraging testing?

  98. Sally Clark by nbauman · · Score: 3, Insightful
    That may have been the Sally Clark case, although there were others. http://www.independent.co.uk/news/false-statistic-may-have-led-to-solicitors-murder-conviction-1135231.html

    I think that's called the "prosecutor's fallacy." If there's a 1/10,000 chance of a child dying of cot death, and a woman has two children die of cot death, the prosecutor tells the jury that the chances could only be 1/10,000 * 1/10,000 = 1/100 million that both deaths were a cot death, so she must have murdered them.

    This only works if the deaths are statistically independent, which they're not. The parents could have a genetic defect which cause 2 successive infants to die.

    If each parent had 1 fatal recessive genetic defect, then 1/4 of their children would die, so the odds are 1/16 that two successive children would die. But actually a lot of fatal birth defects are more complicated than that simple mendelian pattern.

    It's even more complicated because some mothers have been captured on video trying to smother their children.

    1. Re:Sally Clark by Cerebus · · Score: 1

      It's actually called "base rate fallacy."

      --
      -- Cerebus
  99. Re:Think you understand these things? Try this... by Scratch-O-Matic · · Score: 1

    In my case I just wrote out the possible combinations, and saw the 1/3 right away. I had fallen for the same problem as the 100 coin tosses: by the time I have identified a child enough to refer to the "other child," I have already beaten some of the odds!

    But please clarify the "one is a girl" and "one is named Mary."

    --


    Evil is the money of root.
  100. Re:Think you understand these things? Try this... by ColonelPanic · · Score: 1

    I explicitly said that they have at least one child named Mary. They could have two; it still works out.

    Yes, I assume that not every girl is named Mary.

    --
    "Skill shows through where genius wears thin." -Wittgenstein || Religion: uniting aviation and architecture.
  101. Re:Come On by unlametheweak · · Score: 1

    What a load of crap, back in 2006 NBC dateline had a bunch of muslims go to a Nascar race and see if they were harassed, guess what they were NOT bothered at all. This sort of idiotic bollocks is what perpetuates the myth that the US is full of racists.

    I could only presume that DHS officials, and boarder guards don't hang out at Nascar events, because so-called "racial" profiling does go on in law enforcement. Racial profiling itself isn't necessarily wrong (however you may interpret that word), but it does lead to quite a lot of false positives and can perpetuate ethnic animosities. And I certainly doubt that NBC Dateline was able to read people's minds, because observing public behavior at a sporting event is not generally indicative of the types of stereotypes or prejudices people may or may not have. Journalism does often present itself as a shallow type of pseudo-science however.

    It's interesting how sensitive people are to that bit of humour or rhetoric that spawned this thread. It obviously hit a nerve with people. Fascinating.

  102. Nice from afar, but far from nice... by PinchDuck · · Score: 1

    Same concept, different type of broad.

  103. Encourage people to read The Drunkard's Walk by Anonymous Coward · · Score: 0

    I'm actually reading this book right now: The Drunkard's Walk by Leonard Mlodinow (http://www.amazon.com/Drunkards-Walk-Randomness-Rules-Vintage/dp/0307275175/ref=sr_1_1?ie=UTF8&s=books&qid=1248279392&sr=8-1)

    This is a major theme of the book, including a story about the author learning he had tested (false) positive for HIV.

    So far it is a good book. Maybe not as technical as I personally might desire, but I think a great read for the general populace.

  104. Re:Come On by billcopc · · Score: 1

    What's arabic for "WHOOSH" ?

    --
    -Billco, Fnarg.com
  105. Re:Come On by majid_aldo · · Score: 1

    despite them being an optional part of the Muslim faith so most turban wearers are from entirely different religions which actually require them.

    http://en.wikipedia.org/wiki/Turban

    Please educate yourself before posting such drivel.

    the turban is NOT part of the muslim faith...neither optional nor required.

    --
    --- widget evolution: enhanced, plus, super, ultra, extreme, exxxtreme, ultra-extreme, ..etc.
  106. We need more terrorists to make the math easier by clawsoon · · Score: 1

    You're all thinking about this the wrong way. Clearly, we need more terrorists to make the math easier to understand. Then we wouldn't have all this confusion! The boys at the TSA would be very grateful.

  107. Conditional probability... by Anonymous Coward · · Score: 1, Insightful

    The probably easiest way would be to somehow force people to only report the probability conditional on the fact they are tested positively, i.e. compare P(Not being a terrorist | identified as terrorist) to P(Being a terrorist | identified as terrorist)

    e.g. Instead of saying a test has 90% chance to be positive (as stated), report that the test is wrong 90% of the time.

    Additionally, I wonder if there ever was any real terrorist that answered truthfully to the question "Are you a terrorist?" which they ask you when you fly to the US...

  108. Re: The Explanation by ahecht · · Score: 1

    The reason there is a greater chance in the Mary case, as opposed to the girl case, is that a family with two girls is twice as likely to name a child Mary as a family with only one girl (since they have two opportunities to name a child Mary instead of one).

    In the first case, if we choose 1000 couples, on average we get:
    250 with Boy/Boy
    250 with Boy/Girl
    250 with Girl/Boy
    250 with Girl/Girl

    Since we can eliminate the 250 Boy-Boy couples, the odds of Girl-Girl are 250/750 or ~33%

    In the second case, lets assume that 10% of girls get named Mary. In this case we have:
    250 Boy/Boy, of which 0 are Mary/NotMary and 0 are NotMary/Mary
    250 Boy/Girl, of which 0 are Mary/NotMary and 25 are NotMary/Mary
    250 Girl/Boy, of which 25 are Mary/NotMary and 0 are NotMary/Mary
    250 Girl/Girl, of which 25 are Mary/NotMary and 25 are NotMary/Mary

    Therefore, the odds of a Girl/Girl couple having a Mary is 50/100, or 50%

  109. Also a problem for car efficiency, other ratings by MojoRilla · · Score: 3, Insightful

    Math has a way of warping almost anything. Take the miles per gallon rating we use in the US to tell us how efficient our cars are. Miles per gallon is actually a very misleading measurement. What we should probably use is gallons per mile, or gallons per 100 miles.

    Take an example where a Range Rover gets 14 MPG, a Toyota Rav4 gets 24 mpg, and a Prius gets 46 mpg. It isn't intuitive based on the miles per gallon, but moving from the Range Rover to the Rav4 saves more fuel than moving from the Rav4 to the Prius. That is because people don't drive a fixed number of gallons, but drive (more or less) a fixed number of miles. When you look at the gallons used per 100 miles it is clear. The Range Rover uses 7.14 gallons per 100 miles, while the Rav4 uses 4.17 and the Prius 2.17. So it is clear that changing from a Range Rover to a Rav4 will save almost 3 gallons per 100 miles, while changing from a Rav4 to a Prius only saves 2 gallons per 100 miles.

  110. Re:Think you understand these things? Try this... by ahecht · · Score: 1

    The added factor in the second case is that a couple with two daughters has twice as many opportunities to name a daughter "Mary" as a couple with only one daughter does.

  111. Beer goggles by rrohbeck · · Score: 1

    must be the top reason for false positives in broad screening.

  112. Re:Think you understand these things? Try this... by DavidTC · · Score: 3, Informative

    A family with two children is chosen at random from a large population.

    If I tell you only that they have at least one daughter, what is the probability that both children are girls?

    Most people can get that one (it's 1/3), but fail miserably on this question:

    You are incorrect. Your statistic would be true if we were randomly picking family with two children until we came across one with (at least) one girl. There's a 1/3 odds there we'd pick one with two girls, and 2/3 that we'd pick one with just one.

    However, that is not what you said. You said we picked the groups at random, and, hence, telling us the gender of a child tells us nothing about the other one. The genders are entirely independent of each other.

    You can see how that works by imagining that the second child has not actually been born yet.

    Or imagine it as coin flips. If I announce the result of one coin flip, it's not going to alter the other. If I make pairs of coin flips, and deliberately select a pair that has at least one tails in it, however, I have removed certain flips from the odds.

    You actually understand this in your second example, and get the right odds, but surreally miss it in the first, despite using exactly the same example. If only girls are named Mary, saying one is named Mary is exactly identical to saying one is a girl. Your two examples are the same. You meant for your first example to be:

    If we pick out two parents who have at least one girl, what are the odds that their other child is a girl?

    That has the odds of 1/3, because the possibilities are M/F, F/M, and F/F.

    --
    If corporations are people, aren't stockholders guilty of slavery?
  113. Re:Come On by Rob+the+Bold · · Score: 1

    The 9/11 and 7/7 attacks etc were instigated by self proclaimed Muslims. There's no "alleged" about it, it's just a fact. Note that I don't believe that all Muslims are terrorists, or that all terrorists are Muslim, that's just stupid. But the most widely publicised and recent terrorist attacks have been strongly linked with Islam. That doesn't mean that Islam "harbours" terrorists, a lot of Muslims don't agree with these violent attacks. But it's pretty safe to say that the majority of attempted terrorist attacks within the next few years are likely to be instigated by Muslim fanatic groups who are pissed off about the whole invasion situation in Aghanistan/Iraq/Iran. The 7/7 attacks here in the UK were "carried out by 4 British Muslim men who were motivated by Britain's involvement in the Iraq War" according to Wikipedia.

    If you define "terrorist attack" as "something spectacular with a body count of at least a half dozen perpetrated by people identified as Muslim or Middle Eastern", then yes, the majority of those will probably be instigated by Muslim fanatic groups.

    If you were to expand the definition to include vandalism, sabotage and assassination (but only one at a time), then we might find that "terrorists" are more diverse than that. Of course, we could always say that those guys were lone wolves, acting alone, in a total vacuum, certainly not egged on by mass media accusations that their targets are mass murderers. And definitely not endorsed by any organization, certainly not by any organization that also insists they not be called "terrorists". Those would fall under the category of "isolated incidents involving deranged individuals".

    --
    I am not a crackpot.
  114. "so...you're telling me there's a chance?..." by turkeydance · · Score: 1

    my fav Dumb and Dumber movie quote.

  115. Change the terminology by oren · · Score: 2, Interesting

    Instead of talking about false positives and negatives and dependent distributions (which fly right over the head of the average joe), boil it down to the "amplification power" of the test. A random person "presumed innocent until proven guilty" has a chance of 1/3000 to be a terrorist. If you apply your 90% test, people failing it will be terrorists ~1/333 of the time. So the test as an "amplification power" of ~9x. Now everything becomes intuitive. You are looking for a 1-in-3000 needle in a haystack with an amplification power of ~9x, you now need to look for a ~1-in-333 needle in a haystack. The term "90% accuracy" doesn't appear anywhere to confuse things, and it is something everyone can easily grasp. And yes, I know, this ignores the terrorists false negatives; for that you say the test has a "miss rate" of 1/9 so about 1 in nine terrorists will slip through. These three numbers - (1) how rare what you are looking for is, (2) what's the "amplification power" of the test, and (3) what is the "miss rate", give you enough info to intuitively convey all you need to get a good feel for how effective the test really is.

    1. Re:Change the terminology by Lunzo · · Score: 1

      I think your description will have the opposite effect for the average person. Instead of highlighting how bad the test is, it will make them think the test is effective. "Wow, it cuts down the work that security has to do by a factor of 9! And the test rarely misses the terrorists!". Instead, the point of the article & summary was to point out that if you screen 1000 people, you're locking 90 innocents up as terrorists, and such a high failure rate is unacceptable for a society that believes everyone is "innocent until proven guilty".

  116. You Need the Full Confusion Matrix... by DrEasy · · Score: 3, Insightful

    ... and a utility function too!

    The article is confusing because it doesn't indicate the false negative rate. You basically need to know the entire confusion matrix before inferring anything. This way, you can not only calculate the accuracy and the false positive rate, but you can also calculate the false negative rate, the precision and the recall. Precision and recall are much more useful metrics than recall when it comes to tests like these.

    Also, you need to know how much it really costs you to have false negatives and false positives. If you accuse someone erroneously of being a terrorist, and the only inconvenience is a few extra minutes of body search (and the humiliation) at the airport, it *might* still be worth the trouble. If on the other hand you end up sending the poor dude to jail, and he sues you for wrongful conviction, then not so much. You therefore need to have a utility function that assesses the cost of getting it right and wrong both ways (positive and negative). That's basically what is discussed in the other article (the cost of cancer screening tests), albeit in an informal way.

    --
    "In our tactical decisions, we are operating contrary to our strategic interest."
    1. Re:You Need the Full Confusion Matrix... by DrEasy · · Score: 1

      Obviously I meant to say: "Precision and recall are much more useful metrics than *accuracy* when it comes to tests like these."

      --
      "In our tactical decisions, we are operating contrary to our strategic interest."
  117. It applies to other contexts as well by gznork26 · · Score: 1

    Two consecutive identical readings was also considered conclusive proof of valid air pressure data when the venturi on a cruise missile I worked on was opened. The engineers figured that this indicated the turbulence caused by opening the venturi had dissipated, and that they could therefore use the air pressure reading as the basis for an initial altitude calculation. As it turned out, in a universe this size, it was possible to take two readings from within turbulence and get the same value, so the missile calculated that it was five miles up, and did a power dive into the sand.

    Good thing it was only a test.

    P. Orin Zack
    + + +
    Google returns 64,000,000 matches when you search for political short stories. The first one is mine. Visit http://klurgsheld.wordpress.com/ to find out why.

  118. Accuracy reports by benob · · Score: 1

    When the event of interest is rare, one can report F-score (or F-measure), which is the harmonic mean between recall and precision. Recall is the proportion of cases that you have found in the population in regard of the actual number of cases, precision is the proportion of the cases that you have found in regard to the number of cases that you believe to have spotted. In other words: Recall = #(right) / #(truth) Precision = #(right) / #(hypothesis) F-score = 2 * Precision * Recall / (Precision + Recall) There are variants to adjust between recall and precision: http://en.wikipedia.org/wiki/F1_score.

  119. Re:Come On by Jah-Wren+Ryel · · Score: 2, Informative

    What a load of crap, back in 2006 NBC dateline had a bunch of muslims go to a Nascar race and see if they were harassed, guess what they were NOT bothered at all.

    Funny, I can't find any record of Dateline actually running that segment. What I do find is a billion news articles about how NASCAR and others like Michelle Malkin got their panties in a twist about it with the typical faux indignation of the bigotted right. I would have expected NASCAR's PR people to be smarter than that, but apparently not.

    This sort of idiotic bollocks is what perpetuates the myth that the US is full of racists.

    You've picked a strawman. Just because such attacks do happen does not mean that "the US is full of racists" what it does mean is that there are some racists here. Don't pretend that just because your silly strawman is false that no such racist attacks happen at all.

    http://ibnlive.in.com/news/sikh-attacked-in-another-hate-crime-in-new-york/57501-3.html
    http://www.nypost.com/seven/09162007/news/regionalnews/muslim_biz_gal_beaten.htm

    --
    When information is power, privacy is freedom.
  120. Re:Come On by russotto · · Score: 1

    What a load of crap, back in 2006 NBC dateline had a bunch of muslims go to a Nascar race and see if they were harassed, guess what they were NOT bothered at all.

    Of course not, they fit right in. Pretty much everyone at a Nascar race likes to blow stuff up.

  121. Re:Think you understand these things? Try this... by XSpud · · Score: 1

    In that case the probability will be "close to 50%" assuming Mary is a reasonably rare name amongst girls.

    Assume 10% of girls are named Mary, and a sample size of 2000

    Oldest child - Youngest
    Boy - Boy 500
    Boy - Mary 50
    Boy - Girl not mary 450
    Mary - Boy 50
    Mary - Mary 5
    Mary - Girl not mary 45
    Girl not Mary - Boy 450
    Girl not mary - mary 45
    Girl not mary - girl not mary 405

    Probability of 2 girls assuming at least one is called Mary = (5 + 45 + 45 + 405)/(2000 - 500 - 450) = 500/1050

    This is still not 50% but p(2 girls) does approach 50% as p(girls name is Mary) approaches 0

  122. Re:Also a problem for car efficiency, other rating by koxkoxkox · · Score: 1

    That's what (some ? most ?) other countries do : in France we use liters per 100 kilometers.

    However, I never thought about the advantages of it, thanks for your post !

  123. Straightforward statistical explanation by UltraOne · · Score: 1

    The relevant statistical concepts are the following:

    .

    True positive (TP)- The person really is a terrorist, and your test detects him (I'm going to use the male pronoun throughout to keep the language less cluttered)
    False positive (FP) - The person is not a terrorist, but your test says he is
    False negative (FN) - The person is a terrorist, but your test does not detect him
    True negative (TN) - The person is not a terrorist, and your test correctly says he is not

    .

    Sensitivity is the ability of the test to detect a true positive and equals TP / (TP + FN), or to put it another way, TP / (number of all terrorists, whether detected or not)
    Specificity is the ability of the test to detect a true negative and equals TN / (TN + FP), or to put it another way, TN / (number of people who are not terrorists, whether the tests says they are or not)

    .

    Generally in statistics, sensitivity and specificity are considered to be properties of the test, independent of the population it is run on, although this probably isn't strictly true in the real world.

    .

    Positive predictive value (PPV) is the chance that someone who tests positive is really a terrorist and equals TP / (TP + FP), or to put it another way, TP / (all people who test positive, whether they are terrorists or not)
    Negative predictive value (NPV) is the chance that someone who tests negative is really not a terrorist and equals TN / (TN + FN), or to put it another way, TN / (all people who test negative, whether they are terrorists or not)

    .

    In these terms, the statement that the OP makes can be rephrased as: Even a test with good sensitivity and specificity can have poor positive predictive value if the frequency of terrorists is low.

    .

    Example: Test is 99% sensitive and 99% specific. Terrorists are 0.01% (i.e. one in 10,000)
    Consider 1,000,000 people. Terrorists: 100, not terrorists: 999,900
    True Positives = 0.99 (sensitivity) * 100 (terrorists) = 99; False Negatives: 100 (terrorists) - 99 (true positives) = 1
    True Negatives= 0.99 (specificity) * 999,900 (not terrorists) = 989,901; False Positives: 999,900 (not terrorists) - 989,901 (true negatives) = 9,999
    Positive Predictive Value = 99 / (99 + 9,999) ~ 0.0098 = 0.98%

    .

    Sorry about the lines that consist of a period, but my <br> tags were being ignored there, and I couldn't figure out a better way to insert blank lines to make the post more readable.

    1. Re:Straightforward statistical explanation by clone53421 · · Score: 1

      Sorry about the lines that consist of a period, ...

      That's the preview CSS screwing things up. Just use <p>...</p> tags and it'll look like there's no space when you preview, but when you submit it'll be correct.

      --
      Alexander Peter Kristopeit bought his basement from his mommy for one dollar.
  124. Good luck... by Anonymous Coward · · Score: 0

    How can this counter-intuitive fact be communicated effectively to people unschooled in statistics?

    It can't. This is why there's a Creationism museum in Kentucky.

    1. Re:Good luck... by Anonymous Coward · · Score: 0

      It seems you adhere to the theory of Evolution, then? Methinks you are the one in need of schooling on the principles of statistics.

      Virtually endless spans of time do not make virtually nonexistent probabilities magically become near-certainties.

  125. Re:Think you understand these things? Try this... by clone53421 · · Score: 1

    The difference is simple: "at least one daughter" is not the same as "one child is a girl".

    "at least one daughter, what's the probability of 2 girls" works as you illustrated.

    "one child is a girl, what's the probability the other is a girl" is a simple 50%. The probability that the 2nd child is a boy or girl does not depend on the gender of the first (the probabilities are unrelated). (Also, first and second are not important for this comparison. You could switch them around and the statement would still hold true.)

    --
    Alexander Peter Kristopeit bought his basement from his mommy for one dollar.
  126. Misinterpretation by moeinvt · · Score: 1

    I thought this was going to be a story about looking around for women while you're drunk.

    1. Re:Misinterpretation by clone53421 · · Score: 1

      Depending on how drunk you are, it probably could be.

      --
      Alexander Peter Kristopeit bought his basement from his mommy for one dollar.
  127. Re:Think you understand these things? Try this... by XSpud · · Score: 1

    The GP is correct in this case as they did not specify whether a particular child was a girl. All we know is that at least one is a girl.

    You are correct that "telling us the gender of a child tells us nothing about the other one", but we've not been told which of the children is a girl so this this is not relevant here. All we know is that we have 3 equally likely possibilities - M/F, F/M and F/F.

    So in this example, these questions mean the same thing:

    A family with two children is chosen at random from a large population. If I tell you only that they have at least one daughter, what is the probability that both children are girls?

    If we pick out two parents who have at least one girl, what are the odds that their other child is a girl?


    What is relevant is how the questioner knows that there is at least one daughter e.g. by asking the parents "Is your eldest a girl?" or "do you have any daughters?" gives probabilities of 0.5 and 1/3 respectively, but the way the question was phrased implies the latter.

  128. Re: The Explanation by not-my-real-name · · Score: 1

    What if both girls were named Mary?

    --
    un-ALTERED reproduction and dissimination of this IMPORTANT information is ENCOURAGED
  129. Re:Come On by Anonymous Coward · · Score: 0

    That is, however, nearly useless information.

    Most child molesters are known to the child and the family.
    Does this mean that we should consistently pick new people that we don't know to watch our children??

    It's not that "a lot of Muslims don't agree with these violent attacks", it's more that a lot of Muslims don't understand why westerners think these attacks have anything to do with being Muslims. Timothy McVeigh was a white guy who won a Bronze Star in the Gulf War. Should we start treating white male veterans differently because some fraction of less than 0.0% of them blew up a federal building? Muslims are confused by questions such as "where's the outrage in the Muslim community about terrorism?". Their response is typically something along the lines of "uhm, what? those guys weren't Muslims, they were whackos that happened to be Muslims or claimed that they were Muslims". This is pretty much exactly like the reaction of the average Catholic in the USA while the IRA was blowing people up in Northern Ireland. "Uhm, what? they're Catholic? uh, whatever, they are a bunch of terrorists blowing people up in Northern Ireland".

    Being Muslim has as much to do with terrorism as being Irish, or a military veteran.
    Being a loon that thinks you can terrorize people in to doing what you want them to do is the defining characteristic of terrorists, but unfortunately there is no loon uniform, loon language or loon skin color so we tend to fall back to simple associations and that's not helpful in the slightest.

  130. In One Word by TaleSpinner · · Score: 0

    > How can this counter-intuitive fact be communicated effectively to people unschooled in statistics?

    In One Word: it can't.*

    *Yes, that's two words, one of which is a contraction. Statistically, it's close enough. And I'm much better at statistics than anyone in Congress.

  131. A similar case was on Law & Order by Anonymous Coward · · Score: 0

    There was a similar case on one of the Law & Order TV shows.

    Thankfully for the guy who was framed, the state's forensic expert noticed the semen didn't look right. It looked like it had been frozen. They found the real bad guy in the end of course.

    Still, as a juror, if a guy accused of rape claimed he was framed I would want either a good alibi or a good explanation of how someone acquired his semen, or a statement from the victim that didn't jibe with this guy being the do-er. Absent that, framed or not, the evidence of his guilt would be "beyond a reasonable doubt."

    If it was a rape-murder though, that tinge of doubt might be enough to keep me from giving the guy the needle. When it comes to the ultimate penalty, I want to be absolutely sure. Reasonable doubt just isn't good enough.

  132. clarity by davidwr · · Score: 1

    The change from 14 to 24 being a better improvement than that of 24 to 46 is immediately clear to anyone who thinks in terms of ratios rather than differences.

    24/14 > 46/24

    The problem isn't using mpg vs. gpm, the problem is people who don't remember their elementary-school maths, or who never learned them.

    --
    Knowledge is how to play a game, intelligence is how to win, wisdom is knowing what game to play.
  133. Ignorance of Basic Statistics by jonadab · · Score: 1

    > How can this counter-intuitive fact be communicated effectively to people unschooled in statistics?

    I'm in favor of making basic statistics, and also basic logic, required units in gradeschool. Everybody should know what standard deviation is, and statistical significance, and a premise, and the difference between soundness and validity. If something has to be cut from the curriculum to make room, I can propose a long list of significantly less important stuff: cursive handwriting, Johnny Appleseed, casting out nines, analog clock reading (who the heck can't afford a digital clock these days), the list just goes on and on.

    --
    Cut that out, or I will ship you to Norilsk in a box.
  134. Bad example by davidwr · · Score: 1

    If you've paid attention to the cancer warnings in the press, they don't tell you to go see a doctor for every mole.

    What they do tell you is to monitor any changes in your moles, including of course new ones. Compare them against reference pictures of what is healthy and not healthy, and use common sense to see if there is another plausible explanation. If you have a bleeding mole but you just cut yourself there, it's very unlikely to be cancer and you don't need it tested.

    If your body has a history of moles changing in a particular pattern and your doctor has previously told you not to worry, new changes that fit the same pattern are unlikely anything to worry about.

    --
    Knowledge is how to play a game, intelligence is how to win, wisdom is knowing what game to play.
    1. Re:Bad example by interkin3tic · · Score: 1

      If you've paid attention to the cancer warnings in the press, they don't tell you to go see a doctor for every mole.

      I actually was thinking about that, but in the end, I sacrificed medical accuracy for humor.

  135. Old Lloyds of London insurance Names by davidwr · · Score: 1

    Here's an example in the opposite direction, which I think will make things a little more clear. Suppose I were to set up a "reverse lottery," which works as follows. You have, let's say, a net worth of $100,000. If you sign up for my lottery, I pay you a dollar. Then you pick six numbers between 1 and 10, I draw six balls out of urns, and if the numbers match ... I take everything you own. Your house, your car, your computer, the clothes off your back. You're turned out on the street.

    This was the concept behind the original Lloyds of London insurance syndicate. "Names" pledged everything they owned to underwrite the risks of those paying the premiums.

    I payed you and your fellow Names a premium based on the value of my ship and its cargo and the risk, plus a profit for you.
    So did a lot of other customers.
    If my ship sank, you all paid me the declared value.
    If by some fluke all the ships sank at about the same time, we the insured took you to court and collected everything you all owned, your horse, your slide rule, your coat and top hat. You were turned out on the street.

    Fortunately for the Names, that didn't happen until the late 20th century.

    --
    Knowledge is how to play a game, intelligence is how to win, wisdom is knowing what game to play.
  136. Re:Also a problem for car efficiency, other rating by Noren · · Score: 1

    Both of these systems are based on volume of fuel - mass of fuel would be a fairer comparison. Measuring by volume makes diesel engines appear more efficient, simply because diesel fuel is denser. More mass of diesel fuel will fit in a liter or gallon than of gasoline.

  137. Re:Think you understand these things? Try this... by DavidTC · · Score: 1

    You are correct that "telling us the gender of a child tells us nothing about the other one", but we've not been told which of the children is a girl so this this is not relevant here. All we know is that we have 3 equally likely possibilities - M/F, F/M and F/F.

    No. We already know the gender of one child. Either we know that the first, or the second. We don't know which one it is, but we do know we know one of them.

    Ergo, we're got two options, equally likely. We're trying to find out, either F/[?] or [?]/F, we don't know which.

    And hence we have four options. Either we've got F/[M] or F/[F] if we've learned the first one, or we have [F]/F or [M]/F if we've learned the second one. We don't know which to use, because we don't know which we've learned, but luckily they have the same 50/50 odds.

    Just because two of the outcomes result in two daughters don't mean they're the same, anymore than F/M and M/F are the same outcome. Knowing the first child, and the second being female, has just as much odds as knowing the first child and the second being male, and the same with swapping 'first' and 'second'. Four outcomes, not three.

    It's only when the original choice of the family, in some way, depended on one of the children being female that the probability changes to 1/3. Like if you go around selecting families with one daughter, which means there's a 2/3 chance the other is a son.

    --
    If corporations are people, aren't stockholders guilty of slavery?
  138. Re:Think you understand these things? Try this... by DavidTC · · Score: 1

    Actually, I can make this point much simpler. You agree that if they say 'My eldest is a girl', they have a 50% chance of having another girl. Presumable that would also apply if they said 'My youngest is a girl.', right?

    And when they say 'One of my children is a girl', what they are actually saying is 'Either my youngest is a girl or my oldest is a girl.', right?

    As either of those possibilities would result in a 50% chance of another girl, the situation as a whole must result in a 50% chance of another girl.

    --
    If corporations are people, aren't stockholders guilty of slavery?
  139. People play a reverse lottery every day. by Anonymous Coward · · Score: 0

    People play a slightly different kind of reverse lottery every day. It's called insurance. The expected value of insurance is always negative, but you are paying to reduce your negative variance. The lottery is simply paying to increase your positive variance. Expected value isn't the whole picture (and by the way, when the lottery is large enough, it can actually have a positive expected value)

  140. Re:Come On by Anonymous Coward · · Score: 0

    How about you define terrorism as it's always been defined ? Ideology-motivated murders (as opposed to profit-motivated, or racist-motivated, or ...)

    That would both be a reasonable definition and would classify ideologies as murderous like so :
    1) islam, idiotically long history of incessant and senseless attacks (including over a 1000 useless attacks with the nothing but the purpose of killing on constantinople)
    2) communism (but 1000x less than 1)
    3) various other religions (again a factor 100 or 1000 less than the 2 previous)

    The extent people are willing to go to deny the obvious truth is amazing. Islam is an ideology that motivates disproportionally many deaths, there is no reasonable argument possible that states otherwise. And yes, muslims follow islam, and can therefore at the very least be said to be "more prone to murder", simply and only due to that ideology. That's called statistics. Men are also more prone to murder.

    Whether that's a causal relation can also be established. Take 2 people's who share everything, except religion. Like, for example, the population of the Kashmir valley, meaning the only difference between them is religion. And yes the muslims kill more, much, much more.

    So that leaves one of 2 explanations : either islam causes people to kill others, or the killings cause people to become muslims.

    But I guess any politically incorrect truth, no matter how blatantly obvious, must be fought with all force.

  141. AKA Legalized 3rd rate citizen/race discrimination by Anonymous Coward · · Score: 0

    Great way to legalize 3rd rate citizen and race discrimination. We only hope that we are the lucky select few to be privilege first class Fascist neo-nazi-sedo-citizen. Hail Britannia Hail Britannia Hail Britannia... Geass!!! Hail Lelouch! Hail Lelouch! Hail Lelouch!

    I predict that the controlling party statistic abilities will coincidently degrade by insane amount and the old British Lord system come into play. Only 2% are first class and the rest 3rd rate citizen. Kind of what we have now with Rich, middle, and poor class, but you get Rich with everything and poor slave with nothing like how it was back before the french revolution.

  142. 90% accurate 10% rate of false positives by Dr.Lefty · · Score: 1

    How can this counter-intuitive fact be communicated effectively to people unschooled in statistics?"

    We could start by never claiming any test is X% accurate. Any detection scheme for anything cannot have it's accuracy defined by only one number. You need at least two numbers...the rate of false negatives (or efficiency, which is what is usually quoted), AND the rate of false positives to get a picture of what any test will be capable of...Even the example in the linked article was wrong. a 90% efficient test does not necessarily have a 10% rate of false positives. It could have a 1% rate of FP, or a 50% rate of false positives. Saying a test is 90% accurate has no meaning by itself.

  143. Re:Think you understand these things? Try this... by XSpud · · Score: 1

    You are making this more complicated than it needs to be.

    Let's assume a population of 4 thousand if you like. I hope you'll agree there are 4 equally likely possibilities:

    1) M - M 1000
    2) M - F 1000
    3) F - M 1000
    4) F - F 1000

    Then we apply the random selection and the further knowledge we are given, i.e. at least one of the children is a girl. This discounts M - M and we can deduce the probability of F - F is 1000/3000.

    Also from the table above we can work out if we know the eldest is F then the chance of the other being a girl is 1/2 and if we know the youngest is F then the chance of the other being a girl is also 1/2.

    And hence we have four options. Either we've got F/[M] or F/[F] if we've learned the first one, or we have [F]/F or [M]/F if we've learned the second one. We don't know which to use, because we don't know which we've learned, but luckily they have the same 50/50 odds.

    The mistake here is you've included the F/F set twice because you are treating F/[F] and [F]/F as different sets, which they are not. Consider what you're saying here, that p([F]/F or F/[F]) is twice p(F/M) and twice p(M/F). Or another way of looking at it is the probability of the eldest being F is 75% if you consider F/[M], F/[F], [F]/F and [M]/F to be equally likely (25%), which is incorrect.

    It's only when the original choice of the family, in some way, depended on one of the children being female that the probability changes to 1/3. Like if you go around selecting families with one daughter, which means there's a 2/3 chance the other is a son.

    For the purpose of this probability calculation, the knowledge we have "at least one daughter" is equivalent to "randomly select from families with at least one girl". In both cases we start off with the same information on which to base the calculation. I'm interested to know why you see there's a difference.

    Incidentally, if the question was phrased something like "a family was chosen at random, and I met just one of the children, who was a girl", you will get the 50% probability you mention, but this cannot be deduced from the original question . "First child I met was a girl" implies "at least one daughter" but the reverse is not true.

  144. Natural frequencies instead of probabilities... by MenThal · · Score: 1

    There was an article on the problem of people not understanding probability percentages in Scientific American a few months ago, going specifically into the HIV tests.

    The proposed solution was to use more "natural frequencies" as in "out of 10,000 people one person has HIV". That is, focusing on the counts and numbers and avoiding the 99%, five nines and 0.01% failure rates like the plague due to their inherit relativeness, as in something that decreases your chances of cancer from 0.02% to 0.01% is touted - technically correct, but misleading - as reducing your risk of cancer by 50%.

    The most scary thing about that article was that doctors - medical practitioners - were doing just as bad as the general populace at understanding the probabilities and false positive risks when presented as percentages. Moving to natural frequencies the docs did a lot better, probably because it is more intuitive.

    http://www.scientificamerican.com/article.cfm?id=knowing-your-chances

  145. Re:Come On by somersault · · Score: 1

    I'd agree about the Irish, but as for the Muslim association with Al Qaeda etc, read Al Qaeda's Ideology. Al Qaeda are trying to get back to a purer for of Islam, that is the motivation for their attacks. It's not just a vague link (though no doubt some of the people attracted to Al Qaeda will be the type of people who are looking for an excuse for a bit of violence), they're literally doing what they are commanded to do in their scriptures - what other modern Muslims are too pussy-footed to do. Just as you don't see many (any?) modern Jews sacrificing pigeons, goats and cattle all the time for their sins.. it's right there in their scriptures, and they were still doing it around the time of Jesus, so why have they stopped now?

    Btw you can't get a fraction of 0.0% - it's already nothing.

    --
    which is totally what she said
  146. Re:Also a problem for car efficiency, other rating by renoX · · Score: 1

    I don't know: fuel is sold per volume not per mass..

  147. Re:Come On by Ash+Vince · · Score: 1

    Unacceptable to whom? And why?

    I would imagine that any of this guys family might not see the funny side of the joke:

    http://en.wikipedia.org/wiki/Balbir_Singh_Sodhi

    Would the average American find me joking about the World Trade Center funny just because I thought the joke was about the lunatics flying the planes? I personally think not, so I would not risk telling jokes of that nature.

    --
    I dont read /. to RTFA, I read /. to offend people in ignorance.
  148. Re:Come On by Ash+Vince · · Score: 1

    the turban is NOT part of the muslim faith...neither optional nor required.

    I personally do not associate Turbans with the Muslim faith but they are mentioned on the page I linked to so I thought it best to hedge my bets a little. Thanks for the correction.

    --
    I dont read /. to RTFA, I read /. to offend people in ignorance.
  149. Re:Think you understand these things? Try this... by Anonymous Coward · · Score: 0

    Are you sure? I make it that the answer can be anything from 1/3 up to, but not including, 1/2 depending on what the probability is of a girl chosen at random being called Mary.

  150. Re:Also a problem for car efficiency, other rating by clone53421 · · Score: 1

    Yes, I'd considered the same thing when I heard that some countries measure efficiency in litres per 100 km.

    Also notice, though, the interesting tidbits that can easily be found from the reciprocal natures of the two values:

    (miles/gallon) * n gallons = How far will this fill-up take me? (or, how long until I fill up again?)

    (litres/100 km) * n km = How much is this trip costing me?

    Noting the fuel prices in the US vs. abroad, I find it not all too surprising that in the US we're more interested in knowing when we fill up next vs. finding out how much each drive is costing us... ;)

    This slightly-flamebaitish post was intended to be mostly funny, not offensive. Sorry if you didn't appreciate my warped humour.

    --
    Alexander Peter Kristopeit bought his basement from his mommy for one dollar.
  151. Re:Also a problem for car efficiency, other rating by clone53421 · · Score: 1

    Worth noting, the 2nd formula gives cost in litres, which of course needs to be multiplied by, say, euros/litre to find cost in monetary units...

    --
    Alexander Peter Kristopeit bought his basement from his mommy for one dollar.
  152. Re:Think you understand these things? Try this... by DavidTC · · Score: 1

    For the purpose of this probability calculation, the knowledge we have "at least one daughter" is equivalent to "randomly select from families with at least one girl". In both cases we start off with the same information on which to base the calculation. I'm interested to know why you see there's a difference.

    No, it's not the same thing at all. The possible outcomes are the same, but the odds are not. (Which you should understand because, strictly speaking, M/F and F/M are the same outcome if we're not asked about which is which.)

    Incidentally, if the question was phrased something like "a family was chosen at random, and I met just one of the children, who was a girl", you will get the 50% probability you mention, but this cannot be deduced from the original question . "First child I met was a girl" implies "at least one daughter" but the reverse is not true.

    Because that was the original question. I quote:

    A family with two children is chosen at random from a large population.

    If I tell you only that they have at least one daughter, what is the probability that both children are girls?

    In other words, a family was chosen at random, and we are told the gender of one of the children. We did not select a family with at least one daughter. We selected a family entirely randomly, then it turns out they have least one daughter, which of course has no bearing on anything else. We might as well be told one of their children is 5'4" and then asked the gender of the other.

    Or, to put it more sanely, like I did earlier...the question is identical to stating that 'either the youngest or oldest is female'. Both of those statements have a 50/50 chance of the other being female, and if they are the only two options the thing as a whole must be 50/50. That's how probability works.

    The question you think was asked, and the question the original poster thought he was asking, is not the question that was actually asked, as I was attempting to point out. The original poster thought he'd asked your question, 'If we pick a family with at least one daughter, etc', a question with odds of 1/3, but he did not ask that one.

    It's like me flipping a coin twice, and then telling you one of the flips was heads. That doesn't change anything. You think that we're doing a bunch of coin flips in pairs and selecting pairs with at least one head, which, indeed, would alter what the odds of the other are...but that's not what we're doing. We're selecting a pair of flips and randomly stating what one of them was.

    Now, it's entirely possible you don't agree with my parsing of the original question, which is understandable, it's not a very good question. I'm not going to debate semantics. If you want to read that it is asking something else, that they deliberately selected a family with a female child, fine.

    However, do you agree that the question 'We find a family with two children. We flip a coin to pick one of them, and inform you that one is female. What are the odds the other one is also?' has a 50/50 odds? And the same odds if, on another family, instead of flipping a coin to pick, they tell you the oldest child is female?

    --
    If corporations are people, aren't stockholders guilty of slavery?
  153. Re:Come On by Anonymous Coward · · Score: 0

    Muslims are too pussy-footed

    So that's why Muslim women can't show their feet in public.

  154. Re: The Explanation by clone53421 · · Score: 1

    In that case, I pity them.

    --
    Alexander Peter Kristopeit bought his basement from his mommy for one dollar.
  155. Re:Come On by MrResistor · · Score: 1

    Turbans are worn by Sikhs. This is a completely different religion to Islam which is alleged to harbour these terrorists.

    Different, yes, but not completely different. Sikhism is a combination of Islam and Hindu ideas. I don't know of any incidents of Sikh terrorism, but there are definitely a strong militaristic aspect to their teachings (which is why they're supposed to carry a dagger and wear a steel bracelet at all times).

    --
    Under capitalism man exploits man. Under communism it's the other way around.