How Well Do You Estimate?
A random UK blogger has published a quiz asking readers to estimate various numeric values which they may or may not have knowledge of; and has analyzed the resulting answers to determine how well people guess. The first part of the results looks at some specific questions, and the second part takes a look at the quiz overall.
With 44.7% accuracy!
more or less.
I am one of many. My idea is not unique, nor do I expect my voice alone to sway you. I speak in a chorus of opinion.
I would estimate that that server stayed up less than 2 minutes after the story was published. Mirrors anyone?
Server timed out trying to contact ex-parrot.com.
Looks like we've got an ex-webserver on our hands.
.
.
"It's not dead, it's IIS!"
Reminds me of the joke...
Why can't girls measure distances?
(Holding up a pinkie)
Because they've been told that THIS is 6 inches all their life.
AC
Tony Benn is a Labour politician in the UK.
I can usually estimate within plus or minus one or two Libraries of Congress every time.
I estimate that at about this point all the jokes about estimating will get tedious
Philip
Signatures are broken
Reminds me of a bit of training from my army days.
If you have difficulty estimating a distance ( range), divide the distance in two, and try estimating that.
This sounds stupid, but actually works. Well, it worked for me. I'll never forget how I laughed in my head at the suggestion, and my astonishment at it actually working.
Mike.
Part 1
Part 2
Does nobody here on Slashdot even remember the Mythical Man Month any more? The section on estimation and back of the envelope calculations was quite enlightening.
Clearly you don't. That section is in Programming Pearls by Bentley, not the Mythical Man Month.
I used to work at a small datamining shop. The people there were very bright, some of them quite famous in the fields of statistics, number theory, etc.. One day, we were sitting in the front room of our offices having lunch, chewing the fat, as it were.
At lunches, we would sometimes try to stump our CTO a grey beard who is famous for work in information theory and general genius. We had never succeeded, even with obscure questions in biology "How do Prions work?", physics "What order are the colors of the rainbow, and why?", "How does the Corriolus effect work?", etc. that none of us had any particular knowledge of, and always had to research afterwards to determine the correctness of his answers.
So, I posed the question to the group "How many leaves are on that tree outside the window?" It was a ~30 foot tall, bushy tree in the height of summer. I hoped he'd take the bait.. I thought this was going to be very hard to "get right", and it would even be difficult come up with a plausible answer.
After a few moments, I set off the responses by saying that I thought it easily had 10k leaves, possibly 20k or more.
Everyone gasped. "Oh no! No way..." and then proceeded to offer lower and lower estimates.
The responses started with me and made their way up in the seniority ranks (I was the most junior) all the way up to the CTO. He said "Oh! those kinds of things are notoriously hard to estimate. We typically overestimate grossly in counting things of plentitude. Oh, I don't know. 200?".
Finally we had him. There was no way there were 200 leaves on that tree.
Later, in discussion, a trend became clear. The more senior the person, the more conservative was their response, even to the ridiculous level of our CTO saying a tree in full flush, that he could see right outside of the window, had 200 leaves, when it most plainly had many, many more.
Anyone want to hazard a guess? How many leaves on say, an adult Sycamore (or Maple, Oak, etc.)?
I've never actually read MMM, but...
What really torques me is when you make an estimate early in the program,
and you know it's only an estimate,
and since you have only limited information it's not even a very good estimate,
and you give management all of those caveats up front,
it just doesn't matter.
For the rest of the life of the program, better estimates using more information, and even the reality of program execution will all be force-fit back into that original SWAG.
But sometimes even that original SWAG didn't matter, because it might well have been force-fit into some manager's wish-list.
The living have better things to do than to continue hating the dead.
Substitute +2 and 0 for low karma posters, obviously...
Looking back on my posts, I have shedloads of +5s and occasional -1s in a long list of +2s... but very few +3s. Moderation is a runaway process, in which the difference between +5 and -1 is a single modpoint.
Real Daleks don't climb stairs - they level the building.
I estimate that I would end up somewhere in the middle.
Does that imply that you are mean spirited?
As almost every single comment up until now talks about personal experiences or makes stupid jokes, I'm going to critique the method he uses to score an answer. From the second link (find a google cache of it to read it) you can see that he treats each answer and estimate of the accuracy of the answer as a single question - you get a single score from both. I think this approach is fundamentally flawed. Why not instead score the guess (with some sort of algorithm like the one he uses) and then score the guess of accuracy by the same method. Then if you want a single number, add the two together. Right now if you guess well and guess your accuracy perfectly, you get zero points. That is completely out of whack. Instead, using my way you score the best possible score when you guess perfectly and perfectly guess your accuracy, and the worst possible score when you guess horribly and horribly guess your accuracy. The scores move between those two extremes rationally too. As he wanted people who guessed zero error (thought their guess was a perfect guess) to get no points, he obviously had an agenda - that people should be penalized for thinking they are perfectly right. In no way is this an unbiased or useful test.
I submitted this story last night, and it didn't get posted.
I guess it depends on if the chute opens or not
They spend a lot of time on grouping. For example What is 97 + 198? I was taught to add 8 and 7, carry the one etc...
They are taught to group the numbers, the instantly recognize that the answer is close to 300, then see how it differs from the 100s. 97 is 3 less, 198 is 2 less. Now add the 3 and 2, getting 5.
The answer is of course 300 - 5, or 295.
I find this method very intuitive.
I estimate that I would end up somewhere in the middle.
:)
You must not be an American then
Take for example graduating from college. Did you know that there are no "below average" college graduates? Proof: In order to graduate from college you must have a GPA equating to a C or better. A C is average, therefore there are no below average college graduates.
Other estimates that I ask people from time to time. What percentage of the US population is African American (black)? What percentage of the US population has a college degree?
Although the African American question is a little skewed because of the area I live in does in fact have about 30-40% of the population as being black, the national average in 2002 is 13%. I typically get answers that the national average is 30-40%.
The college degree question is also very off. I typically get answers around 50% or higher, where its 27% as of 2003. Its some kind of myth here in the US that everyone has to go to college so they can do unskilled labor the rest of their lives. In fact, my aunt was lecturing her (adult) son that got his girlfriend pregnant with the "How are you going to pay for the kid to go to college?" routine. When neither of her parents went to college, neither her nor her husband went to college, and none of her 2 children went to college.
Ask an American and a Japanese if they are "good in math". The Japanese will typically say "no", the American will say "yes". Ask the same 2 kids to take a standardized math test, the Japanese will score better than the American.
However, although its important to feel good, its more important to look good!
You must not have gone to college then. :)
Yes, you need at least specific average to *graduate*, but then you don't have any assurance of doing so. My wife teaches at a college and I can assure you that there are many D's and F's given out. However, unlike highschool and social promotion thereof, those people either shape up (and retake the class) or ship out (dropping out). Many do the latter (thus "x years college" being an popular answer to last grade completed).
Graduate school is a bit different, since you need a B (3.0) average to remain in it. C's are suspension and lower is removal from the program.
I think the grades represent how some hypothetical "average" community would fair. If you are in college, you *should* fair better than the community, and if you are in graduate school you *should* fair far better than the community. Those who don't shouldn't be at that level.
Sig under construction since 1998.
On a side note, there are many errors made when newspapers, magazines, etc. estimate numbers. Sometimes they will round values before presenting the final number, causing a huge difference. Or they will give some value like $6,021.50 when some of the values have only two or three significant digits. Or they'll make some hideous stats error such as adding two means together and not weighting the scores appropriately. An excellent book that discusses this is John Allen Paulos' "A Mathematician Reads the Newspaper."
I've heard that joke in a somewhat different form:
Q: Why are men so much better at reading maps?
A: Because only the male mind is comfortable with the concept "one inch equals one mile".
A former co-worker was telling us about some of her tutoring experiences. She was helping some high school kids with the concept of estimation. She looked at the ceiling and said you could estimate that it was about 10 feet high. She told them that "the great thing about estimation is that it doesn't have to be the 'right' answer."
So she pointed a car parked nearby and asked one of the students how far he thought the car was. His reply, "50 gallons."
Incredulous, she said that his answer didn't make sense.
"But that's the great thing about estimation! It doesn't have to be right!"
-- Don't Tase me, bro!
Did you know that there are no "below average" college graduates? Proof: In order to graduate from college you must have a GPA equating to a C or better.
That is because grades should be a reflection of a student's mastery of the material, not how a student relates to their peers. There are classes where 70% is an A, not to get more students with A's but because that is the expected level of understanding. In fact, that class had less A's than most others with the typical 90% scale.
Ask an American and a Japanese if they are "good in math". The Japanese will typically say "no", the American will say "yes".
Most Americans feel they are not good at math and ungood at egnlish.
D6 63 0D 70 89 81 BB 8E 7B 7C 5F 5D 54 EA AB 73
This issue has been studied for many decades in order to help organizations minimize losses on bad bids. Courses are taught on this. I took something like this once. There was an exercise to estimate the number of beans in jar. People's guesses fell along a curve called the binnormal distribution. From this equation you can estimate the best price to offer versus other people's bids in order to ocassionally win and make money at it.
In Russia most people overestimate the percentage of people with higher education as well. (Don't have the reference handy, but you probably can't read in Russian anyway - but it's on fom.ru). Also, about 60% of Russians said they want their kids to become scientists - even while the average salary in science is around povery line and everyone knows it.
No offense, but this is the worst In Soviet Russia joke ever.
Do not taunt Happy Fun Ball(TM)