Slashdot Mirror


U.S. Students Struggle With Reasoning Skills

sciencehabit writes "The first-ever use of interactive computer tasks on a national science assessment suggests that most U.S. students struggle with the reasoning skills needed to investigate multiple variables, make strategic decisions, and explain experimental results. The results (PDF) are part of the National Assessment of Educational Progress that was given in 2009 to a representative sample of students in grades four, eight, and 12. What the vast majority of students can do, the data show, is make straightforward analyses. More than three-quarters of fourth grade students, for example, could determine which plants were sun-loving and which preferred the shade when using a simulated greenhouse to determine the ideal amount of sunlight for the growth of mystery plants. When asked about the ideal fertilizer levels for plant growth, however, only one-third of the students were able to perform the required experiment, which featured nine possible fertilizer levels and only six trays. Fewer than half the students were able to use supporting evidence to write an accurate explanation of the results. Similar patterns emerged for students in grades 8 and 12."

42 of 488 comments (clear)

  1. No suprise there by Hatta · · Score: 5, Insightful

    US adults struggle with reasoning skills too.

    --
    Give me Classic Slashdot or give me death!
    1. Re:No suprise there by MyLongNickName · · Score: 5, Funny

      Blatantly false. Since US kids have a problem with reasoning and I am not a kid I must not have reasoning problems.

      --
      See my journal for slashdot ID's by year. Mine created in 2005. http://slashdot.org/journal/289875/slashdot-ids-by-year
    2. Re:No suprise there by Austerity+Empowers · · Score: 4, Insightful

      I ain't paid to reason, I paid to go to meetin's.

    3. Re:No suprise there by Anonymous Coward · · Score: 4, Insightful

      Broader than that: Humans struggle with reasoning skills.

    4. Re:No suprise there by game+kid · · Score: 4, Funny

      As a corollary, because these reasoning-challenged kids' brains are obviously made of wood, they are witches and must be burned.

      My goodness, I think your logic has saved America!

      --
      You can hold down the "B" button for continuous firing.
    5. Re:No suprise there by cpu6502 · · Score: 5, Informative

      :"Dangers of a Salaried Bureaucracy," 1787

      "Sir, there are two passions which have a powerful influence in the affairs of men. These are ambition and avarice; the love of power and the love of money. Separately, each of these has great force in prompting men to action; but, when united in view of the same object, they have, in many minds, the most violent effects."
      Benjamin Franklin

      --
      My AC stalker: " I personally agree with your posts most of the time, but that won't keep me from modding you troll"
    6. Re:No suprise there by ZonkerWilliam · · Score: 3, Insightful

      Tests are not about reasoning, but knowing the information.

      I believe you have it, a lot of the youths I talk to rely on facts and do not try to "figure" it out on their own.

      I think it's the biggest danger for youth today, this prevents them from going into the sciences or engineering.

    7. Re:No suprise there by Mike+Buddha · · Score: 4, Insightful

      It's fascinating to see this poor reasoning played out on this very forum right now, right before our very eyes.

      --
      by Mike Buddha -- Someday the mountain might get him, but the law never will.
    8. Re:No suprise there by catchblue22 · · Score: 4, Interesting

      Broader than that: Humans struggle with reasoning skills.

      I would suggest that your comment indirectly implies an important root of the problem. Many in the social sciences attempt to study human society as if it were an ant colony, from a distance, as if the observer is separate from the observed. As we look at human beings and their foibles and faults, we seem to be led to the conclusion that humans are nothing like what we would wish. We don't seem to be rational. We often don't seem to be moral. We in fact seem to be rather despicable creatures. Leaving it at that, we are tempted to throw up our arms and say "to hell with humans, we are beyond help". All our idealism, our attempts to be rational, to be good seem hopeless and futile.

      However I would like to take this further. Humans tend to be irrational. Humans tend to be selfish evil creatures. Our natural tendencies imply that we must try harder to overcome them. Because we tend to fall into irrationality, we must fight to be rational. Because we tend to be selfish and shallow means that we must try our best to nurture "the better angels in our nature". We will never "win" this battle. We will never vanquish evil and selfishness. But if we try, maybe, just maybe we can make our civilisation into a system that gives most of us a better and more fulfilling life.

      --
      This and no other is the root from which a tyrant springs; when first he appears as a protector - Plato (423 to 327 BC)
    9. Re:No suprise there by Gilmoure · · Score: 3, Funny

      Americans are dumb.

      Really? From what I've seen Americans are great at talking. It's getting them to shut up that's the problem. Now, are Americans stupid? I can see that being argued successfully.

      --
      I drank what? -- Socrates
    10. Re:No suprise there by internerdj · · Score: 4, Interesting

      Interestingly enough, the study separates Catholic schools from other private schools. I didn't see a reference to grade 12, but at grades 4 and 8 Catholic schooled children outperform publicly schooled children and are on par with privately schooled children. I don't know the statistics about how many Catholic schooled children grow up to be active Catholics; it seems like you have a better shot of being good at reason if you are trained by them.

    11. Re:No suprise there by formfeed · · Score: 4, Funny

      It's fascinating to see this poor reasoning played out on this very forum right now, right before our very eyes.

      I don't get it.

  2. Misleading headline? by djlemma · · Score: 4, Insightful

    The headline implies that US students have more difficulty with reasoning skills than other students as a whole, or that this difficulty is unique to students from the US. I could easily imagine that these skills are lacking for students around the globe...

    1. Re:Misleading headline? by thepike · · Score: 4, Insightful

      Agreed, I'd like to see the scores from other countries.

      Also, I'd like to see this with adults in different professions. For instance, are scientists better at this than artists? And what about creativity scores?

      My gut says that a) all children will probably not be great at this and b) adults probably aren't either. And sadly it probably doesn't match up as well with profession as we might like. I'm a molecular biologist and plenty of my colleagues would probably struggle with these tasks. I wish I could take the test to see how I do (but I'm also afraid I would fail miserably).

    2. Re:Misleading headline? by Korin43 · · Score: 4, Insightful

      Reasoning is required to be a scientist.

      It may be required to be a good scientist, but not to get a job as one.

    3. Re:Misleading headline? by djlemma · · Score: 4, Insightful

      I never presented any evidence, my point was that the study never collected any data about other countries in the first place. Thus, I don't approve of using a wording that singles out the US as being inferior somehow, when there's really not data (in this study) that implies any such thing. The article also mentions that they hadn't collected this particular data before, so they can't even compare to how US students did 10 years ago, or 5 years ago, or any such thing.

      Also, judging by the article, the announcement seemed to boil down to "Students have an easy time with easy questions, but a harder time with hard questions."

    4. Re:Misleading headline? by Em+Adespoton · · Score: 3, Insightful

      Maybe these 4th graders would perform better if someone simply SHOWED them how to determine which of 6 fertilizers is better. Maybe a class called "Lab" would be appropriate to fix this deficiency.

      Yes... because after that, they would know exactly how to determine which of those 6 fertilizers is better in each of those lighting situations.

      Really... I was frustrated with this back when I was in grade 4; teachers encouraged learning specific processes to solve specific problems, and most kids couldn't figure out what to do when stuck in an unfamiliar situation. This wasn't all that surprising, considering grade 4 is about the age where this kind of reasoning ability starts to develop, given a favourable development environment. I remember struggling with basic maths in grade 4, but having no difficulties (other than mathematical errors) completing the problem solving steps. I went socratic on my classmates who didn't have a clue where to begin.

      Maybe these 4th graders would perform better if someone simply SHOWED them how to question the steps of the process, and ask about parts they didn't understand, instead of pretending they already knew everything about it that was worth their time understanding and focus instead on getting the "winning answer". And yes, s/4th graders/humanity/.

    5. Re:Misleading headline? by russotto · · Score: 3, Interesting

      Case in point: scientists mentioned above believe that not being able to test 9 discrete choices with only the capacity to test 6 discrete choices is somehow a failure. Sure, you could test a few choices and extrapolate what the results of the missing choices might be, but you can't conclusively determine something you haven't tested.

      It's not obvious from the interface they give, but you can do it given a few (true) assumptions. The key thing is to note that you can do multiple experiments as long as the total is only 6 trays. The assumptions are that
      1) There is only one optimum fertilizer value, and it's one of the testable values
      2) If you're off by one, plants will grow better than if you're off by more than one.

      Given this, you just test 2,4,6, and 8. If one seems best, test the values on either side of it and pick the best of the three. If two seem equally good, you know the answer is between the two (but test it anyway).

  3. Obviously by KraxxxZ01 · · Score: 3, Funny

    game developers are to blame for making games too easy and mentally unchallenging.

  4. Too much time spent teaching tests by sandytaru · · Score: 4, Insightful

    -- instead of teaching them how to actually think.

    --
    Occasionally living proof of the Ballmer peak.
    1. Re:Too much time spent teaching tests by elsurexiste · · Score: 4, Funny

      ...teaching them how to actually think.

      Fascist!

      --
      I rarely respond to comments. Also, don't ask for clarifications: a brain and Google are faster, believe me!
    2. Re:Too much time spent teaching tests by CannonballHead · · Score: 5, Insightful

      I see a lot of comments about "schools don't teach you to think anymore." On the other hand, you can't reason the right answers out if you have the wrong basis (facts, memorization, etc.). It's like saying that elementary school math doesn't teach you how to solve large multiplication problems anymore, they just teach times tables! ... but it's hard to do a multiplication problem without knowing what 6 * 8 is off the top of your head. Memorization of some things is extremely important to reasoning skills.

      I also wonder if it has to do with books. Reading is out, other forms of media is in. Visual media doesn't make you think a whole lot. Even adults that do think can watch a movie, totally zone out and entirely ignore how things are presented, what views the movie is expressing (if any), whether or not it's realistic in any way, etc. Some movies push you to think; most, though, push people to turn off their brains.

      And since visual media (games, TV, movies, etc) are getting more and more prevalent ... I wonder if the lack of reasoning and thinking is related to the lack of necessity of imagination that is stimulated through reading books?

    3. Re:Too much time spent teaching tests by mcgrew · · Score: 4, Funny

      DOH! 6*4 is 48. I suck...

  5. Congratulations by Anonymous Coward · · Score: 4, Insightful

    After billions of dollars we have produced an education system churning out children that cannot think for themselves.

  6. What do you expect? by Lucas123 · · Score: 4, Insightful

    Multiple choice, standardized tests don't promote reasoning, just memorization. It's time we revamp the education system and our testing methods. Let's focus on students completing lengthy projects and being graded on their success.

    1. Re:What do you expect? by gstoddart · · Score: 4, Interesting

      Multiple choice, standardized tests don't promote reasoning, just memorization.

      You're not kidding.

      I took a first year logic/critical reasoning class later in university because I still needed a first year credit and that sounded interesting.

      We were talking about confidence intervals ... and confidence interval of 0.05 meant you were 95% sure. On the exam, the question asked about a confidence interval of 0.5, which I answered as 50% sure.

      The professor marked it wrong, and said that since we'd only covered 0.05 in class, it was a typo -- nobody was expected to know about 0.5. I told her that since it was a class on critical reasoning, she was an idiot and demanded she mark my correct answer as correct. I had to go to the department head to get her to do it.

      When the teachers can't follow reasoning, how the hell are they supposed to teach it? In this case, she was expecting blindly repeating the example from class, not doing any thinking (even though as written all of the people she marked right couldn't have been).

      --
      Lost at C:>. Found at C.
    2. Re:What do you expect? by BetterSense · · Score: 5, Insightful

      I still remember getting this one wrong in grade school:

      How many 'states of matter' are there?
      a) 1
      b) 2
      c) 3
      d) 4

      I would answer 4--Solid, Liquid, Gas, Plasma--because I read books. But we weren't expected to know about plasma, so the correct answer was always 3, and I was marked wrong. The teachers never gave me credit, because I don't think they knew what a plasma was either.

    3. Re:What do you expect? by TemperedAlchemist · · Score: 5, Informative

      Well, there are far more than four, if we're to get technical. For the correct answer to be three, the test would have to indicate that it's referring to classical states, but if it merely asked for states of matter, none of those answers are correct.

    4. Re:What do you expect? by TemperedAlchemist · · Score: 3, Informative

      The three classical states are so grouped because each can change into any of the others. You probably are already familiar with freezing/melting and vaporization/condensation, but may not be familiar with sublimation or disposition.

      Plasma is grouped as a high-energy state of matter, apart from the other three, because only a gas can undergo ionization and become plasma (and a plasma can undergo deionization to become a gas). Another high-energy state is quark-gluon plasma (not to be confused with typical plasma).

      Low-temperature states (consequently low-energy, but I refrain from calling it this directly) are on the other side of the spectrum. Perhaps the best example is superfluid, created when matter is cooled close to absolute zero. It has some pretty interesting properties, among the most prominent being infinite fluidity and infinite thermal conductivity.

      Also a low-temperature state, Bose-Einstein Condensate, is when the matter stops behaving like you would expect it to (separate particles) and instead in a quantum state.
      --

      For obvious reasons, you can see why these other states of matter aren't included in third grade textbooks, since many of them require some higher level mathematics and understanding of physics to begin to understand. Plasma is sometimes included early on because it is easier to explain and very common in everyday life (fire, electricity).

      But that doesn't vindicate teachers from teaching it wrong. Adding the word classical can make a whole world of difference when later they're taught about additional states, and doesn't leave the impression that those three are the only states of matter. It's akin to an elementary teacher telling children that rational numbers are the only numbers there are (irrational numbers are very real, so too are unreal numbers and hyperreals). Just because you can't explain something doesn't excuse you of teaching it wrong.

  7. There are solutions: Philosophy is one by ohnocitizen · · Score: 3, Informative

    http://en.wikipedia.org/wiki/Philosophy_for_Children

    Philosophy can be integrated into the curriculum as early as Elementary school, and has wonderful effects that extend beyond developing reasoning skills.

  8. Re:No Child Left Behind Sucks. by h4rr4r · · Score: 4, Insightful

    Why did that surprise you?
    Teachers are doing a job. If that job is evaluated based on standardized tests, they will make sure that job is done well.

    Do you not work for income? Would you not focus on the parts of your job that are actually evaluated?

  9. The death of logic by snarfies · · Score: 5, Interesting

    Noted sci-fi author John Barnes recently wrote something about this in his blog: http://thatjohnbarnes.blogspot.com/2012/06/hobo-queen-of-sciences.html

    tl;dr version (though its quite a good read, as his books that I have read so far): Girl in her class tried using angry pounding shouting as a debate tactic, and when asked about it, she declared it was "logic." "I was totally logical. I pointed things out real loud and told people they were dumb if they didn't believe it, and I yelled so they'd get the point."

    Yeah. Back in my day "Logic" was a little bird tweeting in the meadow, nowadays its "agrees with me."

    1. Re:The death of logic by Johann+Lau · · Score: 3, Funny

      Oh wow. You know, the people in Idiocracy are at least likeable.... what will actually happen might be so much worse. Also, it will not take 500 years, no siree bob.

  10. No experience with the utility of reason by russotto · · Score: 5, Insightful

    Kids live in a world even more arbitrary and capricious than that of adults. This is especially true in primary and secondary school. Why, then, would they develop reasoning skills? Those that do end up challenging authority and getting arbitrarily slapped down, so there's negative incentives as well as a lack of positive ones.

  11. Re:Let the public education by Anon-Admin · · Score: 5, Interesting

    But you are assuming that a government run school wants to produce students who can think critically.

    If they did, then these people may actually ask the hard questions. "Why are you in office if all you do is lie to the public, cheat to get ahead, and steal from the public coffers?", "Why is the drug scheduling system based on "Potential for abuse" and not "Danger to the health of the individual?", "How can you violate the 4th amendment to the constitution by passing security acts and not amending the constitution?"

    See, they don't want people who can think. They want people who will shut up and do what they are told.

    This from someone who's daughter asked the hard questions in school about drug policy. Thus he was visited by the police to discuss it in detail. (Not a drug user but the mere argument was enough to get them to stop by for a chat.)

  12. Teach Logic by dcollins · · Score: 4, Insightful

    I'm coming around to the opinion that we've got to teach logic at a very young age, as was done in classical education. Ultimately it's the foundation to all of math and the scientific method. If the first time you study basic logic is in college, then your entire education is built on shifting sand.

    --
    We know where leadership by an anti-intellectual "strongman" who scapegoats minorities and likes boisterous rallies goes
  13. Never would have guessed by MrEricSir · · Score: 4, Funny

    After watching the Republican primary debates, I certainly NEVER would have guessed that Americans had poor reasoning abilities.

    --
    There's no -1 for "I don't get it."
  14. Re:Let the public education by __aaeihw9960 · · Score: 5, Interesting

    Do you know why they teach to the lowest common denominator?

    Let me tell you a story that happened just this year:

    We have an autistic student in the grade directly below the one I teach. Low-functioning, highly aggressive and combative, generally a disruptive force in the classroom. When we present the principal, then superintendent, then school board with evidence, research and suggestions, they all agree that he needs to be in a self-contained classroom. Realistically, what this kid is getting != what he's taking away from every other student during the day. So, we call a meeting with the parents, special needs advocate and a ROE representative just to cover all of our bases. What do the parents also bring to the meeting? A lawyer. A lawyer from ~ 600 miles away from the nearest urban center (yes, the words big city lawyer come to mind). Why? Because if we pulled their child away from his friends (he has none), then they would sue fast, sue hard, and sue often.

    In this day of reduced spending, teachers being paraded around like well, like someone that's paraded around for public scorn, what choice did we have?

    Realistically, the other 25 sets of parents should be able to say, "no, you assholes, your child does not get to sap mine." BUT, because we can't tell anyone about what specifically transpired in these meetings using names and what-not, no one knows. All they know is that there are 25 little kids that already hate school, because of one precious little snowflake.

  15. Suh-weet! by Abalamahalamatandra · · Score: 5, Funny

    I'll be 44 in a couple of weeks.

    Another name for this is "job security".

  16. So? by wcrowe · · Score: 4, Insightful

    I just have to ask, is it really reasonable to assume that everyone should have great analytical skills? The study says that about one third of the students had the necessary reasoning skills. This sounds about right to me. Most people are not very analytical. This is why professions that require good analytical skills (medicine, engineering, law, etc.) tend to pay good wages.

    Anyway, this study would be more interesting if we could compare current results with results from the past, or results in other countries. As it is, it's about as interesting as saying, "One third of students were over five feet tall." Without some sort of context to put that in, we can only speculate on its significance.

    --
    Proverbs 21:19
  17. Big surprise? by Kaz+Kylheku · · Score: 3, Insightful

    Most people are not going to become scientists. At the elementary school level, people are not yet pre-selected for thinking roles; you're looking at basically a more or less random sample of the population.

    Out of a thousand elementary school kids, how many will become scientists, engineers, etc?

    Now if, say, third year engineering students across the USA are were found to be struggling with reasoning skills, oops, that would be troubling news.

    Unfortunately for those kids who are struggling with reasoning, though, a lot of the kinds of jobs that they might have easily gone into after high school fifty years ago are now overseas.

  18. Overly critical. by MaWeiTao · · Score: 5, Insightful

    Anyone who thinks American students are bad with reasoning obviously hasn't spent much time outside the country. Those people haven't seen anything, especially Asia. And the problem isn't just reasoning skills, it's simply entertaining your own opinion as opposed to trying to please a superior. I've been in situations where an employee was asked what they thought about something and they'd sheepishly avoid the answer. Even when pressed they seemed unable to come up with a response. Lack of creative and independent thinking continues to be a problem, even in Japan.

    That said, I think America is moving too far in the opposite direction. Sometimes rote memorization essential. And you need standardized tests to glean some sort of progress. They might not be perfect, but there's no better alternative.

    The fact of the matter is that you need the fundamentals before you can progress. It's similar to artistic technique. Too many people hide behind the label of modern art to excuse their lack of talent. In order to have flexibility you need underlying ability. It's essentially the same principle here. And the fact is that kids don't necessarily have the knack for reasoning that people acquire with age. So why waste excessive amounts of energy trying to drill that into them?

    But certainly, Americans have the ability to think independently and creatively. And I find them to generally be better informed and less prone to falling for myths, urban legends and other such nonsense. I'll concede, it could be the part of the country where I live. But overseas and amongst immigrants I've found that the consensus is that the US has the best educational system in the world.