Slashdot Mirror


What Works In Education: Scientific Evidence Gets Ignored

nbauman writes "According to Gina Kolata in the New York Times, The Institute of Education Sciences in the Department of Education Sciences, U.S. Department of Education, has supported 175 randomized controlled studies, like the studies used in medicine, to find out what works and doesn't work, which are reported in the What Works Clearinghouse. Surprisingly, the choice of instructional materials — textbooks, curriculum guides, homework, quizzes — can affect achievement as much as teachers; poor materials have as much effect as a bad teacher, and good materials can offset a bad teacher's deficiencies. One popular math textbook was superior to 3 competitors. A popular computer-assisted math program had no benefit. Most educators, including principals and superintendents, don't know the data exists. 42% of school districts had never heard of the clearinghouse. Up to 90% of programs that seemed promising in small studies had no effect or made achievement scores worse. For example a program to increase 7th-grade math teachers' understanding of math increased their understanding but had no effect on student achievement. Upward Bound had no effect."

27 of 440 comments (clear)

  1. No shocker there by hedwards · · Score: 5, Interesting

    I've yet to see a competently written math book. Most of them are written by and for people with PhDs in mathematics. They'll show one example, fail miserably to explain what they did in any clear way, then later they will refer back to it as what they did in example 3. And the student is expected to be able to figure out what they did. Sure, given sufficient time, a student could reverse engineer the problem, but it's also trendy for teachers to hand out way too many problems as homework, without permitting the students time to understand.

    I remember when I was in middle school and high school, the schools were using "integrated math." Which is to say we didn't have algebra, geometry or trig, we had all of them at once and we would start over again the next year. The problem is that just as we were beginning to grasp one of them, we'd move onto the next subject, and the next year, we'd have to start over as we hadn't mastered the material the last time we saw it.

    1. Re:No shocker there by Cid+Highwind · · Score: 3, Interesting

      I remember when I was in middle school and high school, the schools were using "integrated math." Which is to say we didn't have algebra, geometry or trig, we had all of them at once and we would start over again the next year.

      It's even better when you have to move to a different school district halfway through that program. Having half of a geometry or trig course under your belt is not going to make being dropped into the middle of advanced algebra suck any less.

      --
      0 1 - just my two bits
    2. Re:No shocker there by Anonymous Coward · · Score: 5, Interesting

      I've yet to see a competently written math book. Most of them are written by and for people with PhDs in mathematics.

      Sounds about right - as a programmer, I've always been appalled by how math is taught. If we taught programming the way we taught math, every program would be unmaintainable. Think about it:

      - One letter identifiers for everything. Algebra teaches you to always use x, y, z for variable names. Calculus teaches you to do it for function names. If you run out of those, use greek letters, or just start making up symbols.
      - Everything is named after who discovered it, not what it does. Pythagoras's theorem, Newton's method, L'hopital's theorem, Cartesian co-ordinates, Euler's number...
      - Formulas are always crammed into a single line, without being spaced out. And without any in-line comments. You're forced to try and understand the entire formula in one shot, rather than piece by piece.

      MatLab is a perfect example of why mathematicians shouldn't program. You can look at the source to certain functions (like calculating Euler's number) to see this in action.

    3. Re:No shocker there by MobyDisk · · Score: 5, Insightful

      Obligatory XKCD:
      http://xkcd.com/1201/
      For those not sure why this is appropriate: the hypothetical teacher explains the rule, but not how to apply the rule or what use it is. We have all had professors like this. It is why teaching is a whole separate skill from the trade itself.

    4. Re:No shocker there by operagost · · Score: 3, Interesting

      I pay an awful lot of tax money (and have no kids in school, BTW) for the school district to hire a bunch of test proctors. Yes, I actually expect teachers to teach in grade school and high school! Keeping pace and entertaining the occasional question is for ADULT STUDENTS IN COLLEGE.

      --

      Gamingmuseum.com: Give your 3D accelerator a rest.
    5. Re:No shocker there by Shadow+of+Eternity · · Score: 3, Insightful

      No it's fucking not. We don't pay thousands upon thousands of dollars for an infrequently consulted FAQ. A professor's job is to teach undergraduates a significant and deep understanding of the material, and a graduate professor's job is to expand on that to the point that their students become *producers* of knowledge rather than consumers.

      --
      A bullet may have your name on it but splash damage is addressed "To whom it may concern."
  2. Teacher do not know Mathematics. by jellomizer · · Score: 4, Insightful

    The problem is most education professionals are not so good at understanding Math, and many really do not trust is.

    You go to any college and talk to education majors, and ask them why they didn't major in other majors, after they repeat the normal BS, about wanting to help children yadda yadda, It comes down to the fact that many of the other majors that has a clear career path requires much more Math study, and they don't like Math.

    Sure we have a few educators like Math and Science teachers who get it, but they are the minority, and the ones who seems to get promoted to positions where they can make decisions, are usually History and English teachers. So they don't know about this research is because they are not looking for it, and they really don't want to find it, because the numbers may contradict what you opinion is, and no one likes that.

    We have the State and Unions fighting over these details and little focus on what works.

    --
    If something is so important that you feel the need to post it on the internet... It probably isn't that important.
  3. For once, Dept of Edu gets it right by xxxJonBoyxxx · · Score: 3, Informative

    I took a quick look at the materials they're publishing, and if you can read a vulnerability report, you can read these. (e.g., http://ies.ed.gov/ncee/wwc/pdf/practice_guides/mps_pg_052212.pdf#page=16)

  4. This is sad by Murdoch5 · · Score: 4, Insightful

    Again for the Nth time I'm going to fall back on my personal education experience.

    I had horrible teachers growing up, when I say horrible, all but one of them was even worth her paycheck . An elementary school teacher should be an expert in all areas that they teach.

    In my elementary school ( 1992 - 2000 ) we had one teacher for the entire day, that teacher did math, history, english and etc.... For the school system to effectively work what you need is for that teacher to be an expert in all of those subjects, an expert to the point that they don't require a textbook. The textbook is for the students to assist and supplement the information from the teacher, NOT for the teacher to use as a coverup for not knowing the subject.

    So often we as students were told to close the textbooks and just understand the material well a lazy teacher sat at the front of the room and simply just read from it. A big secret to good education is that the teacher should never be doing the students job, reading from a textbook simple means that the teacher is only as qualified as the student and not really doing his / her job.

    This post talks about the materials that the students can use to assist in there education. Well in my school we had the resources but the teachers and support staff just weren't trained on how to deploy and use the materials. The computer lab was off limits because ALL of the teachers had no clue how to really use them, the science lab was closed because the teachers and staff didn't know how to setup or use the equipment.

    This is my problem with the school system, it's setup to protect the teachers and it leaves the students on the side of the road. I pointed this out in my school several times when I was there and every time I was given an excuse, "The teachers work very hard and it's not there job" or "The government wants us to teach this way so we are". It's sad and horrible, the school system ( in Canada ) is in the shitter. I have little cousins right now and from what they tell me the system hasn't changed.

    So what's my point? Well here is the big secret to making the education system work, HIRE QUALIFIED TEACHERS AND GET THE RIGHT MATERIAL IN PLACE!!!!!! That's it, it hasn't happened yet at least from what I've seen and been through. Simple answer to a not complicated question.

    To any teacher that doesn't fit into what I just explained I don't want to bash you. I know good teachers and good school exist, they do and they are great, just the majority of the system is broke and that shouldn't make the good few look bad.

    1. Re:This is sad by multimediavt · · Score: 4, Interesting

      I went through grade school from 1977-1985. Most of that was spent in San Jose, California as Silicon Valley exploded. I had great teachers and an amazing Gifted and Talented education program. The teachers were completely versed in all the subjects they taught: history, English, math, sciences. They were paid poorly and some had second jobs. The school system was ok, but this was before most of the budget cuts that happened under Reagan. In 1983 we moved to Virginia where the system didn't know what to do with me (I was doing math and english a level higher than everyone else in this system) and as a result I had to take sixth grade math and English again. That really tilted the scales of me ever liking the Virginia educational system. It was funded better, but did less with it as you saw 15 years later with your experience. The good teachers dried up in k-12 because they could stay in school as long or a little longer and become university or college professors, or become researchers or consultants. All these vocations pay better and have better benefits, so as the k-12 budgets get cut less qualified people want those jobs. So, the downward spiral begins. When the measure of life is done in currency this problem with k-12 education shall remain. The good, qualified teachers that are in the system today are not there for the money. Hopefully, they have well paid spouses or enjoy a meager life doing what they love. These people are few and far between, however.

    2. Re:This is sad by Notabadguy · · Score: 4, Interesting

      My college experience was USMA (West Point).

      Most faculty at military academies are also military officers. My freshman year, my instructor both looked and sounded like Major Payne.

      Epic instructing example #1: (Read the instructor lines in Major Payne's voice)

      The entire classroom is instructed to take to the chalk boards and work out a problem. Our instructor left the room to give us time to work on it. He returned 10 minutes later (everyone was stuck - no one had solved it). He addressed me.
      Instructor: "Cadet! What is the answer?"
      Me: "Sir, I do not know!"
      Instructor: "Well, if you DID know the answer, what would it be?"
      Me: "Sir, I do not know!"
      Instructor: "You have all failed me! Class dismissed."

      No answer, no walk-through...he didn't know either. I went to his office at the end of the day with my textbook, because I couldn't follow the logic in one of the example problems in the text-book.

      Me: "Sir, I am stuck on this example problem. I don't understand the progress from Step B. to Step C.:
      Instructor: "Read it again!"
      Me: *reads again* "Sir, I still don't understand how to get from B. to C."
      Instructor: "Read it again!"
      Me: "Sir, I have read it again, and don't understand it!"
      Instructor: "Then you have failed me! Your personal failure train is now departing my office! Chugga-chugga chugga-chugga Wooo wooooooooo!"

      The highest grade in my class at mid-terms was a D, which is failing at West Point. I passed with a B- by spending my free period sitting in the back of the class of another instructor teaching the same material, and soliciting that instructor's help during lunch and after classes to understand the material.

  5. Re:D.A.R.E has no benefit by Brett+Buck · · Score: 4, Insightful

    "Scarce dollars"? There has been literally trillions of dollars poured into public education over the past 50 years, An absolutely insane amount of money is still being spent - but the quality continues to decline. Anyone who cares about education needs to get this through their head - *money does not solve this problem*. The issue is lack of standards, lack of quality teachers, and endless ivory-tower meddling in the educational process. None of those are solved by money.

  6. So much does not work by EmperorOfCanada · · Score: 4, Interesting

    Very often every system in education becomes hijacked by some interest group. Textbooks are a great example. Looking through my daughters' very expensive textbooks I can see that the science and math textbooks were written by non mathematician/scientists. One of my favorite questions went something like Jamal has 5 candies that are 5 different flavours; how can he distribute them among his 5 friends? Write all the ways. WHAT? Or just the usual questions that are missing some element such as you have a triangle that is 2 units on the bottom side and 3 units high. How long is the remaining side? But there is no picture of the triangle. Is this a right-triangle. Are they talking about the hypotenuse? And then one of the best. A grade 10 math textbook with a section on parabolas. My daughter was assigned the usual questions 1-20 at the end of the chapter. I don't quite remember how to find the vertex or some such so I leaf through the textbook to find out how. All it does is define the parabola and give some examples of how they can be used for things like flashlight reflectors. But absolutely no math involving the parabolas. None. Lots of parabola questions but no math. This was not some kind of workbook but a textbook where they had just been sloppy.

    Then there is the technology. They are so lost. So so so lost. They have just grasp at technology. The usual result is that they buy big systems where moodle would be fine. But at no point do they really leverage the technology much. A great example is both of my daughters' schools have robocalls to tell me about things like vaccinations, school trips, etc. This is very annoying in that the calls usually waste most of the call telling me things that I don't care about. The worst part is that the critical bits are at the end. So I hear about things like congratulations to some student for winning a sack race in Kalamazoo and then in the end learn that some critical form needs to be turned in by 9am the next morning. Hello please use at least email. Maybe a website? The 20th century is calling and wants their robocaller back! I wonder how much they pay for this service?

    But there is a wonderfully effective way to use computers in education. You look at student's marks. You then look at the pattern of the marks as the student's pass through various teachers. I am not talking about standardized tests but just comparing the marks of various students in the same classrooms. The key being that you can see that when a batch of students hits a truly great or terrible teacher that their marks will thrive or suffer for years to come. Bad teachers are like boulders in the stream; they result in much turbulence and waves far beyond their position in the time stream. Both of my daughters hit the same terrible math teacher. I tutored both of them past this disaster of a teacher but many of their co-students may have lost any hope at a career in STEM as their grade 10 math would then suck with little time left to recover to the point where they could leave HS with a good mark in Pre-cal let alone Calculus.

    1. Re:So much does not work by JWW · · Score: 5, Insightful

      But there is a wonderfully effective way to use computers in education. You look at student's marks. You then look at the pattern of the marks as the student's pass through various teachers.

      What?!!! That would allow you to actually truly measure teacher performance and effectiveness. It would make bad teachers absolutely impossible to miss.

      WE CAN'T HAVE THAT NOW CAN WE???

  7. Re:D.A.R.E has no benefit by Jawnn · · Score: 4, Insightful

    "Scarce dollars"? There has been literally trillions of dollars poured into public education over the past 50 years, An absolutely insane amount of money is still being spent - but the quality continues to decline. Anyone who cares about education needs to get this through their head - *money does not solve this problem*. The issue is lack of standards, lack of quality teachers, and endless ivory-tower meddling in the educational process. None of those are solved by money.

    Yes, scarce, but that's rather beside the point of TFA. So are "quality teachers" and 'ivory-tower meddling" (whatever the fuck that is). TFA seems to make a case for spending more wisely, like buying teaching materials that actually work, or more fundamentally, becoming aware that the data to guide such purchases even exists. Such lack of awareness is inexcusable, but clearly, it is pervasive. How's about we work on that problem instead of parroting the same tired shit you hear on Faux News?

  8. Just BS from teacher's unions by walterbyrd · · Score: 3, Interesting

    For example: Korea has huge class sizes, and they kick our ass in math and science.

    Propaganda from teacher's unions always say to just, randomly, throw money at the problem.

    1. Re:Just BS from teacher's unions by wickerprints · · Score: 4, Interesting

      I personally have had teaching experience in the US at the high school level, and as an Asian-American, I don't think it's BS. Korea is a different country with very different cultural attitudes towards the value of learning, parental responsibility for child rearing, and the importance of fostering individuality rather than collective standards of behavior, compared to the US. Therefore, educational and classroom models that apply in Korea may not apply in the US, and vice versa. You cannot assume that just because a different model exists and is successful, that other models must be intrinsically flawed.

      Look at what American kids are like, and compare that with Korean kids. You will find they hold very different notions of acceptable social behavior. You'll also find that Korean students are FAR more respectful to their teachers, not necessarily because Korean teachers are more knowledgeable or strict or experienced, but because Korean society as a whole places much more value on the educational process. The parents drill it into their kids, and the kids see the evidence of what constitutes a successful future in how their society rewards those who emerge at the top with respect to higher education. This is also true of China, Japan, and Singapore, among other Asian (and non-Asian) nations.

      Take a Korean teacher and put them in front of a class of 30 American students, and see how long their pedagogical and disciplinary model lasts. American students know that they can't be punished and ultimately can't be held accountable for their own bad behavior--the worst that can happen is their parents have to discipline them at home, and how many American parents, with their own lack of self-control, really have what it takes to do that?

  9. Re:Story from my Math teacher 20 years ago by istartedi · · Score: 4, Informative

    When I was struggling with calculus my first year, and a lot of concepts hadn't gelled, I had an idea. I decided to go to the library and see if there were any better calculus texts. I found Calculus Made Easy and believe it or not, it actually made good on its promise. I aced my first semester calculus exam, with much thanks to that book. The biggest take-away was that they actually showed the relationship between summations, limits, and integrals. All of that material had been covered by other texts, and by teachers of course; but they had never related it. The "genius" of the invention of calculus was in that relationship, not just a bunch of dry examples of limits, series, and integrals.

    And yes, this was actually more than 20 years ago. The copy I read was dug from the depths of the multi-story engineering library stacks at UVa, and even then it was an old copy. Now you can probably download it...

    --
    For all intensive purposes, "whom" is no longer a word. That begs the question, "who cares"?
  10. Richard Feynman on textbooks by MobyDisk · · Score: 5, Informative

    Richard Feynman's story on textbooks was eye-opening: http://www.textbookleague.org/103feyn.htm
    (Thanks BobTree)

  11. Variable students by gurps_npc · · Score: 5, Interesting
    Part of the problem is that what works for one student doesn't always work for another.

    You can't expect a child with dyslexia to learn from the same program that works for an excellent reader. Less serious learning issues have similar effect.

    One thing I never understood is why we don't have a public boarding school option for those kids whose parents clearly are the problem.

    If your parents are homeless, drug addicts, or convicted felons, you have about a 50% drop out rate. If we just offered them public boarding schools, we could save those kids - at far less cost over the long term than what those drop outs will end up costing the government.

    Boarding schools can go for as low as $25k / year, vs regular schools at half that while a year in prison costs over $100k If just save just one out of 8 of those kids from a life of prison, we come out ahead.

    --
    excitingthingstodo.blogspot.com
  12. Re:Creation by RazzleFrog · · Score: 4, Insightful

    If you mean climate control then there are overwhelming boatloads of scientific evidence if you look for it. Years of data compiled and analyzed.

    And what do you mean "supports the Bible"? I mean the bible doesn't even support itself with all the endless contradictions. There is no science in that. Not sure what SD is.

  13. Re:Creation by RazzleFrog · · Score: 4, Insightful

    The problem in Texas is that they ARE trying to influence the textbook companies and since they are one of the largest purchasers of textbooks they actually could potentially have some success. Except for the whole separation of church and state thing that keeps kicking their ass in court.

  14. Re:Story from my Math teacher 20 years ago by NJRoadfan · · Score: 3, Funny

    I can see why it was buried. You wouldn't want students finding out about a textbook that is only $17! There is no profit in that.

  15. Re:D.A.R.E has no benefit by Baron+von+Daren · · Score: 3, Insightful

    I don’t want to get into a huge tangent on this topic, but rest assured there are plenty of school districts in the US that don’t have enough money. While I agree that throwing money at these districts indiscriminately won’t solve anything, it’s pretty hard to build a quality educational systems without sufficient funding. This is especially true in districts where the educational system has to contend children who have difficult home lives and parents who are themselves undereducated. Money certainly can't solve the problem, but it is a significant part of the equation.

    We live in a society where those who sell children toys make exponentially more than the people who educate children. That a very simplistic statement, but it touches on the matter of our shared social value system. This gets into a lot of issues concerning market based vs universal public education, but, again, that’s a tangent. The major point is simply that when we move beyond lip-service and rhetoric, education isn’t a core value for our society.

  16. Re:D.A.R.E has no benefit by alexander_686 · · Score: 5, Insightful

    Maybe.

    There was a study about 10 years ago that showed zero correlation between teacher pay, teacher effectiveness, and academic results between states.

    Probably what is more important is teacher requirement, training, and management. If you increased teacher pay today without changing the above you would increasing pay to those who are already teachers or are likely to become teachers.

    I have issues with how teacher’s pay is structured. The initial pay is low and most of the benefits are at the backend so it encourages marginal teachers to become entrenched and discourages middle aged people from making a career switch into the profession. (I think there is a rich vein of potential people who hold masters in math, science, or engineering who would make great teachers but don’t want to deal with the initial low pay and would not qualify for some of the bigger retirement packages.)

  17. Re:D.A.R.E has no benefit by bmajik · · Score: 3, Interesting

    I have issues with how teacherâ(TM)s pay is structured. The initial pay is low and most of the benefits are at the backend so it encourages marginal teachers to become entrenched and discourages middle aged people from making a career switch into the profession. (I think there is a rich vein of potential people who hold masters in math, science, or engineering who would make great teachers but donâ(TM)t want to deal with the initial low pay and would not qualify for some of the bigger retirement packages.)

    I think this is pretty insightful.

    I recently joined a team of other MS employees teaching Intro to CS at a local public highschool. We're bootstrapping the in-service teacher along with the students so that hopefully she can teach the class herself in the future.

    htttp://www.tealsk12.org

    People who have come up into CS in the "normal way" and who can do CS can make more money straight out of college in the industry than can ever be made in a lifetime of public K-12 education. And for software people who want to make the switch into K12 later in life when they are financially independent; there are a number of tiresome barriers that prevent them from really doing so.

    --
    My opinions are my own, and do not necessarily represent those of my employer.
  18. Re:D.A.R.E has no benefit by Baron+von+Daren · · Score: 3, Interesting

    The market forces that bear upon the toy industry do not apply to universal education. If an individual toy company fails, the impact on society is negligible; not so with the national educational system. I made the comparison to emphasis our social value system.

    My original point was that proper funding is a necessary condition for a quality educational system, though it is not sufficient. In other words there are reasons our educational system is failing aside from funding, but the answer is not to cease funding the educational system properly.

    This is somewhat of a tangent from that point, but since the market comparison has been made, I feel it is important to emphasis the need for public funding of the primary educational system. It is in the public interest to have an educated citizenry, and it is incumbent upon all citizens to both fund the educational system and have a stake in its efficacy. Markets are not well suited to provide a quality universal education system. Markets are excellent at providing quality private schools that augment the base educational system because individuals have a clear and direct incentive to fund the education of kin (kin used here in the broader anthropological sense which exceeds blood relations). There isn’t as clear an incentive to fund the education of perfect strangers. The educational level of perfect strangers, however, is a kind of externality: the educational level of perfect strangers directly impacts the prosperity of the larger society. Moreover, the children who generally need the most educational resources come from families that have the least ability to fund their children’s education.

    That isn’t to say that market concepts like incentives, competition, etc. aren’t important in the educational system, but they have to applied in the framework of a publicly funded, universal educational system. Educators should compete for incentives commensurate with the social gravitas of their role. That’s where I got into the point about shared social values; our society underestimates the gravitas of public education when it comes down to things like funding. Educators should be more respected and better compensated, thus incentivizing competent individuals to excel in the service of public education. It’s kind of naive to expect enough educators to excel purely out of a passion to educate (though that shouldn’t be underestimated either).