Slashdot Mirror


Huge Study Finds Professors' Attitudes Affect Students' Grades (arstechnica.com)

A huge study at Indiana University, led by Elizabeth Canning, finds that the attitudes of instructors affect the grades their students earned in classes. The researchers conducted their study by sending out a simple survey to all the instructors of STEM courses at Indiana University, asking whether professors felt that a student's intelligence is fixed and unchanging or whether they thought it could be developed. Then, the researchers were given access to two years' worth of students' grades in those instructors' classes, covering a total of 15,000 students. Ars Technica reports: The results showed a surprising difference between the professors who agreed that intelligence is fixed and those who disagreed (referred to as "fixed mindset" and "growth mindset" professors). In classes taught by fixed mindset instructors, Latino, African-American, and Native American students averaged grades 0.19 grade points (out of four) lower than white and Asian-American students. But in classes taught by "growth mindset" instructors, the gap dropped to just 0.10 grade points. No other factor the researchers analyzed showed a statistically significant difference among classes -- not the instructors' experience, tenure status, gender, specific department, or even ethnicity. Yet their belief about whether a students' intelligence is fixed seems to have had a sizable effect.

The students' course evaluations contain possible clues. Students reported less "motivation to do their best work" in the classes taught by fixed mindset professors, and they also gave lower ratings for a question about whether their professor "emphasize[d] learning and development." Students were less likely to say they'd recommend the professor to others, as well. Is it possible that the fixed mindset professors just happen to teach the hardest classes? The student evaluations also include a question about how much time the course required -- the average answer was slightly higher for fixed mindset professors, but the difference was not statistically significant. Instead, the researchers think the data suggests that -- in any number of small ways -- instructors who think their students' intelligence is fixed don't keep their students as motivated, and perhaps don't focus as much on teaching techniques that can encourage growth. And while this affects all students, it seems to have an extra impact on underrepresented minority students.

29 of 136 comments (clear)

  1. Bull by TheMeuge · · Score: 4, Insightful

    Prove to me that is not because one set of professors actually gives fair grades, while the other artificially inflated them...
    This study is why people now think social sciences are bullshit. It made horrible racist assumptions at the outset, and then denied the basic truth that some people are smarter than others, regardless of whether they are back, white, green, or polka dot.

    1. Re:Bull by gtall · · Score: 4, Interesting

      I've taught logic in graduate school. The worst thing you can do as a teacher is determine that smartness is baked in. The best thing you can do is assume every student is a budding Einstein if you could just help them along a bit to discover how to learn. By the way, Einstein was no Einstein in school, and not really a very good mathematician.

      Jeezus, I hope you never get near students.

    2. Re: Bull by TheMeuge · · Score: 3, Insightful

      Well since you seen to have conflated the idea that believing people are different is the same thing as assuming anything about your students individually, you're pretty bad at logic. Also you're an arrogant prick.

    3. Re: Bull by HornWumpus · · Score: 3, Interesting

      In the social sciences, by graduate school most of the high IQ demo is already out.

      Think about who likes to live in echo chambers? It isn't the smart ones.

      Shouldn't they have learned logic before grad school? Sounds like * studies to me.

      --
      John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
    4. Re:Bull by Anonymous Coward · · Score: 2, Interesting

      Prove to me that is not because one set of professors actually gives fair grades, while the other artificially inflated them....

      Exactly that! If you look at the graph comparing grades, you will see that the "fixed mindsets" generally gave lower grades. This could be interpreted as being more demanding or rigorous and not inflating the grades. With more rigorous testing you will get a bigger difference between higher and lower performing students, because the grades will be spread over larger interval (reflected by the larger error margins in their data).

      If the authors of the article want me to believe them, I want to see the grades that the students taught by the "open mindset" professors will get when they are tested by the "fixed mindset" professors. Also, subject all students to a test that is implemented by a third party and see if the "open" vs "fixed" differences remain the same. Not too hard experiments to do, are they? I have a very "fixed mindset" when it comes to experimental proof vs. wishful thinking.

      PS. The authors have not controlled for family income, which is known to correlate with learning performance: richer kids go to better schools and are more prepared when they get to the university.

    5. Re:Bull by fazig · · Score: 2

      Einstein was pretty good at math and natural sciences in school. The whole failing math thing is based on a translation error as far as I know.

      I can't speak for graduate school. When I graduated this wasn't a thing here in Germany.
      Today I work mostly with 2nd or higher up (of 7) semester undergrads. From my experience I can say that smart people come in all shapes. Here I mean either motivated people or those who are quick to grasp concepts and can solve their problems without a lot of assistance afterwards. Nurture can work pretty well here.
      Up until the 3rd semester I can say that not-so-smart also comes in all shapes. Sometimes it's laziness. Sometimes people aren't really interested. Sometimes they may have problems grasping the material that our courses build on and still try to do it. Maybe sometimes it's because I suck. I can't answer every question they may have on the spot.

      I can only assume that most of your grad students already passed what is supposed to be that "great filter" in academia. Which increases the likelihood that dumber, lazy, and uninterested people were removed already. Keep that in mind when you use your students as your sample group.

    6. Re: Bull by ShanghaiBill · · Score: 5, Interesting

      Did anyone review the actual coursework to determine which set of professors were grading more fairly?

      They could have both graded fairly. According to the summary, the students felt less motivated and didn't work as hard in the "fixed-mindset" classes. So they may have gotten worse grades because they failed to learn as much and actually deserved worse grades.

    7. Re:Bull by TechyImmigrant · · Score: 2

      Einstein derived E=MC^2. That's a neater trick than measuring it.

      --
      I should use this sig to advertise my book ISBN-13 : 978-1501515132.
    8. Re: Bull by TechyImmigrant · · Score: 5, Interesting

      Did anyone review the actual coursework to determine which set of professors were grading more fairly?

      They could have both graded fairly. According to the summary, the students felt less motivated and didn't work as hard in the "fixed-mindset" classes. So they may have gotten worse grades because they failed to learn as much and actually deserved worse grades.

      The importance of teachers and parents on student achievement, independent of a student's supposed intrinsic intelligence, is confirmed by a whole generation of education research. Education researchers are not common on Slashdot, but my wife was one, after being a math teacher and has a PhD in mathematics education. One trick she pulled while doing research in a central Oregon reservation was to stand in for a pregnant teacher for a term (she was there and still had her teaching license, so why not?). The class which for all time had hit a 100% failure fate (to pass standardized exams), magically attained a 100% pass rate for that term and fell back to a 100% fail rate after she left.

      Pedagogy research has been done. The results tell how teaching should happen. If you know the research and apply the conclusions, students will succeed. A problem is that this is consistently not done in most schools. Schools still get bogged down in stupid stuff like ability tracking and age delineation. They clearly are broadly ignorant of the results of education research.

       

      --
      I should use this sig to advertise my book ISBN-13 : 978-1501515132.
    9. Re:Bull by epine · · Score: 5, Informative

      By the way, Einstein was no Einstein in school, and not really a very good mathematician.

      I know someone very smart, who is currently doing graduate work in logic, who actually bothered to go to a library (perhaps it was Princeton) to take a boo through some of Einstein's original manuscripts.

      Somewhere in there, he found something like nine pages of notes over the course of which Einstein essentially taught himself four-dimensional differential geometry. He said it was an extremely efficient self-course, setting a pace he couldn't imagine himself.

      Not long ago I audited about five hours of Susskind's introduction to GR. (About 200 hours of Susskind's lectures are available on YouTube.)

      Adding the Lorentz transform was pretty straightforward, but then when you add accelerating frames of reference, you're left with a deep problem, which actually stumped Einstein for some while.

      Eventually, he wrote down the Einstein metric:
              G mu nu = R mu nu - 1/2 R g mu nu
      and the rest was history.

      Susskind commented that this was quite a bit worse that QED, because gravitation self-interacts far more than EM (I think his analogy was to imagine photons that also carry charge).

      Neither of these anecdotes in any way supports the idea of Einstein as a weak mathematician, though clearly his intuition in writing down the right problem greatly exceeded his formal abilities.

      My friend concluded that what Einstein really when he commented something to the effect of "if you think you have problems, they're nothing compared to mine" was relative to the task at hand: inventing a whole new metric tensor.

      Furthermore, Einstein probably was Einstein in school, it's just that no teacher ever set a test in writing down the right problems (rather than the right answers). Having such a gift at writing down the right problem, one can imagine why he didn't exert himself in the competition to write down answers to the tired problems of yesterday.

      This can be viewed through the economic lens of comparative advantage at an individual scale. You might just be the best person alive on the planet at writing down the right problem (this is not easy). Should you invest your marginal effort in developing that capacity, or in polishing apple's for your teacher, using a skillset where you are definitively ordinary (formalism) as compared to Poincare or Riemann? Where being merely Poincare or Riemann would be a definite step down, as compared to your one true gift.

    10. Re: Bull by K.+S.+Kyosuke · · Score: 2

      By the way, Einstein was no Einstein in school, and not really a very good mathematician.

      Well, I'm just going to assume you are a budding Einstein. Maybe it will allow you to discover how to learn so that you don't parrot that old rubbish the next time the way you just did!

      --
      Ezekiel 23:20
  2. Re:common knowledge by HornWumpus · · Score: 2

    He believes in prophets. He is _clearly_ nuts.

    --
    John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
  3. Not exactly by rsilvergun · · Score: 3, Informative

    the original purpose of institutionalized learning was to prepare farm workers to work in factories. They kept walking off the assembly lines because they couldn't understand the concept of a job that was never done. Plow the fields and plant the crops? Done. Build a widget? Build the next one. This is why we have bells in schools, btw. They're to condition you for factory bells.

    Over time education like I described above (intended for the working class) was mixed with principles of an entirely different branch of education: what the ruling class gets. This is where "well rounded" educations came from. The idea was to teach critical thinking skills to people who didn't think critically by nature. You typically did this with the liberal arts instead of STEM because while there's no value in getting a math problem half right there _is_ value in being half right on your critical understanding of a book.

    The "well rounded" education is used to make sure your offspring can go off and effectively run your dynasty when your old/dead. You needed them to think critically or they'd get killed by an ambitious member of your court.

    In an proper world without the constant meddling of the ruling class everyone would get both a practical (working class) education and the "well rounded" one that was usually reserved for the ruling class. You might not know this, but you want this. You want this a lot. Ignorant people make bad decisions. If you're a member of the ruling class you can exploit those bad decisions for your gain. If you're not those people become an angry mob and kill you. Or you join the mob, which sounds fun until you stop and think about the decades of poverty that lead up to you joining that mob.

    --
    Hi! I make Firefox Plug-ins. Check 'em out @ https://addons.mozilla.org/en-US/firefox/addon/youtube-mp3-podcaster/
    1. Re:Not exactly by Aighearach · · Score: 4, Interesting

      The story is all so nice and neat, but a lot of is back-fitted crap, like the stuff about bells.

      School was often taught in Churches, they were already using the Church bells for whatever events happened at the school. Later, electricity made bells easy to install everywhere. It is a basic aid for group activities, used by nearly every type of human activity. The only reason to connect it to factory bells is when you're just making up history as imagined by a popular narrative.

      More real was that basic education was seen as being needed so that workers grow up able to read instructions, and weigh, measure, and time things. But there was never really a gap where it wasn't understood that a well-rounded education was more effective even at teaching to weigh and measure. That was always understood. It is simply that the schools were being provisioned from different sources of money than the traditional upper class education; a teacher who can read and write is enough when you want to save money. And some of them will be good anyways, so you'll end up with lots of educated workers.

      Even now with all the access to information it is difficult to get people to separate what they imagine from what they know. They don't bother to think about, "if I was hired as a school teacher in that era, what instructions would I be given?" Where does the conspiracy to condition children to bells come from? How would the instruction be given? How would a teacher who had to purchase supplies out of the budget for their pay know that they were required to purchase the bell? Or would they only buy it because it was a major convenience for them? Is it possible that the rich kids didn't have bells, because they had private tutors and it didn't serve any purpose?

      In Merry Olde England, when the peasants were gathered around the square waiting for alms, (a free cup of soup and a beer, basically) did the church ring the bell to tell them it was time? Did pre-industrial American farm kids come running when a dinner bell was rung? Can you imagine living on a farm with people spread out all over the place and not being used to banging on a noise-maker at dinner time?!

  4. Honestly by PopeRatzo · · Score: 3, Interesting

    If I can get serious for just a moment, I believed that coming from a place of love and respect made for better student outcomes. I didn't teach STEM or anything, but I was considered a hard grader and expected a fair amount from students (especially grad students). When I was just a newly-minted lecturer, back in the '80s, I had a colleague tell me that it's important to be invested in the success of your students. You're not just pumping gas. That always stuck with me.

    --
    You are welcome on my lawn.
  5. Standardised tests? by quenda · · Score: 2, Insightful

    Are they hinting at assessment bias? Are these scores given by professors for written answers, projects, theses - from standardised multi-choice tests - or both?
      Why is this not mentioned?

    A hint is that the article uses "underrepresented minorities" as a euphemism for lower-intelligence minorities - Asians and Jews not included. So IQ is likely to be key here. If you control for SAT scores, does the racial "bias" disappear? My guess would be "yes".

    It is true that intelligence, at least the measurable part, is fairly fixed for individuals, so the professors teaching the hardest subjects (advanced maths and physics) are more likely to express the "fixed mindset", while those teaching the more wishy-washy liberal arts subjects like biology and chemistry, where attitude and hard work achieve more, are more likely to lean in the "growth mindset" direction. This would yield the reported results.

    But why speculate when comparing standardised test scores, and aptitude scores (SAT, IQ) would help answer these questions?
    Were the authors careful to only compare professors teaching the same subjects?
    Was affirmative action involved in the admissions process?

      Would the authors prefer hinting at racial bias to giving actual facts?

    Far too little information is given to infer a causal relationship between teacher attitude and score gap.

    1. Re:Standardised tests? by Mashiki · · Score: 2

      Standardized tests can work well or fail absolutely, it has a lot to do with the methods of teaching, and the subject at hand as well. Subject-fact tests generally are better, because they require you to understand the knowledge that's been gained and apply it to the problem. Regurgitation of information doesn't get you any points. The most difficult exams I've ever taken are open-book subject fact tests. Not only do you have to understand the content of the question being asked, you need to reference the section in the book that you are studying and apply reasoning to it as well.

      To add in, here in Ontario back oh 15ish years ago the Liberal government implemented three big changes. First was standardized tests, the second was standardized teaching, the third was standardized methods of teaching relating to group learning. Needless to say, it's been an absolute shit show in terms of students passing the tests. The method that they picked works very good for girls, very shit for boys, and super shit for K-9 students. Around 65% of all students fail the standardized math tests now, 60% of boys fail all standardized tests, while it's only around 25% for girls. There's a reason why there's been a big push around tutors, and whatnot here the last decade and change.

      It also doesn't help that various schools that were very specialized in particular areas of education, were effectively stripped of their budgets then closed when they became "under performing" and whatnot.

      --
      Om, nomnomnom...
    2. Re:Standardised tests? by NicBenjamin · · Score: 2

      Why are you assuming that any of the grades are inflated? It's entirely possible that the fixed professors grade lower because they are worse at teaching.

      Let's say we have a class that has multiple sections taking the same tests. If your belief is that your student's abilities are fixed, and the first quiz has your kids doing worse then the growth-minded-guy teaching the other section, you are not likely to change your teaching style. It's not your fault your kids cannot comprehend your brilliance. OTOH if the growth guy's students lose he's likely to decide his job involves changing his teaching style to suit his students, and (assuming he's not a total incompetent) he's likely to improve his student's results. Statistically speaking, Growth Prof will end up with higher-graded students regardless of who actually does the damn grading.

      Note that this will disproportionately help people getting low grades. The right teacher can turn a 50% student into a 75% student, but you cannot turn a 95% student into a 120% student. So if there's a correlation between under-represented minority status and low grades the better/Growth Professors will tend to improve their URM students more then their non-URM students.

    3. Re:Standardised tests? by AmiMoJo · · Score: 2

      A hint is that the article uses "underrepresented minorities" as a euphemism for lower-intelligence minorities

      Ah, the old supremacist myth that some arbitrary races are just inherently dumber. Rather undermined by the fact that the mere fact that the professor thought they might be able to improve resulted in a significant narrowing of the gap.

      It is true that intelligence, at least the measurable part, is fairly fixed for individuals, so the professors teaching the hardest subjects (advanced maths and physics) are more likely to express the "fixed mindset", while those teaching the more wishy-washy liberal arts subjects like biology and chemistry, where attitude and hard work achieve more, are more likely to lean in the "growth mindset" direction.

      Except that, again, here we have results in non-wishy-washy STEM subjects, including hard ones like maths and physics. As the study notes, the actual course doesn't seem to have any effect, the only variable that caused a significant change was the belief by the teacher that the students could improve.

      But why speculate when comparing standardised test scores, and aptitude scores (SAT, IQ) would help answer these questions?

      Because that wouldn't account for other factors like economic and social background, which are know to have large effects too. This study accounted for those things, and your desire to ignore them is a common supremacist tactic to try to imply that some races are just naturally less intelligent.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
  6. Lower or Higher? by tomhath · · Score: 3, Interesting

    I find it odd that the "growth mindset" instructors didn't have an equal effect on all students. Perhaps they were cutting Latino, African-American, and Native American students a break. Or maybe they made more of an effort to help them because they are minority students. It wouldn't surprise me if it was some of both.

    1. Re:Lower or Higher? by ceoyoyo · · Score: 2

      It's possible, but not necessary. Performance scales of any kind are generally nonlinear, usually something like a logistic curve. So a beneficial effect tends to create more of a boost in the middle than at the top. Also, poorer students might not have good influences from home, so a great teacher makes more of a difference.

      A 90% student might go up to 95% with a great teacher, but a 50% student might jump much more than 5%.

  7. What I noticed by Snotnose · · Score: 4, Interesting

    I got my BA in '81 or so.

    Teachers that took attendance every day and docked you for absences tended to be the teachers who's handouts were copies of copies of copies of 20 year old crap. Not to mention the lectures were useless. Best plan was to find out when the tests and quizzes were and what they covered, and skipped class. But skipping class cost you big time.

    Teachers who's lectures were not to be missed. Fark the tests and quizzes, if you wanted to understand the subject you went to the lectures.

    Goes without saying the first group of teachers had tenure and didn't care, the second group did not have tenure and did care.

    YMMV, there was variation in mine.

  8. Re:Yeah there is nothing more motivating by drinkypoo · · Score: 2, Insightful

    taking a required class with 500 of your closest friends and than trying to talk to one of the two TAs who are apparently failing English as a second or third language.

    Bah, you think that's bad? When I went to college the first time (at 17) my Algebra instructor himself had an impenetrable Chinese accent, at least to me and several others in the class who would all look at one another in puzzlement when he dropped a particularly mush-mouthed gem. I couldn't understand a goddamn thing he was saying, and eventually had to drop out. I'm still crap at math.

    Another person I know took [teaching] "Engrish as second ranguage" with "Doctor Kah" who would say "Ok, this be on test, this very importan" and then would ramble through several sentences of apparent gibberish.

    If I were going to teach in another country, I'd expect to have to be comprehensible in their language. Why don't people have to do that here? I don't give half of one shit where someone comes from, what their genetic background is, what gender they are, or what color their skin is, I just want to get the information I need to succeed.

    --
    "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
  9. No shit. by Chas · · Score: 2, Funny

    Why to you think colleges are such intersectional, communist crybaby spaces now?

    --


    Chas - The one, the only.
    THANK GOD!!!
  10. Re:Yeah there is nothing more motivating by Ichijo · · Score: 2

    I had a similar experience. I took Calculus 2 at the local community college from a native speaker. But he wouldn't assign homework, instead he expected us to study on our own and come to him with any questions. I don't work well without structure, so eventually I had to drop out.

    I took the same class again, with the same result.

    Then I took the class at the University. The teacher was an old Chinese man with a thick accent. But he assigned homework every day and took the time to explain things until we all learned the material really well. I earned an A in that class.

    So I had a similar experience as you, except it was the complete opposite.

    --
    Any sufficiently unpopular but cohesive argument is indistinguishable from trolling.
  11. Could it be this? by Evtim · · Score: 3, Interesting

    https://en.m.wikipedia.org/wik...

    If memory serves there is the opposite effect, i.e. you can stunt the growth of someone if you act as if they are "lost cause".

    Teacher should be aware of those and be carefully not to let the talented become lazy or the less talented to give up...

  12. Or maybe: tough courses cause poor grades by bradley13 · · Score: 3, Interesting

    Here is the full article: STEM faculty who believe ability is fixed have larger racial achievement gaps and inspire less student motivation in their classes

    Being a teacher, this kind of thing is important to me. And this article irritates me, because I think they get things exactly backwards. The article specifically examines the performance of two groups of students: white/asian vs. black/latino/native-american. The latter group is implicitly assumed to be disadvantaged by the fact that their average, group intelligence is lower than the first group. The hypothesis being that, if your teacher thinks you're less intelligent, you will do more poorly in class that you should.

    Interestingly: the article states that there was no discernable grouping amongst the teachers. Teachers and their beliefs were evenly distributed across all ethnicities, genders, ages, etc.. So this isn't a claim of racism or genderism, but simply a claim that teachers with particular views are poorer teachers. This is measured by the fact that their students received poorer grades.

    I think this is the critical flaw in the study: Those grades are assigned by the teachers themselves. There is no objective measure of student capability. Teachers with "tough" courses will, on average, give out lower grades. And lower still to the less capable students.

    I teach introductory courses - filter courses - at my university. An essential part of my job is to fail students who are unlikely be unable to complete the course of study. Hence, I give lower grades than instructors in other courses later in the program, after the incapable students have been eliminated. I've been doing this a long time, and I have come to the view that students either have certain aptitudes, or they don't. I submit that I have come to this "fixed mindset" view by observation: teaching thousands of students, failing those who cannot develop the necessary skills, and passing those who can. My role as a teacher is precisely that: to help them develop skills. If they are incapable of doing so despite my best efforts? Then they are in the wrong program of study.

    In other words, it's not a "fixed mindset" that causes an instructor to hand out poor grades, but the other way around: someone who teaches teaches tough courses will come to recognize that student aptitudes are largely inherent. There are exceptions: I've seen talented students fail through laziness, and marginal students get through with sheer grit and determination. Those exceptions, by their very rarity, serve to underscore the general pattern.

    Finally, one must comment on the student evaluations. Students in courses that handed out better grades were more likely to have liked the course. That's not a surprise, that comes close to a law of nature. However, the study misses a great opportunity here. The authors admit that my theory (about tough courses being the root cause) might be true:

    "It is possible that faculty who endorse fixed mindset beliefs create more demanding coursesâ"requiring students to spend more time studying and preparing for their course. If this is true, then differences in studentsâ(TM) performance and psychological experiences might be explained by the demands of these courses (instead of professorsâ(TM) mindset beliefs)."

    One of the questions in student evaluations ("how much time did this course require?") would have been a good indication of course difficulty. Unfortunately, the study does not seem to have tested this hypothesis, or at least, the paper makes no mention of it. A cynic might wonder if they did do the analysis, but perhaps it didn't support the desired results. After all: "tough courses lead to lower grades" would hardly be a conclusion worthy of publication.

    --
    Enjoy life! This is not a dress rehearsal.
  13. Also reverse cause and effect - teachers see fact by raymorris · · Score: 2

    It's also *possible* that the teachers are observing what happens in their classes, would mean the study is reversing cause and effect. Teachers who see students learn, perhaps because they teach an interesting subject, will think students can learn - because they do. Teachers who see students say "I'm bad at math" - and then proceed to be bad at math, will notice that. It may be both sets of teachers are observing what does happen in their classes - their particular subject in a particular field at a particular grade level, etc.

    That said, I think the most likely explanation is that teachers who don't think they *can* make a difference, don't.

    Teaching is one part of my job and I tend to think students can learn faster / better than they actually can. I'm a major nerd whose main hobby is learning. I read 1,200 page "textbooks" for fun. I forget that not everyone is like me.

  14. Re:New sells. Especially new research in academia by LostMyAccount · · Score: 2

    It's funny, but nutrition and weight loss is one field where the "proven" theory of calories in/calories out has been shown to be at least less axiomatic than it's been thought to be if not less effective than ketogenic diets.