Giving Doctors Grades Has Backfired

HughPickens.com writes: Beginning in the early 1990s a quality-improvement program began in New York State and has since spread to many other states where report cards were issued to improve cardiac surgery by tracking surgical outcomes, sharing the results with hospitals and the public, and when necessary, placing surgeons or surgical programs on probation. But Sandeep Jauhar writes in the NYT that the report cards have backfired. "They often penalized surgeons, like the senior surgeon at my hospital, who were aggressive about treating very sick patients and thus incurred higher mortality rates," says Jauhar. "When the statistics were publicized, some talented surgeons with higher-than-expected mortality statistics lost their operating privileges, while others, whose risk aversion had earned them lower-than-predicted rates, used the report cards to promote their services in advertisements."

Surveys of cardiac surgeons in The New England Journal of Medicine have confirmed that reports like the Consumer Guide to Coronary Artery Bypass Graft Surgery have limited credibility among cardiovascular specialists, little influence on referral recommendations and may introduce a barrier to care for severely ill patients. According to Jauhar, there is little evidence that the public — as opposed to state agencies and hospitals — pays much attention to surgical report cards anyway. A recent survey found that only 6 percent of patients used such information in making medical decisions. "Surgical report cards are a classic example of how a well-meaning program in medicine can have unintended consequences," concludes Jauhar. "It would appear that doctors, not patients, are the ones focused on doctors' grades — and their focus is distorted and blurry at best."

Comments

Seriously...

[Last_Available_Usern]

How could no one have foreseen the potential abuse and pitfalls of a system like this? Without even reading any further than "Giving Doctors Grades..." I immediately conjured images of a bunch of doctors huddled around each other saying, "I don't want that one." "Well I don't want that one either. My feedback is back at 85% and I can't risk another death screwing me over."

Just like Teacher "Grades"

[Jason Levine]

In NY, where I live, we're now "grading" teachers based on how well their students do on standardized tests. Any teacher who strays from the "prep for the test" subject matter and uses inventive ways of helping their students learn is going to have students who might know more, but who will perform worse on the tests. Teachers who stick to the script and drill test preparation into their students will wind up with better scores even though their students will know less (except how to fill in bubbles).

Just like the Doctors example in the article, the "teacher grading" system is going to backfire. Talented teachers will be kicked out (test scores are tied to their jobs now, your students get low scores and you're out) and mediocre teachers will remain. It's almost like trying to take the jobs that teachers and doctors do and standardize their job functions across every student/patient they see doesn't work. Maybe because their jobs require using their brains and trying different techniques as opposed to an assembly line worker who just needs to perform the same task every time with no variation.

Re:Just like Teacher "Grades"

[shankarunni]

It's actually much worse. Teachers who toil away in schools where the students get little or no parental or peer support for learning, get hurt very badly by these grades, because regardless of how hard they work on the students, they do less well on standardized tests (and improve less) than students who grow up in suburban environments that encourage learning.

So it becomes a terribly dis-incentive for the best teachers to go to the schools that need them the most - they'll grab all the plum assignments in the nice, rich, suburban schools, while fresh teachers get sent to the inner-city schools (perpetuating this situation).

Re:High Risk + Low Success = High Cost

[swb]

I think there's a ton of money being dumped into the walking dead.

When my mom was at stage 4 of metastasized breast cancer, we had a family meeting with the oncologist to discuss my mom's situation. When asked what -- if any -- chances she had for life extension (not a cure, but more than 12 months) he was totally equivocal about it and was basically looking to start another round of chemotherapy. I felt like he was just looking for another round of payments before she died. They give you the thinnest hope to try to get you to keep using their services.

I've heard similar stories before from other people with older relatives, very sick and unlikely to every recover in any meaningful sense of the word yet the doctors insist on expensive and invasive treatments. The only explanation I can think of is that it's good business for them.