Slashdot Mirror


MIT's SAT Math Error

theodp writes "The Wall Street Journal reports that for years now, MIT wasn't properly calculating the average freshmen SAT scores (reg.) used to determine U.S. News & World Report's influential annual rankings. In response to an inquiry made by The Tech regarding the school's recent drop in the rankings, MIT revealed that in past years it had excluded the test scores of foreign students as well as those who fared better on the ACT than the SAT, both violations of the U.S. News rules. MIT's reported first-quartile SAT verbal and math scores for the 2006 incoming class totaled 1380, a drop of 50 points from 2005."

29 of 280 comments (clear)

  1. Perhaps they should offer a Quality Assurance majr by Tablizer · · Score: 5, Funny

    and a minor in dupe detection ;-)

  2. 1220 in 1989 by Saint+Stephen · · Score: 5, Informative

    You can't compare any scores because it's all been rebased to be meaningless.

    Back then, a 1400 really meant something, and a "perfect" score was a one or two person thing.

    1. Re:1220 in 1989 by Anonymous Coward · · Score: 5, Funny

      Back then, a 1400 really meant something, and a "perfect" score was a one or two person thing.

      What it really meant was they were sitting at the same table!

    2. Re:1220 in 1989 by JoelKatz · · Score: 5, Informative

      That's correct, the scores are normalized so that the distributions are the same. This means you *can't* compare scores across years. If you did, you would find that, amazingly, the distributions were the same. But have the students stayed the same? Nope. Have the questions stayed the same? No again.

      If you google around, you'll see articles about how "national SAT scores fell for the second year in a row" or some nonsense like that. There are ways you can sensibly compare SAT scores across years, but you cannot compare averages over a significant fraction of the testing pool.

    3. Re:1220 in 1989 by glwtta · · Score: 4, Funny

      I played him chess and made him cry, but he sure as hell beat my 1170.

      Let me guess, the verbal section accounted for much of the discrepancy?

      --
      sic transit gloria mundi
    4. Re:1220 in 1989 by NMerriam · · Score: 4, Informative

      I was under the impression that SAT scores were normalized, so the distribution was the same between years. Am I wrong? Anyone have any sources?


      Yes and no, one problem is that now they normalize the test TOO often, due to the fact that students weren't scoring well (average SAT score fell to about 930-950 or so by the early 1990s). They added essays and some other stuff which arguably added more subjectivity to the grading, and they did a BIG recalibration in 1994 that basically gave everyone an extra hundred points (don't they allow calculators now, too?). So any test scores from 1994 or later are considered meaningless as anything other than an indication of how you did on the SAT compared to the other students that exact same year.

      Before 1994, the SAT correlated closely with IQ and could generally be compared (roughly) across years because it hadn't changed much in decades (precisely the complaint that led it to being redesigned). For example, MENSA doesn't accept SAT scores after 1994 as indication of intelligence.
      --
      Recursive: Adj. See Recursive.
    5. Re:1220 in 1989 by msuarezalvarez · · Score: 5, Insightful

      Showing interest in indicating intelligence to MENSA is a clear sign of lack of intelligence.

  3. Re:If I could do it all over again... by renegadesx · · Score: 5, Funny

    I pitty the fool... stay in school

    --
    Make SELinux enforcing again!
  4. Those whacky MIT Kids... by physicsphairy · · Score: 5, Funny

    Yet another hilarious prank, no doubt. I wonder how many kids scored 1337?

    Just watch out when one of them attains the CEO position at your company.

    "Hey, you know what would be a really hilarious number for our stock prices to hit?"

    Uh oh.

  5. Re:Oops! by Brian+Gordon · · Score: 3, Insightful

    Your intelligence doesn't determine how ready you are for school. I have a high IQ but I score badly because other people put more work into school than I do.

  6. Well there's your problem... by Anonymous Coward · · Score: 5, Funny
    MIT's reported first-quartile SAT verbal and math scores for the 2006 incoming class totaled 1380, a drop of 50 points from 2005.


    I don't normally put a lot of stock in standardized test scores, but with a total score of 1380 for an entire class, I can see how that might be a problem.

  7. Re:Oops! by Rakishi · · Score: 4, Informative

    US colleges use a whole lot more than the SATs to determined admission, essays and extra-curriculars and grades and so on. In some ways the fact that you can study for the SAT does make it a better measure, work ethics and the ability to study are important for life and college.

    Actually the US college system relies amazingly little on standardized tests in comparison to many other nations. In many countries there is a set of tests which pretty much are the only measure and the only chance you get. If you do badly or the computer system fucks up you're screwed.

  8. Re:is that a word? by Tablizer · · Score: 5, Funny

    What is quartile?

    Don't worry, you're not in it.

  9. Re:Oops! by arth1 · · Score: 4, Informative

    He wasn't bitching about it -- he was stating a fact: that he was doing worse than others, and did not blame it on anyone else. The only one here bitching is you.

  10. The editor of Forbes would agree... by MacDork · · Score: 3, Insightful

    Ahh, parent poster is a Troll, eh? Forbes publisher Rich Karlgaard would probably agree with AC. Is he a troll too? I saw far too many kids there for the party myself... the 'life experience' they called it. We even have online encyclopedias citing which schools paaar-tay the hardest. I'm sure that image doesn't hurt enrollment numbers and the government money flowing into universities. I wouldn't be surprised if universities quietly encourage that 'rep' via PR firms. College is big business. So big in fact that university finances have begun drawing the scrutiny of congress. We've even begun exporting American-style higher education. It may not be the best in the world, but it sure makes a shitload of money.

    In the meantime, there's a lot of kids leaving college with a worthless degree and lots of debt. The university was enriched by the process, but you can't say that for all their graduates. I'll bet if the OP had mentioned something about outsourcing the post would be +5 Insightful.

    1. Re:The editor of Forbes would agree... by Anonymous Coward · · Score: 5, Insightful

      That is silly; I can find mainstream pundits that agree with pretty much any side of a debate. I agree with the OP moderation: first, this whole thread has little to do with the article (calculation of school ranking error) or even marginally relevant (are school rankings relevant). Instead, the first post takes the deliberately polarizing and wide-encompassing claim "college is not worth it" in a single line, obviously with the intent to garner a lot of replies.

      Did the OP add anything to a conversation? Is a unilateral claim such as this insightful? Informative? Ask yourself this seriously. It is off topic, and just a way to get the predictable responses (I did well in school and have a sucky job... I didn't go to college and make millions...) A serious post would at least have some text, or make a well-reasoned claim to *something*. Some of the replies in the thread are actually insightful, and have been moderated accordingly.

      The original post is pretty much the definition of a troll, and judging by the number and type of replies, a successful one.

    2. Re:The editor of Forbes would agree... by tux_deamon · · Score: 3, Insightful

      What is with the assumption that a college education is little more than vocational training? If you want to land a well paying job, go to tech school -- learn a trade. There are a ton of well paying jobs in health care for those who are focused. But if you want to develop skills in critical thinking, communication, and analysis, consider college. I cherish my 4 years of university education. It exposed me to a wide breadth of knowledge and ideas. It helped me to become the well rounded and resourceful thinker I am today. It's helped me to understand general problems within specific contexts, and to approach those problems independently with original solutions. To me, that's more important than picking up "entry level" skills for a job in any industry. There's nothing wrong with getting an education. It's one of the best investments you'll ever make.

    3. Re:The editor of Forbes would agree... by tknd · · Score: 4, Insightful

      Ahh, parent poster is a Troll, eh?

      Yes, he is a troll. Education does not promise you money, it only promises to educate you if you are willing to be educated. In all of my classes my professors never claimed that after passing the class I would be blessed with high paying jobs. Instead, their claim was, "these are the topics we will cover." How well they covered those topics varied, and obviously some professors did poorly while others did well. But nobody ever said, "learn this and you will make money." As a student, you choose your degree, and you choose what classes you will take. There is no reason to come crying after you graduated to claim that your degree did nothing for you when it was practically your choice all along.

      Forbes publisher Rich Karlgaard would probably agree with AC. Is he a troll too?

      The article you linked to makes no claims that school is worthless. In fact, the article is brining up a major point that you and the parent missed: if you only are thinking in terms of costs and how much the degree with return in terms of money, then you have to think in terms of return on investment on the degree and the following job because of it compared to whatever alternative plan you have in mind. The option that has the highest return is obviously the option you should take if your only goal is money.

      I saw far too many kids there for the party myself... the 'life experience' they called it. We even have online encyclopedias citing which schools paaar-tay the hardest.

      I saw a lot of kids partying. But I also saw a lot of those kids failing their classes, dropping out, staying for as long as 6 to 7 years, or ultimately getting a crappy job as a result. The question here is did they turn out better than they would have if they did not go to college? Maybe maybe not. But ultimately, who ever made the choices (parents and the child) are responsible. I'm not going to feel sorry or feel like it is a problem if a kid's parents are uninformed about their kid's choices or the kid does not have the motivation to utilize his resources. That's their business and as far as I can tell that's a hell of a lot better than some of the alternatives.

      College is big business. So big in fact that university finances have begun drawing the scrutiny of congress.

      Oh, another Harvard, Yale, and Stanford article. What about public schools?

      We've even begun exporting American-style higher education.

      I don't see anything wrong with it. There are already a lot of international students enrolled everywhere throughout the country. In the same way, there are a lot of American students participating in foreign schools.

      In the meantime, there's a lot of kids leaving college with a worthless degree and lots of debt.

      I had a friend in college that happened to be a computer science major. But the big thing about her was that she was a girl and she was cute. Her personality was nothing like a geek and she could have easily done something else or fit in with other social groups. Naturally, the question came up, "Why computer science?" Her answer was, "I initially thought about getting another degree but my parents disagreed and said I needed to get something more 'useful.'" In the context she was speaking of, "useful" was a degree that would guarantee a higher salary. Indeed, she did get a job that she didn't mind doing in the software industry and did hit a higher salary. Unlike most people, she actually made the choice based on money and it paid off.

      Others do not think like that. Instead they either think college is one of those necessary things or something their parents forced them into. The end result is a kid that partied too much barely finished his degree, and most of all did not learn anything or put the degree to use. I do not think that issue will ever be fixed because some people are that stupid. Ultimately for those people it may not matter because their parents m

  11. Worked for Esther Dyson by rs79 · · Score: 4, Insightful

    " I saw far too many kids there for the party myself "

    http://findarticles.com/p/articles/mi_m4422/is_n6_v15/ai_20860361

    "Her dad once chastised her for wasting his tuition money by not going to her classes. With typical Esther aplomb, she countered, "Daddy, you don't understand. You don't come to Harvard to study. You come to Harvard to get to know the right people."

    --
    Need Mercedes parts ?
  12. Re:Oops! by sholden · · Score: 3, Insightful

    Because the IQ score gives no useful information.

    If the person has a high SAT score but a low IQ score then they are in the "work really hard" group, you want them.

    If the person has a high SAT score and a high IQ score then they are in the "gifted" group, you want them.

    If the person has a low SAT score and a low IQ score then they are in the "dumb" group, you don't want them.

    If the person has a low SAT score and a high IQ score then they are in the "smart but lazy" group, you don't want them.

    Since all you don't actually care about the groups, just the "want them"/"don't want them" decisions IQ provides nothing.

  13. Re:If I could do it all over again... by mr_mischief · · Score: 4, Informative

    Well, English and philosophy are two of the recommended undergrad degrees taken in conjunction with pre-law to gain entry into law schools. So the Bachelor's degree by itself may not be spectacular, but it can set one apart from all those political science majors. History might also be a good choice. See University of Missouri St. Louis Political Science department's information on studying Law for just one program that mentions English and philosophy both as options.

    Also, consider that many state government positions have a prerequisite of any Bachelor's degree from any accredited college. In Illinois, for example, many decent jobs with good benefits can plausibly be had with a degree in Liberal Arts or Medieval Literature, although you might be up against candidates who might have studied something more directly relevant. For some fields within the Illinois state government, the degree requirement can be waived for experience.

  14. Re:If I could do it all over again... by mosb1000 · · Score: 4, Insightful

    "I had been under the impression that engineering degrees were generally for people who wanted to make money (in a normal-ish job) after graduation, while sciences were for people who either wanted to be, or accepted the risk of being in academia for life. Is that not the case?"

    I think that anyone who wants an engineering degree for the money will be disappointed. I have a degree in chemical engineering, and I make $55,000 (that is with 10 months of experience). That sounds like a lot for being just out of school, but given the extra effort of obtaining the degree, and the amount of work that is expected from me at my job, I don't think it's a better deal than a liberal arts degree would've been. I think that the value of any degree is what you do with it. If you work to gain valuable experience, advocate yourself, and work well with others, you can make a 6 figure income with any degree.

    I am in the field because I am passionate about making peoples lives better, and I feel like engineering accomplishes that. I don't want to work forever in academia, because I feel like all the mindless bureaucracy and politics of the university makes enriching the lives of others nearly impossible. Of course, if I did want to work forever in academics, I could still do that with an engineering degree.

  15. Re:If I could do it all over again... by Lightlord · · Score: 3, Funny

    I pitty the fool... stay in school Dont be a fool......stay in school Fixed that for you!
  16. Re:If I could do it all over again... by icedcool · · Score: 5, Insightful

    Let me fix that for you... 1) Work 2) Profit! There you go.

    --
    Most people aren't thought about after they're gone. "I wonder where Rob got the plutonium" is better than most get.
  17. Re:If I could do it all over again... by allacds · · Score: 5, Informative

    I think that anyone who wants an engineering degree for the money will be disappointed. I have a degree in chemical engineering, and I make $55,000 (that is with 10 months of experience). That sounds like a lot for being just out of school, but given the extra effort of obtaining the degree, and the amount of work that is expected from me at my job, I don't think it's a better deal than a liberal arts degree would've been. I think that the value of any degree is what you do with it. If you work to gain valuable experience, advocate yourself, and work well with others, you can make a 6 figure income with any degree.


    Yes but consider this. The average starting salary of a liberal arts degree holder is generally quoted as $30-35k. The average starting salary of an engineering degree holder is generally quoted in the $50-55k range. That's a pretty significant difference - the engineering degree yields a return of 40 to 80% straight off the bat. Granted the engineering degree is harder but I'd say it's well worth the effort.

    Now that said, I do agree with you that a degree is only as valuable as you make it (to a certain point). But I think taking these numbers in the aggregate probably cuts a lot of the variance due to super high- and low- achievers.
  18. Re:If I could do it all over again... by Lemmy+Caution · · Score: 4, Insightful

    Having a college degree confirms that the bearer can finish college. This isn't trivial: someone who claims to have equivalent knowledge without the degree may, in fact, lack discipline or the ability to embark on long-term projects. Just knowing that someone can do the things required to get a degree is an important piece of positive information above and beyond the demonstrated learning that the degree indicates.

  19. Two points (cheating and cheating) by pbooktebo · · Score: 4, Informative

    The first thing I note is that, for an institution as brilliant as MIT to make an error that increases their ranking seems a bit suspicious. Despite the fact that many readers here see little or no purpose to these rankings, they are horribly influential, and the difference reported is substantial. MIT is good enough to be great without cheating.

    The second point is that many schools are very careful when examining foriegn test scores because of cheating supported by the government. It is well-known that many countries actively encourage cheating (which helps the students get grants or acceptance). The school where I was had a watch list and would ignore scores outright from many countries. Makes me wonder whether they still reported these suspect high scores as part of their average (I expect they did).

  20. Re:If I could do it all over again... by Eli+Gottlieb · · Score: 3, Funny

    Or just take a DeLorean back in time make sure that your father follows that truly wise advise:

    Don't be a fool. Wrap your tool.

  21. Re:If I could do it all over again... by Mister+Whirly · · Score: 5, Funny

    "what do you expect when you're 22?"

    A six figure income, no dress code, full benefits, three assistants, and a 32 hour work week??

    --
    "But this one goes to 11!"