Slashdot Mirror
Mathematicians Deconstruct US News College Rankings
An anonymous reader writes "US News makes a mint off its college rankings every year, but do they really give meaningful information? A pair of mathematicians argues that the data the magazine uses is all likely to be at least somewhat relevant, but that the way the magazine weights the different statistics is pretty arbitrary. After all, different people may have different priorities. So they developed a method to compute the rankings based on any possible set of priorities. To do it, they had to reverse-engineer some of US News's data. What they found was that some colleges come out on top pretty much regardless of the prioritization, but others move around quite a lot. And the top-ranked university can vary tremendously. Penn State, which is #48 using US News's methodology, could be the best university in the country, by other standards."
A college degree is an education, and that should be of paramount concern. It's also nice to be in a place you'd enjoy living, etc.
But then there's reputation. You might get the same education at CMU and MIT, but if you're looking for jobs, all other things being equal, someone's gonna pick the MIT grad because it'd a bigger name. I realize it's variable across fields and with individuals, but names mean something to a lot of people, particularly when they're not really qualified to judge on merits.
So when will there be a site available so I can see how my college ranked based upon what I deem to be the most important?
... that is if they can afford it.
US News could take this, print their magazine, then offer this "service" on their site, run by ad revenue to really give the student a run for their money when applying for a college.
Once you get your first job, where you graduated from (name recognition) is less important than the intelligence of the student and what you're really done. Don't get me wrong, you should probably consider one of the "top 20" in your field, but you're just as likely to get a good (or better) answer from people in your future industry than from a magazine. There are exceptions to the rule, of course, but unless you happen to be in one of the few snobby professions it doesn't matter. Finding a good "fit" for college is almost as important as the curriculum itself.
Now, if you're going on to do something great (and almost all of you can put your hands down - you either weren't born with the brain or the parents; I'm included in that class, too, fwiw) you should consider finding the top graduate program in your field. Not one of the top, THE top, as judged by your peers. Then school will matter, because when you get near the top, snobbery is almost everything. Your parents, your intellegence, your charisma, and your degree for the "three of four" ticket to stardom. You can need at least three and get to the top. Actually, I think you can only have three - if you get all four your competition will be jealous and cut you down like a dog.
Is it just my observation, or are there way too many stupid people in the world?
I thought the bit where the best result would be the point nearest the line from the origin to the polytope (containing the bunch of points representing universities' parameters) passing through the point representing weights was the important bit not that different weights give different results. While what you said _is_ blindingly obvious, the other thing isn't. It might be more useful to use this method than to simply recalculate all scores using the new weights.
I've actually played with ranking data quite extensively, and usually for reasonable weighthings of the parameters the movement in position is in the order of plus/minus 5 places. Sure, Penn State would be number one if all one cared about is retention rates, but really nobody does. Instead we can define a range of reasonable weights for retention rates (say between 7% and 35% of the total weight) and test all possible combinations in that space, suddenly Penn State place goes up and down a fairly small amount.
A bigger concern is what is the value of selecting a school based on the ranking as a whole, without paying attention to the your likely area of major. Say, Yale is a great school but in CS is a non-entity. If you are positive CS is your thing, MIT, Stanford, Harvard and Princeton are far better choices.
What I want to know is why U.S. News considers itself qualified to rate colleges in the first place.