Wednesday, December 12, 2007

In Defense of College Rankings

I've spent a fair amount of time over the last year having various conversations and arguments about college rankings, and one of the problems with the discussion is a tendency to intermingle critiques of rankings per se and critiques of specific rankings, e.g. those produced by U.S. News. For example, people often say things like "Rankings are reductive, overly-simplistic and create perverse incentives for colleges to engage in an arms race for money, status, and student." While the first critiques--reductiveness and over-simplification--apply to all rankings, the perversity of the incentives is wholly a function of what you happen to base your rankings on. If you rank colleges based on good measures, then the incentives could be constructive.

In other words, there's nothing wrong with universities trying to climb the rankings ladder if the ladder leads to the right place. An 2006 Education Sector report explaining how to build such a construct is here.

As a rule, generalized anti-rankings arguments are a lot weaker than those levelled at specific rankings like U.S. News, because the arguments tend to stem from a broader aversion to accountability, competition, and public scrutiny. To read more on this topic, see this paper, "In Defense of College Rankings," which I presented last month at the Association for the Study of Higher Education annual conference.

Also, for a lively ongoing discussion of college rankings, check out Morse Code, a blog written by Bob Morse, the U.S. News rankings guru. Even though U.S. News has an obvious interest in this debate, the blog is actually quite thoughtful and non-propagandizing.

No comments: