Here's why: a few months ago, I wrote an article for Washington Monthly that included a ranking of "America's Best Community Colleges," along with a profile of Cascadia Community College, one of the best. The rankings were primarily based on the Community College Survey of Student Engagement (CCSSE), a student-based survey of best educational practices, with some graduation rate data thrown in. The personal responses I received from two-year education folks have been almost universally positive; they were glad to see a discussion of the importance of community colleges and the recognition of excellence in a sector that gets very little attention despite enrolling 45 percent of college freshmen every year. The only negative feedback was from the adminstrators of CCSSE itself, who believe rankings are an inappropriate use of their data. I disagree, and explained why here.
I was able to create the rankings because CCSSE (much to its credit) makes its data available to the public. The same is not true for the the National Survey of Student Engagement (NSSE), which administers a very similar survey to 4-year colleges. That data is only released with the permission of individual colleges. Recently, USA Today asked all the universities that have participated in the survey (currently almost 700 per year, and over 1,200 total since the survey began eight years ago) for such permission. 257 institutions agreed, and you can see the results here. There are ten data points for each institution, showing their NSSE score on five "benchmarks" (an aggregation of individual survey questions, converted to a 100-point scale) of good practices like student-faculty engagement, active and collaborative learning, etc., for both freshman and seniors.
You're thinking: USA Today has beat me to the punch. No! Part of the deal was that USA Today wouldn't display all the data in a rankings format, listing the universities in numerical order from highest to lowest. NSSE's FAQ about the USA Today effort makes this explicit, saying:
2. Will institutions be ranked?
No. The project is intended to respond to calls for greater institutional transparency and to underscore the idea that educational quality is more complex than typically reported elsewhere, such as in rankings. The focus will be on informing people with an interest in collegiate quality about the indicators of educational effectiveness represented by NSSE benchmarks and survey items, as well as distinctive patterns of engaging educational activities offered by different types of institutions around the country.
This doesn't make sense. "Rankings" in general aren't inherently complex or non-complex, it just depends on which rankings you're talking about. The U.S. News rankings, for example, are quite complex, based on fifteen separate measures, some of which use regression equations and the like. You can argue about whether those are the right measures (I have; they're not), but that's a different argument. And NSSE can't say that it's inherently wrong to boil down multiple indicators into a single number, since that's exactly what the NSSE benchmarks themselves do--summarize multiple survey questions into one number.
The best way to "inform people with an interest in collegiate quality about indicators of educational effectiveness" is to compare institutions--i.e., rank them. And while USA Today and NSSE won't do that, you can. Just open up a new Excel spreadsheet, set your iPod to shuffle, and type in the ten numbers for each university. It's an afternoon's work, max. Then add them up, press "sort," and voila--new rankings, which will be much more interesting and informative than anything from U.S. News. Issue a press release, name them after yourself--go crazy!
You should, of course, do the right thing and include the appropriate caveats that your list doesn't include all institutions and that there's bound to be some upward bias because of self-selection. But don't be too humble about it, because frankly the institutions who (A) are doing the best job educating their students, and (B) are willing to released their data deserve all the attention they get. And don't feel too guilty about outing the institutions at the bottom, because while it might create some heartburn in the administrative offices, their students really need to know. The good institutions--and these are more likely to be good, since they've chosen to release the data--will do the right thing and use this as an opportunity to improve.
No comments:
Post a Comment