Thursday, September 29, 2005

An Alternative Approach To College Rankings

Here's something interesting for anyone frustrated by the methodology used in the USNWR annual college rankings. The Washington Monthly has published its own list based on an entirely different set of criteria, and,not surprisingly, the list looks a lot different.

The USNWR criteria are summarized here, but fall into 7 general categories: Peer Assessment (i.e. reputation) - 25%, Retention(% of freshman who return)- 20-25%, Faculty resources - 20%; Admissions Selectivity - 15%, Financial Resources - 10%, Graduation Rate - 5% and Alumni Giving - 5%.

I have never been a big fan of these criteria or of the relative weightings assigned to them because the seem to be less designed to measure the quality of the education and educational experience than to assure that Harvard, Princeton and Yale are always on top.

The Washington Monthly apparently had a similar problem and came up with a completely different set of criteria:

The first question we asked was, what does America need from its universities? From this starting point, we came up with three central criteria: Universities should be engines of social mobility, they should produce the academic minds and scientific research that advance knowledge and drive economic growth, and they should inculcate and encourage an ethic of service. We designed our evaluation system accordingly.
(For a more detailed breakdown on how they measured colleges and universities on these criteria see this "Note on Methodology").

Using these criteria, the came up with the following rankings, which, not surprisingly, look quite different from the USNWR rankings:



I don't know whether the WM criteria are the right ones either. Frankly, they seem a bit biased in favor of an egalitarian impulse. But it is interesting to look at how colleges and universities stack up on criteria other than reputation.

3 comments:

Anonymous said...

Bill...

I don't have anything to sell.

I do like the fact that many state univeristies ended up on thg elist. And I do agree with the aspect of their rankings that unviersities should be a catalyst for social mobility.

Scoggin

Bill said...

Yeah, mabybe I've arrived. Still not to many readers but the spam is WAY up.

Anonymous said...

Jesse said...

I would answer the question "what does America need from its universities?" far differently.

I think it should be based from 3 core needs.

1) Academic Knowledge that can be applied to the "real" world. It is sad that the USNWR approach does not mention academics at all.

2) "Avancements." It is my opinion that our best ideas in the future (and some that we have now,) are spawned from college research. This needs to be accelerated.

3) "The experience." For most people this is the first time away from their family and their time to learn how to be functioning adults within our society.

The USNWR and Washington monthly rankings should be absolutely meaningless. Unfortunately they are not.

Jesse