Friday, February 06, 2009

The Burden of Proof

Paul Basken (one of the best higher education reporters in the business IMHO) filed a short piece($) in the Chronicle a few weeks ago about struggles to improve the quality of teaching in engineering. He wrote:

After a close-up look at 40 American engineering schools, the Carnegie Foundation for the Advancement of Teaching has released a new report on the matter, but the diagnosis is old news: A widespread emphasis on textbook-heavy theory over hands-on practice discourages many students and leaves the ones that remain unprepared for real-world problems. With the difficulty long known, why have solutions been so elusive? Among the reasons cited by college leaders: a faculty culture resistant to change, and perceived pressure from accreditors.
And:

The "problem-based approach" in Georgia Tech's biomedical-engineering program includes asking sophomores to spend an entire semester exploring a big-picture question, such as how to keep the blood supply safe from the AIDS virus, said Laurence J. Jacobs, a professor of civil and mechanical engineering and an associate dean at Georgia Tech. Other colleges are having a much more difficult time introducing such changes in their traditional engineering programs because of faculty members who "are very, very protective of their curricula," Mr. Jacobs said. Changing faculty attitudes is the key, said an author of the Carnegie report, Sheri D. Sheppard, a professor of mechanical engineering and an associate vice provost for graduate education at Stanford University. The science foundation has spent millions of dollars trying to encourage universities to break up old styles of teaching, and it still couldn't overcome the "cultural issue of change" among faculty members, Ms. Sheppard said.

I went to college, four years of undergrad, two more in grad school. Both of my parents are retired college professors, and I recently taught a graduate course in education policy for Johns Hopkins. But I'm not of higher education. I've spent my career in public policy, first in the executive and legislative branches at the state level, then in various non-profit think tanks in DC. And I am just baffled when I read things like this. Maddened. Because it seems to me that one could easily summarize the two paragraphs above as follows: 

People have known for a long time that college students learn more when they're actively engaged in learning via hand-on practice and other means. But many professors refuse to adopt these methods, because they don't want to and they don't have to.

Am I missing something? To be clear, I'm not advocating for some kind monolithic scripted curriculum. When I put my class together, I made choices about subject matter and methods that suited my expertise and instructional strengths and weaknesses. But it seems to me that the more autonomy faculty are given in the classroom, the greater the burden of proof to demonstrate that their choices are actually working, with that proof being based, in significant part, on some evidence of what students learn. Isn't that what higher eduction is all about--evidence? And if the methods or approaches aren't working, they shouldn't be allowed to continue, period, regardless of who the instructor might be. Blaming this problem on "culture" is a dodge, a way of obscuring responsibility, as if faculty are helpless victims of some larger infectious mindset and not professionals who are, as such, responsible for the choices they make. 

4 comments:

Stephen Downes said...

The 'burden of proof' question, though, also raises the 'method of proof' question.

Who should professors not offer their grade sheets (in which the majority of their students pass) as evidence for their students having learned?

If this is not proof, then such professors can ask, quite reasonably, what would count as proof?

Anonymous said...

I may have read about it here, but there is at least 1 community college that take this approach. (it's in Washington State I believe) Olin Engineering college also does this as well.

The common factor was that they were new schools that didn't sign people on, unless they signed onto the mission.

At the k-12 level, the same thing happens. Best practices from 1 school can't get integrated into a rigid school.

Anonymous said...

Amen to the observation about Paul Basken's writing. He has apparently gotten too close to the truth in some of his articles, however, to the displeasure of powerful advertisers in the Chronicle. Hence, not much from him lately.

Anonymous said...

Kevin - I enjoy reading your blog and usually find your comments to be highly insightful. In this case, though, I think you have oversimplified the problem and make the mistake of placing all of the blame on the faculty when there is plenty of blame to go around.

This is a problem that I research. It is common for people promoting changes to focus all of their attention on the faculty and ignore many of the structural aspects of the higher education system that make change difficult.

Three papers that are highly relevant to this issue can be found at:
http://homepages.wmich.edu/~chenders/Publications/HendersonPRST2007Barriers.pdf

http://homepages.wmich.edu/~chenders/Publications/HendersonAJP2008DivergentExpectations.pdf

http://homepages.wmich.edu/~chenders/Publications/Dancy_Henderson_CommissionedPaper2008.pdf

These can also be found on my web site:
http://homepages.wmich.edu/~chenders/Publications/Publications.htm