It's A Lot More Than Culture, Stupid

Over at the New Republic, Josh Patashnik jumps into this conversation about the late Senator Daniel Patrick Moynihan's observation that student tests scores seem to be highly correlated with proximity to Canada. The problem, of course, is that lots of other things that influence educational outcomes, like per-student spending and per-capita income, are also correlated with distance from our neighbors to the north. As we all learn in Stats 101, there's a statistically significant relationship between male baldness and yearly salary--men with less hair earn more, not because firms value hairlessness, but because both baldness and salary are independently linked to a third variable: age.

While conceding that spending matters, Patashnik sees the essential truth of Moynihan's Canada theory as cultural. Thus, the title of the post: "It's the Regional Culture, Stupid." Apparently, the real driving force behind high performance in these states isn't high-quality curricula, good teachers, adequate funding, well-educated parents, etc., but rather beneficent influence of virtuous Christian white people:

these states are all part of David Hackett Fischer's "Greater New England" region, the homogeneous, white, Protestant northern tier of the country settled by New England Yankees and northern European migrants, which I've referenced before. This region is sort of the goody two-shoes of America in a variety of quantitative social-science measures: Great test scores, very low crime rates, a historical aversion to violence (nearly all the states with no death penalty are Greater New England states), a tradition of clean, nonpartisan reformist politics...

But to prove this point, you have to find a way to disentangle the allegedly virtuous white person factor from everything else, like spending, parent's education, etc. As evidence, Patashnik cites...a 1992 newspaper article, which begins by asking: "where do students do best on standardized math tests? In North Dakota, Montana, Iowa, Nebraska, Minnesota and Wisconsin."

Here's the problem with citing test scores from 16 year ago: they've given that same test (the NAEP) a bunch of times since then. According to the 2007 NAEP--which is perhaps more relevant to a discussion occurring in 2008--the top six states in 8th grade math were, in descending order: Massachusetts, North Dakota, Minnesota, Vermont, Kansas, and New Jersey. I'm not sure which theory of regional culture encompasses both Kansas and New Jersey, but somehow they've managed to overcome the handicap of being unable to scoot over the border for maple syrup and done pretty well in math.

Another way to examine culture is to try and factor out other things that matter, like poverty. So let's look at the same test, but this time only at scores for students who aren't eligible for free- and reduced-price lunch. Now the top six are Massachusetts, Kansas, Minnesota, Texas, New Jersey, and Vermont. Texas! Maybe if Senator Moynihan were alive today, he'd be developing some kind of proximity-to-Mexico theory...

Okay, one might reply, but don't forget--this is the virtuous Christian white person theory we're talking about here. With the solitary blond-haired kid, sitting in an ice-fishing shack studying differential equations on Sunday after the Lutheran service gets out--Garrison Keillor stuff! What do the numbers look like if we exclude, you know, those other people? Well, if we look just at the NAEP scores for white students, the top six turn out to be: Massachusetts, Texas, Maryland, New Jersey, Minnesota, and Virginia.

In other words, this regional culture determinism is pretty stupid. Of all the things that matter in education, some kind of mystical connection to the Protestant work ethic isn't high on the list. Massachusetts, for example, doesn't have the best NAEP scores in the country because of who landed on Plymouth Rock. It has the best NAEP scores in the country because it has high per-student spending (equitably distributed to high-poverty school districts) high parental education levels, unusually rigorous academic standards, top-quality assessments, good teachers, and strong accountability systems--today.

Patashnik is joining George Will in advancing the "what matters in education isn't education" theory of education, which is one of the more damaging conceits held by people who should know better.