Monday, September 15, 2008

Fiddling

It was a little strange to be sitting in the Mayflower Hotel this morning listening to U.S. Secretary of Education Margaret Spellings say that "Rome is burning!" with respect to American educational outcomes when Wall Street really does seem to be burning, but these events get scheduled far in advance and her larger point that perpetual achievement shortfalls and large socio-economic educational disparities will seriously weaken American competitiveness is sound. The topic is always a little tricky to talk about, though, given America's pre-eminent global economic standing and unique combination of size and educational attainment.  Given that, politicians tend to pick which dimension happens to be convenient for their argument. So last week Barack Obama lamented the growth in the overall number of PhDs in China and India compared to declining U.S. numbers, while this morning Secretary Spellings noted that we're "behind Denmark and Finland" in terms of the percent of younger working-age adults with post-secondary degrees, and both things are true. But it remains the case that the United States is, relative to other countries, both unusually large (third biggest in both land mass and population) and extremely well-educated, and it will be some time before India and China catch up in educational attainment in percentage terms--or, I imagine, before Scandinavian countries (or other small high achievers like Singapore) manage to bring their success to U.S.-size scale. (One of) our big economic advantages is enjoying the advantages of high absolute numbers and perentages simultaneously. The more useful perspective, which really came out in Sir Michael Barber's lunchtime  presentation (note: American audiences can't get enough of references to Winston Churchill, George III, Charles I, etc.), is to focus on the U.S. position in terms of comparable learning results via international tests like PISA, because that gets you past international differences in secondary and postsecondary credentialing systems, and indeed this is an area where there's real cause for concern. 

Friday, September 12, 2008

Hot Boys

Education Sector non-resident senior fellow Peg Tyre, a former education correspondent at Newsweek, is streaking towards the best-seller lists with her just-published book, The Trouble with Boys, a thoroughly researched and deftly written contribution to the raging national debate over if--and if so, why--boys are strugging to stay up with girls in today's increasingly competitive educational culture. Published just three days ago, the book is already among the top two dozen sellers on the both the Amazon and Barnes and Noble lists. An essay Peg wrote for Newsweek's got more than a million hits in 48 hours. She'll be at our offices in Washington on November 13 to discuss the boys crisis, an event that also features former Education Sector policy analyst Sara Mead, who has written extensively about the issue as well.

Roll Tide

Buzz Bissinger, he of Friday Night Lights fame, turns in a very worthwhile read on college football and Nick Saban, head coach of the Alabama Crimson Tide. Bissinger thinks our priorities are a little askew when a football coach earns $3.75 million in base salary, 25 hours of non-commercial airline flights, a free country club membership, two cars for use by his family, and incentive bonuses for reaching a bowl, winning the game, and being named coach of the year. And, oh yeah, graduating his players.

Saban's team went 6-6 last year, meaning he made $583,000 per win. Average faculty salaries at Alabama are $116,00.

Thursday, September 11, 2008

The Google and The Internets

Are you a Virginia resident looking for more information about higher education? Need information on financial aid? The State Council on Higher Education in Virginia has an excellent resource list including the "Internet" and "Libraries." According to the site, libraries, "have resource books with information about national financial aid programs" and the "Internet" provides:
free electronic searches for information about different types of grants and scholarships available to students.
Free electronic searches!! I want free electronic searches. Can someone tell me where I can find this "Internet" thing?

It sure is nice to see our states buckle down and handle the big issues in college affordability with such great resource lists.

Wednesday, September 10, 2008

And the Real Problem Is...

Now that it's September and most college students are back in their dorms, the press has quieted down about the looming "student loan crisis" that made for great headlines a few months ago. As this article, online at the American Prospect, explains, this is because there hasn't been much of a crisis after all. As many people tried to explain amidst the loan crisis hubbub, this is an area where the federal government actually has a functioning back up system in place -- the Direct Loan Program.

The article also touches on the actual loan crisis in higher education - the ever-larger amounts of debt students are graduating with, the growing dependence on private student loans, and the lack of real debt counseling for students (often still teenagers) who sign on the dotted line for tens of thousands of dollars in loans.

Tuesday, September 09, 2008

McCain on Obama on Education

In a new John McCain adverstisement, an announcer says the following about Barack Obama's record on education:
Education Week says Obama "hasn't made a significant mark on education". That he's "elusive" on accountability. A "staunch defender of the existing public school monopoly."
You have to watch the ad carefully to pick up the sourcing, which doesn't exactly follow the text. Education Week only said the first thing, about the "significant mark." The "elusive" line is actually from the Washington Post, and the last, "staunch defender" part is from the Chicago Tribune. And in that case from a Tribune columnist, Steve Chapman, writing here

Are there any rules or accepted practices about this kind of thing? Can you quote some crazy thing from a Bill Kristol or Maureen Dowd column in a political ad and simply source it to "The New York Times."? Obviously, I understand there's no honor among thieves etc., but still...



The Obama Education Speech

Barack Obama delivered what his campaign billed as a "major policy address" on education today in Dayton, Ohio. Excerpts from the prepared remarks and comments below:

Every four years, we hear about how this time, we’re going to make [education] an urgent national priority. Remember the 2000 election, when George W. Bush promised to be the “education President”?

This is an odd criticism. An awful lot of people would probably argue that Bush has been the wrong kind of education President, but he's undeniably been an education President. No Child Left Behind was one of his signature domestic policy achievements and the administration has steadily pushed the issue, for good or ill, ever since. 

The rising importance of education reflects the new demands of our new world.

I suspect these folks would have liked more nuance here. 

"...children here in Dayton are growing up competing with children not only in Detroit, but in Delhi as well."

The likelihood of your city being singled out for attention on education and workforce issues is now crucially dependent on its name beginning with the same first letter as a major Indian and/or Chinese city filled with Friedmanesque software engineers willing to work for ten bucks an hour. See also: Baltimore / Bangalore; Seattle / Shenzen, etc. etc. 

If we want to keep building the cars of the future here in America, we can’t afford to see the number of PhDs in engineering climbing in China, South Korea, and Japan even as it’s dropped here in America.

I'd like to see this and similar sentiments phrased so it's clear that more PhDs in China, South Korea, Japan, and elsewhere is a good thing that will help America in the long run. The world has many vexing problems and the more smart, well-educated people to solve them, the better. An expanded well-educated class in China and elsewhere will create new markets for the kind of high-value goods and services that America produces, and they'll make newer, better products that we'd like to buy. Perhaps most importantly, they'll improve the lives of people in those countries, which we should all care about. Many countries in Europe plus Canada, Australia and others have comparable levels of college degree attainment to the United States and I don't think anyone wishes that weren't the case; indeed it's not a coincidence that those countries are also our military allies, trading partners, etc. And of course Japan already falls into this category. 

The question of whether America is producing enough advanced degree-holders to support a vibrant auto industry or what have you should really be considered on its own terms--terms that I suspect don't have much to with the total number of PhDs (a metric one would anticipate China and India eventually dominating in that they have many more people) or even PhDs per capita, but rather the quality of PhDs plus the many other factors influencing the competitiveness of various industries i.e. health care costs, intellectual property law, infrastructure, integrity of the financial markets, etc. 

If we want to see middle class incomes rising like they did in the 1990’s, we can’t afford a future where so many Americans are priced out of college; where only 20 percent of our students are prepared to take college-level English, math, and science; where millions of jobs are going unfilled because Americans don’t have the skills to work them; and where barely one in ten low-income students will ever get their college degree.

My favorite paragraph thus far. Out-of-control college price increases are a vexing problem that grows worse every year. Low levels of college preparation among college-goers points to the need to greatly improve curricula, instruction, and guidance in high schools. And socioeconomic disparities in higher educaiton should always be defined as they are here, not as the percent of low-income students who go to college but the percent who graduate. 

Lincoln created the land grant colleges to ensure the success of the union he was fighting to save.

A bit of an overstatement. Lincoln signed the Morrill Land-Grant Colleges Act of 1862 into law, but I don't think he had much to do with it's conception; Presidents didn't really pursue legislative agendas back then as they do now. 

In the past few weeks, my opponent has taken to talking about the need for change and reform in Washington, where he has been part of the scene for about three decades.
And in those three decades, he has not done one thing to truly improve the quality of public education in our country. Not one real proposal or law or initiative. Nothing
.

While Virginia Walden Ford did a nice job of making the case for McCain on education over at Eduwonk a couple of weeks ago, in the end this criticism is fair. John McCain has pushed a lot of issues in Congress, both foreign and domestic, but education has never been one of them and was virtually absent from his campaign agenda until relatively recently. 

You don’t reform our schools by opposing efforts to fully fund No Child Left Behind.

True, although Democrats have been running Congress for coming up on two years now and they haven't proposed to fully fund it either. 

Obama's education plan will "finally put a college degree within reach for anyone who wants one by providing a $4,000 tax credit to any middle class student who’s willing to serve their community or their country."

There are plenty of worse ways to spend money than tying college aid to national service. But (per above re: college prices) history suggests that there's no amount of federal student aid that colleges and unviersities can't absorb--and then some--by raising tuition. I'm also not a fan of financial aid via tax credit; the Clinton-era HOPE and Lifetime Learning credits cost the treasury billions of dollars per year, they're not nearly as well-targeted to (per above re: socieconomic attainment disparities) low-income students as are other forms of aid. 

I’ll tell you what’s wrong with No Child Left Behind. Forcing our teachers, our principals, and our schools to accomplish all of this without the resources they need is wrong. Promising high-quality teachers in every classroom and then leaving the support and the pay for those teachers behind is wrong. Labeling a school and its students as failures one day and then throwing your hands up and walking away from them the next is wrong. And by the way – don’t tell us that the only way to teach a child is to spend most of the year preparing him to fill in a few bubbles on a standardized test.

Unsatisfying. Fundamentally, the NCLB debate is not about resources. Even a "fully funded" NCLB would provide less than five percent of what it costs to run the nation's K-12 school system. The debate is about how best to measure educational success and what do when we determine that success is insufficient. Reasonable people can differ profoundly on those questions, but I'm pretty sure nobody is for "throwing up your hands and walking away from them." Similarly, re: "don't tell us..."--who, exactly, is telling us this? That's just a straw man and a flimsy one at that. 

We need assessments that can improve achievement by including the kinds of research, scientific investigation, and problem-solving that our children will need to compete in a 21st century knowledge economy.

Yes, we do! Education Sector will be releasing a new report on this very topic next month. Watch this space for details.

It’s time to ask ourselves why other countries are outperforming us in education. Because it’s not that their kids are smarter than ours – it’s that they’re being smarter about how to educate their kids.

An important acknowledgment that educational failures are often the result of educational problems, which is surprisingly hard for some people to admit. 

A while back, I was talking with my friend Arne Duncan, who runs the Chicago Public Schools. He was explaining how he’d managed to increase the number of kids taking and passing AP courses in Chicago over the last few years. What he said was, our kids aren’t smarter than they were three years ago; our expectations for them are just higher.

Right on.  

...as President, I’ll double the funding for responsible charter schools.

Arguably the most significant line in the speech. I take this as a clear commitment to public school choice and multiple ways of building and governing public schools, BUT with a strong emphasis on quality and accountability, i.e. "responsible," or as Obama goes on to say, "Charter schools that are successful will get the support they need to grow. And charters that aren’t will get shut down." This is one of those issues where I think there's really not much room for reasonable debate:  Of course we should give parents choices among public schools and create new pathways for entrepreuneurialism and innovation, and of course that should only happen in a context of meaningful public accountability beyond simple market forces.  As Eduwonk notes, the fact Obama delivered this kind of sharp message in Ohio, where charters have been very controversial, is meaningful.

And when our teachers succeed in making a real difference in our children’s lives, we should reward them for it by finding new ways to increase teacher pay that are developed with teachers, not imposed on them. We can do this. From Prince George’s County in Maryland to Denver, Colorado, we’re seeing teachers and school boards coming together to design performance pay plans.

This is another step toward the new consensus around teacher pay, which is that everyone now concedes that some kind of differentiation beyond the standards steps-and-lanes experience + credentials system is needed, so the real debate is about paying teachers for what other things and how. The politically safe approach is to limit this to teaching in shortage areas and hard-to-staff schools, so just by using the phrase "performance pay," Obama sends a good signal.

teachers who are doing a poor job will get extra support, but if they still don’t improve, they’ll be replaced. Because as good teachers are the first to tell you, if we’re going to attract the best teachers to the profession, we can’t settle for schools filled with poor teachers. 

Again, simply talking about "poor teachers" and the general idea of firing teachers for poor performance is, in and of itself, valuable for the purposes of moving this debate to reasonable ground. Since these issues tend to play out district-by-district at the contract neogotiation level, there's little a President can do to influence them on the policy front, but the bully pulpit affects the tenor of highly public negotiations like those that are going on DC right now, in terms of how the press reacts, how the national unions choose to intervene, how much political capital local leaders are willing to expend, etc. 

I’ll create a parent report card that will show you whether your kid is on the path to college. We’ll help schools post student progress reports online so you can get a regular update on what kind of grades your child is getting on tests and quizzes from week to week. If your kid is falling behind, or playing hooky, or isn’t on track to go to college or compete for that good paying job, it will be up to you to do something about it.

The college prep part of this is, if properly implemented, a very good idea. The speech notes above that only 20 percent of student who go to college are fully prepared to succeed there. That's a frightening number, and most students and parents simply don't know if they're on that track until it's too late. They take classes in high school, pass them, earn their diploma, apply to college, get accepted, and enroll, and only then find out that they should have taken a whole different set of course, years before. 

The speech finishes off with more China and India stuff. Again, we need to talk about these competitive threat issues in more sophisticated non-zero-sum terms. 

Doing School Choice Wrong

Today, ES released a Charts You Can Trust (a Maps You Can Trust, really) showing the failures of Massachusetts' interdistrict choice program--failures which mean that affluent students are more likely to benefit from the interdistrict choice law. Problems with the law include a lack of transportation to get students to their new schools; a lack of outreach to parents to inform them of their new options; and allowing school districts to opt-out of the program, which means that only one of the districts surrounding Boston has opened its doors to new students.

These problems are not unique to Massachusetts. Many states with open enrollment laws that allow students to cross attendance boundaries and school district lines to attend the school of their choice have similar shortcomings--and similar results.

But this isn't to say that interdistrict choice can't be done well--it can, but it costs more money to provide transportation and outreach to families. And it means making the politically difficult decision to require all districts to participate. As we reported a couple weeks ago, interdistrict choice has potential to help students in some areas, but there are limits to what it can achieve and it needs to be done well to avoid the pitfalls of policies like Massachusetts'.

Monday, September 08, 2008

Why the U.S. News Peer Survey Will Never Die, and Probably Shouldn't

The Yale Daily News reports that, in a "major statement," Yale refused to fill out the U.S. News & World Report college rankings peer reputation survey this year, while also refusing to join other private colleges and universities in signing a letter promising to boycott said survey. To begin, this is only true if by "major" you  mean "cautious, difference-splitting and not particularly important." Moreover, those who think the declining participation rate in the U.S. News survey will eventually render it inoperable and thus de-legitimize the rankings are kidding themselves, for two reasons. 

First, because U.S. News can always survey someone else. (Note: there's a nugget of conventional wisdom out there that U.S. News changes its methodology every year so the rankings will be shuffled and thus generate news. While there were changes in the past, this is at least the fifth or sixth consecutive year in which there have been virtually no alterations, so that meme should be laid to rest.)  

Second, because for every institution that's hurt by the survey, which makes up 25 percent of each college's score, another benefits and will thus likely continue filling out the form. And looking at which are which, the survey probably makes the rankings better, not worse. 

Among the "first tier" Top Fifty national universities, here are the ten with the biggest negative difference between their peer reputation ranking and overall ranking, with the ordinal difference in parentheses. In other words, these are the top schools whose U.S. News ranking most exceed the esteem of their peers:

Lehigh (-14)
Wake Forest (-13)
Emory (-12)
Notre Dame (-12)
University of Rochester (-12)
Tufts (-11)
Brandeis (-10)
Washington University in St. Louis (-8)
Rice (-7)
Boston College (-7)

Here are their counterparts on the flip side, those whose rankings are lower than the peer survey would indicate:

UNC-Chapel Hill (+10)
UC - Davis (+10)
Penn State (+10)
University of Florida (+10)
Georgia Tech (+11)
Washington University (+11)
University of Michigan (+13)
UC - Berkeley (+15)
UW - Madison (+15)
Illinois at Urbana-Champaign (+16)
UT - Austin (+23)

The difference is obvious -- all of the over-ranked universities are private, while all of the under-ranked universities are public. That's because public universities, being large and on some level committed to enrolling a diverse student body, tend to fall short on other components of the rankings that favor a small, wealthy student body: alumni giving rates, percent of applicants who are rejected, median SAT scores, percent of students from the top 10 percent of their high school class, etc. 

While the peer survey is in many ways rooted in unexamined reputations that go back decades or more (and  the entire U.S. News methodology should of course be replaced with something completely different and much better), it at least has the effect of limiting the ability of universities to spend their way up the rankings through pure marketing and fundraising tactics. That's a good thing, and the reason you'll never see a Rose Bowl Coalition of Big Ten and Pac Ten universities joining the boycott. 

Michelle Rhee's "Plan B"

It looks like Michelle Rhee wants to bypass the teacher’s union and link teacher licensure to “effectiveness” as determined by OSSE. The union has already tripped up, in my opinion, by rejecting the principle of the idea and upsetting people like Kevin.

But really, they have a point about the nuts and bolts problems of teacher evaluation in DC. In all the coverage of the DC contract negotiations, no one seems to have noticed or cared that this year’s DC-CAS scores didn’t come back in time to be used for teacher ratings. That means teachers couldn’t be evaluated by the standards for success they set for themselves in September. Evaluations were done anyway, regardless of the fact that the system didn’t provide teachers with the evidence they needed to prove their effectiveness.

Would you want to bet your teacher’s license on the OSSE bureaucracy’s ability to fix the teacher evaluation process all at once? Or would you ask that they demonstrate a working system of evaluation before they tie it to your livelihood? I don’t think it’s asking too much that teachers at least be able to examine the evaluation process the Chancellor wants to use before she uses it to fire them.

The Competition Effect Emerges

I like the Council of Great City Schools and it's director, Mike Casserly, but I confess I'm not really sure what he's getting at here. He's right that muddled governance and Congressional meddling have done DCPS no favors through the years. But his thesis that the lack of coordination between DC's three-part arrangement of a regular district, charters schools, and vouchers is the big problem (really two-and-a-half parts; the voucher program is small, thus far ineffective, and unlikely to grow) strikes me as off. He says:

The issue here is neither the voucher program nor charter schools themselves. It is a Congress and other political leaders who have established two alternative systems that now run parallel to the D.C. school district without boosting its capacity to get better. If this arrangement created competitive pressures to improve, it would have worked in the students' favor. But there is little to suggest that is happening here or in other cities. Instead, D.C.'s educational system is more fractured than ever, with little common ground among boosters of either strategy.

"Little to suggest"? That's hard to square with the following excerpt from an interview with George Parker, president of the Washington Teachers Union (from NCTQ per Flypaper):

Have your views of the role of the union changed over time? How?

I think it has a lot to do with the landscape in the system right now. We have the second highest number of charter schools-56 or 57 charters. So we are in a competitive market here in D.C.

The union has now had to take on a dual role. Previously our main concern was bread and butter issues—to make sure teachers have good benefits and working conditions. We didn’t have to be that concerned about keeping children in [D.C. schools]. But now around 21,000 of our students are in charters and around 45,000 in public schools. We lost 6,000 students last year. The charter schools have created a competition where the very survival of the union and the job security of our teachers is not dependent on the language in our contract. It is dependent on our ability to recruit and maintain students because we are funded pretty much by the number of students we have enrolled in the public system.

It puts the union in a different light. It’s not just the contract that protects jobs but also student enrollment. We are expanding our professional development because that impacts student achievement and if parents perceive we improve student achievement then we stand a better chance of getting students back who moved to charter schools. The more students we have, the more teachers we can employ, and the more security we can develop in terms of jobs.
Meanwhile, this is Michelle Rhee being interviewed by John Merrow:

JOHN MERROW: What is your relationship with these charter schools, with these KIPP schools? Are they your competition?

MICHELLE RHEE: Well, I mean, I certainly think that, in some ways, you know, they are, but we have 100,000 school-age kids in Washington, D.C. I want every single one of those kids in an excellent school.

JOHN MERROW: But you are losing students. You've 100,000 school-age kids, but you're now at around 50,000.

MICHELLE RHEE: Correct.

JOHN MERROW: You're hemorrhaging students. Is that a concern?

MICHELLE RHEE: I believe that, when we begin to, on a consistent basis, have schools that have compelling, and engaging, and rigorous programs for kids, will we begin to attract back and see our numbers start to go in the other direction? I absolutely think so.

Anything's possible but when the head of the teachers union says we need to do A, B, and C to respond to competition from charter schools and the chancellor says we need to do X, Y, and Z, to win back students we lost from charters school, perhaps some kind of competition is in fact occuring.

And while "fractured" has an inherently negative ring to it, one could argue that giving charter schools space to develop in a way that's wholly insulated from DCPS and all its problems has not been such a bad thing.

Friday, September 05, 2008

Full-Service Schools

I had the good fortune to moderate a symposium on education policy in Denver last week hosted by Mayor John Hickenlooper. It was one of ten non-partisan events the host city organized in conjunction with the Democratic National Convention on wonky topics ranging from global warming to transportation infrastructure.

There were several highlights to the conversation among the ten panelists at the Denver Center for the Performing Arts, including a declaration by John Wilson, the executive director of the National Education Association, that his union is open to changes to the traditional single salary schedule for teachers. A couple of weeks earlier, the NEA's Denver affliate had theatened to go on strike during the convention over Denver's closely watched alternative to the single salary schedule, called ProComp.

The Denver Classroom Teachers Association had originally signed onto the four-year-old experiment, which combined incentives pay for working in tough-to-staff schools with performance pay tied to strong evaluations, student achievement, and professional development work. The local started making feints towards the picket line in part because superintendent Michael Bennet wanted to give less experienced teachers larger raises than veterans to lower attrition among the city's newer teachers.

Bennet got most of what he wanted in a deal signed during the convention. Word has it that the Obama campaign suggested to the NEA that it probably wouldn't be in the interest of the Democratic party and the several hundred NEA members serving as Democratic delegates to have images of striking teachers playing on a continuous CNN loop in the middle of the convention.

On another topic, Paula Prahl, a vice-president at Best Buy, a symposium sponsor, offered up one of the pithier formulations on public school finance that I've heard: Our dependence on the property tax system to fund public education has turned public schooling into a property right. So if you don't have property [ie, if you don't live in a school system with decent property values], you don't have the right to a good education.

But for my money, KIPP founder Mike Feinberg made one of the most important contributions to the roundtable discussion, which in addition to Wilson and Prahl included Walter Isaacson of the Aspen Institute, former Colorado Governor and LA school superintendent Roy Romer, Obama advisor Jon Schnur, billionaire school refomer and philantropist Eli Broad, former Cleveland superintendent Barbara Byrd-Bennett, and a number of others in the school reform and corporate worlds.

In response to a question from one of the 350 or so people in the audience about whether schools should be expected to overcome the many disadvantages that students from poor families bring to the classroom, Feinberg pointed out the KIPP is build on the premise that there should be high expectations for all kids--and that schools serving kids from impoverished backgrounds need to surround them with support. KIPP provides a longer school day and school year, tutors, parent education programs, and host of community partnerships that supply vision screening, health care, counseling and other services.

KIPP, it struck me as Feinberg was speaking, suggests the futility of the now-several-months-long debate between two rival camps of mostly Democratic school reformers. The first, the Education Equlity Project, a coalition of reformers, urban political leaders, and civil rights advocates organized by New York City schools chancellor Joel Klein, is advocating a regulatory reform agenda: rigorous standards, school accountability and, above all, changes in the way teachers are hired, fired and compensated. The project is the brainchild of Klein's deputy, Chris Cerf, who has sought to build a coalition of African American political leaders to counter the influence of teachers' union in urban education. Cerf believes that it's going to take minority communities and their elected representatives standing up to the unions to win the new teacher compensation systems and other changes that he, Klein and others are pushing to attract and keep talent in urban schools.

The EEC was out in force in Denver, co-sponsoring a press conference and panel discussions featuring rising African American political stars like Corey Booker of Newark and Adrian Fenty of Washington.

The other group, formed by the liberal Economic Policy Institute, argues in a manifesto called the Broader, Bolder Approach to Education that it's not reasonable to assign to schools alone the challenge of, or the responsibility for, educating disadvantaged students. It's unfair to expect schools to bear that burden without the help of better health care and housing and improvements in other aspects of the lives of the disadvantaged.

The two factions have polarized the school reform debate dramatically in recent months. Needlessly, the KIPP model suggests. Many KIPP schools have produced impressive results by combining the core elements of both camps. They have reconfigured the school day and the school year. They have rethought teacher recruitment, roles, and compensation. And they have demanded accountability from every adult in their buildings. At the same time, many of the 66 KIPP schools around the country have sought to address head-on the dearth of social capital among many of their students and have extended their relationship to their students far beyond the classroom to help improve their students' readiness to learn.

At their best, they represent a new breed of innovative youth service and education centers. It's a model for the rest of public education, though one that raises a lot of issues for public educators and school reformers alike, as I'll discuss in a forthcoming Education Sector report.

"would not benefit..."

A little after noon today, the Washington Teachers Union (WTU), an affiliate of the American Federation of Teachers, sent an email to its members that begins as follows:


Dear [member],

The Office of the State Superintendent of Education (OSSE) has proposed regulations that would require a DC Public School (DCPS) teacher to demonstrate effectiveness as a condition for teacher licensure renewal. This proposed regulation would not benefit DCPS teachers, as a teacher's true effectiveness should not be linked to a teacher's right to renew his or her license.

The email goes on to label as "dangerous and discriminatory" a proposal that would create "a new Advanced Teaching Credential that would require a candidate to demonstrate effectiveness to continue teaching in a District of Columbia Public School." It then offers a sample letter for members to write to DC elected officials, including the following:

The Office of the State Superintendent of Education (OSSE) has proposed a new Advanced Teaching Credential that would require new and current teachers to demonstrate effectiveness in order to obtain licensure renewal. Clearly these proposed regulations would not benefit DCPS and have no relationship to student achievement.
I understand that the WTU has an obligation to look after the interests of its members. That's what it's there for, and there's nothing wrong with that. Indeed, I think a well-functioning school system requires teachers who are well-represented and have their voices heard. And while it's easy to be self-righteous and say "we need to worry about what's good for the children in our schools, not the adults," that's an extreme and ultimately self-defeating formulation. The adults in the schools will determine whether the children are well educated. Both interests must be served. When those interests collide, as they sometimes do, they should be balanced. It's fair to say that adult interests have had too much sway in many cases, but we can't pretend they don't exist. I suppose it'd be in the best interests of students for adults to work 14 hours a day, 7 days a week for $10,000 a year, but I don't think anyone could reasonably suggest that teachers be forced to do so.

The letter also makes the fair point that it could be confusing and problematic to have the OSSE engage in a teacher evaluation process that's separate from or overlapping with processes conducted by the district itself. The WTU calls for a comprehensive and ongoing process" of teacher evaluation that "uses clearly-defined standards." I agree.

But--it's hard for me to attribute reasonableness and good faith to the WTU in all of this when they say that "a teacher's true effectiveness should not be linked to a teacher's right to renew his or her license." That's a clear line, and they're on the wrong side of it. Nobody deserves the right to a job irrespective of their ability to do it well, particularly not people who teach schoolchildren.
It's also hard to credit the idea that the proposed regulations "clearly" have "no relationship to student achievement" when, as the letter notes, the final regulations defining the Advanced Teaching Credential haven't even been issued yet.

The bottom line is that the teaching profession needs to become more attuned to and aligned with the reality of teacher effectiveness, defined as success in helping students learn. There are all kinds of difficult issues to contend with in getting there. But the kind of principled rejection of that idea embodied in this letter will marginalize teachers unions in a way that serves no one well in the end.

Update: Interesting comments thread on this here.

Thursday, September 04, 2008

Backward, Forward, Upside-Down

Last week, Post business columnist Steven Pearstein praised the Fenty/Rhee proposal to pay teachers much more money in exchange for more accountability and less tenure. In doing so, he also acknowledged the tradeoffs and potential complications:

Sure, there will be times when teachers will be treated in an arbitrary and capricious way if they give up their tenure rights. Guess what: It happens all the time in the private sector, where hiring, promotion and pay decisions are sometimes made with incomplete information, favoritism, or undue emphasis on one factor or another. But despite this imperfection, despite the numerous instances of unfairness and poor judgment, somehow the vast majority of Americans manage to find a job, move up the ladder and enjoy their work, and companies manage to operate successfully and turn a profit.

Leo Casey of the United Federation of Teachers in New York responded to the above by saying, "In short, non-union employees are regularly screwed, so why should unionized teachers expect a fair shake? Can anyone say “race to the bottom?”

I think Leo is getting the directionality wrong. To be sure, there are millions of workers in jobs that combine low wages, few benefits, and a high degree of vulnerability to the caprice and ill intentions of management. Unions have historically played a tremendously valuable role in lifting such workers up, giving them the compensation, stability and dignity they deserve.

That said, there are also steps on the career and professional ladder above and beyond solid, reasonably paid union and civil service-type jobs: management and the highly-paid professions. Once people move into this realm, they start to relinquish the very same workforce protections and guarantees that they gained when they moved from poorly-paid, unstable positions into the the solid middle. But they do so from a very different position, one that affords them far more power to negotiate in the labor market and more flexibility to make choices about where to work.

The Fenty/Rhee proposal is really about moving teachers up into that third category. It's a race to the top, not the bottom. That comes with serious implications for the nature of teacher collective bargaining, which is why the DC contract negotiations have taken on larger national significance. But it's a conversation that has to happen if schools are going to get the kind of talented, highly-paid teachers they need. (Read more on this from Paul Tough at his new temporary Slate education blog here.)

Boast Away

Like all good Ohio State University alumni (M.P.A. ‘95), I’ve been preparing to obsessively follow the highly-ranked Buckeyes football team from the pre-season all the way to the traditional blowout loss in the National Championship game on January 8th. But this year my loyalties are divided. I have a new favorite team: the aptly-named Mavericks of the University of Nebraska at Omaha, which recently had the temerity to issue a press release announcing that it may be doing a particularly good job of helping its students learn.

Oh, the controversy! By citing its unusually high scores on the Collegiate Learning Assessment, UNO was either giving in to satanic temptation or paving the way for totalitarian dictatorship, depending on who you asked. “Shame,” said one anonymous commenter at Inside Higher Ed. “Lies,” said another. “Gamesmanship,” said an official at the State University of New York at Binghamton, lamenting that his faculty’s hard work in developing local assessments would be undone.

Well, that’s easy for him to say. Binghamton is the flagship university in the SUNY system. It can pick and choose from among the best students across New York State and nationwide, most of whom come from relatively well-off backgrounds and enroll full time, living on-campus or nearby. Binghamton’s median SAT scores are high, funding levels generous, and scholarly reputation strong, leading U.S. News & World Report to rank it as the 37th best public university in America — sorry, 34th best, up three from last year, which Binghamton proudly announced on August 22nd. In a press release.

Apparently, it’s perfectly OK to boast about your performance on a measure that’s highly correlated with, and partially based on, how well your students did on a standardized test they took when they were juniors in high school. But a test of how much they learned after enrolling? Gamesmanship!

Read the rest of this column here at Inside Higher Ed.

Wednesday, September 03, 2008

The Loving Hardass

I'll second Kevin's link to Sherman Dorn. Sherman's post does a nice job splitting the difference between the Education Equality Project and the Broader, Bolder Approach to Education. Read it all, but note especially his title, "The Loving Hardass." I think that's about right where we should be in accountability for schools: we should not forget that we're working with children from diverse backgrounds, nor that we have a responsibility as adults to do our jobs as best we can with what we have.

That said, Sherman's even-handed approach lacks the insistence necessary for change. We need our education leaders to say, with more frequency and greater urgency, things like, "We can prove it doesn’t matter what the color of your skin is or what your home life is -- every single child can achieve." We need more speeches that include unequivocal lines like this one:

For the children who are denied the education they need to fulfill their God-given potential, it is a personal tragedy, and an inexcusable injustice. It is also an affront to American values, and a threat to America’s role as an incubator of innovation.

This must change.
Contrast the above quotes with this, the third graf of the Broader, Bolder Approach to Education:
Evidence demonstrates, however, that achievement gaps based on socioeconomic status are present before children even begin formal schooling. Despite the impressive academic gains registered by some schools serving disadvantaged students, there is no evidence that school improvement strategies by themselves can close these gaps in a substantial, consistent, and sustainable manner.
Ignoring for a moment what type of message this sends, consider that the word "education" appears in the Broader, Bolder title. It isn't a "Broader, Bolder Approach to Social Policy" or a "Broader, Bolder Approach to Children's Policy." The authors specifically chose to include the word "education" in the title, but spend the brunt of the statement asking for an expansion into early childhood education and health services and for education policymakers to pay more attention to student experiences outside of school. Again, those are worthy goals, but they ignore what schools can do. Writing in Democratic Education, in 1987, Amy Gutmann had a strong rebuttal to this point that still applies today:
Among the many myths about American education in recent years has been the view that schooling does not matter very much--except perhaps for the pleasure it gives children while they experience it--because it makes little or no difference to how income, work, or even intelligence gets distributed in our society. Like most myths, this one has no apparent author but a lot of social influence. Unlike some myths, the myth of the moral insignificance of of schooling distorts rather than illuminates our social condition. Its prophecy--of inevitable disillusionment with even our best efforts to educate citizens through schooling--is self-fulfilling because it pays exclusive attention to the question of whether schools equalize and neglects the question of whether they improve the political and personal lives of citizens.

Tuesday, September 02, 2008

Sweet

Reading the somewhat positive reviews of Matthew Sweet's new album generated a fit of early-90s nostalgia over the weekend, so I threw the trio of albums he recorded with Robert Prine, Richard Lloyd et al into the car and gave them a re-listen while driving around town doing errands and such. Conclusion: still really good! But while Altered Beast and 100% Fun are certainly minor classics, 1991's Girlfriend remains a certified desert island-quality pop-rock masterpiece. On one level it's just another piece of evidence supporting the first principle of musical greatness, namely that while talent, hard work, and inspiration can take you far, the path to true immortality necessarily involves falling deeply in love only to have your heart ripped from your chest, thrown to the ground, and stomped so badly that you have no choice but to write songs about it because nothing else can ease the pain. Yet Girlfriend is also noteworthy for being a particularly comprehensive example of the genre, narratively speaking. Blood on the Tracks is mostly aftermath, a pure howl of rage. Rumours demonstrated the commercial potential of keeping the band together after everyone cheated on and betrayed everyone else--no easy trick. (Sleater-Kinney managed this for one song but I suspect the wounds in that case didn't go so deep.) In Girlfriend, Sweet takes nearly half the album explaining the precursors of his failed marriage, laying out with brutal honesty how his own obsessive neediness and impossible expectations sowed the seeds of the inevitable breakup. Then, the gut-punched anger of "Thought I Knew You" on track 8 is followed by sadness ("You Don't Love Me"), defiance ("I Wanted to Tell  You"), and so and so forth all the way to the philosophic resignation of "Nothing Lasts," the original title of the album. Of course, the perspectives of heartache have their limitations--some things last. Girlfriend, for one. 

Dorn Speaks

I've sort of resisted buying into the "dueling manifestos" charaterization of this and that, since the makers of the respective documents insist that wasn't their intent and I'm inclined to believe them. Nor are they really written in a way that allows for clear comparisons. But in the end it's fair to say that they represent two competing perspectives on education reform and the dueling meme seems inescapable, so with that in mind let me say that I find very little to disagree with in Sherman Dorn's lengthy take on the subject and I recommend it for those who really like diving into these weeds.

Monday, September 01, 2008

A Great School Depression?

Not to be insensitive (okay, maybe a little), but color me skeptical of Sam Dillon's new piece in the New York Times, "Hard Times Hitting Students and Schools," which stitches together a variety of anecdotes and data points related to mortgage foreclosures, rising food and fuel prices and state budget shortfalls into a picture of school fiscal distress that's almost surely overblown. And in some cases, misses the point entirely:
Responding to a cut of $43 million by the state in education spending and to higher energy and other costs, school officials in Jefferson County [Kentucky] have raised lunch prices, eliminated 17 buses by reorganizing routes, ordered drivers to turn off vehicles rather than letting them idle and increased property taxes.

and:
West Virginia officials issued a memorandum recently to local districts titled “Tips to Deal With the Skyrocketing Cost of Fuel.” Last week, David Pauley, the transportation supervisor for the Kanawha County school system, based in Charleston, met with drivers of the district’s 196 buses to outline those policies. Mr. Pauley told them to stay 5 miles per hour below the limit, to check the tire pressure every day and to avoid jackrabbit starts.

As others have noted, school transportation is notoriously inefficient, wasteful and polluting. Rather than characterizing the above as evidence of a terrible financial crisis, it would make a lot more sense to call it what it is: a case of rising fuel prices causing schools to implement common-sense fuel efficiency measures that should have been in place a long time ago, and we're all better off as a result. 

Also:
In interviews, educators in many states said they were seeing more needy families than at any time in memory.

The national poverty rate didn't change in 2007 and while the economy seems to have deteriorated since then, I doubt poverty has suddenly yanked back up to where it was in the early 1990s. The article also cites an increase in the number of students applying for free- and reduced-price lunch. It's worth noting that those numbers held steady and in some cases rose all the way through the late 1990s, even as poverty fell to historic lows in 2000, so that measure doesn't have a great track record in terms of sensitivity to changing poverty conditions. 

The point being, we (a) live in a big, diverse country, and (b) have not vanquished the business cycle, so there will inevitably be places and times when the fiscal fortunes of schools and students take a turn for the worse. But if you simply pick and choose the most alarming numbers and quotes, you're almost surely going to portray things as worse in the aggregate than they really are. 

Sunday, August 31, 2008

Words from Vowell

Sarah Vowell offers a paeon to Pell Grants:

I paid my way through Montana State University with student loans, a minimum-wage job making sandwiches at a joint called the Pickle Barrel, and — here come the waterworks — Pell Grants. Thanks to Pell Grants, I had to work only 30 hours a week up to my elbows in ham instead of 40.

Ten extra hours a week might sound negligible, but do you know what a determined, junior-Hillary type of hick with a full course load and onion-scented hands can do with the gift of 10 whole hours per week? Not flunk geology, that’s what. Take German every day at 8 a.m. — for fun! Wander into the office of the school paper on a whim and find a calling. I’m convinced that those 10 extra hours a week are the reason I graduated magna cum laude, which I think is Latin for “worst girlfriend in town.”

People tend to talk and think about student financial aid and college access in pretty straightforward terms: College is the kingdom of opportunity, but they charge at the gate to get in. Give students financial aid and they'll go to college; don't give them aid and they won't.

But while economics tells us that there must be students whose go / no-go college attendance decisions are affected by marginal differences in price, in the grand scheme of things it's pretty clear that most students are going to college whether or not Pell Grants and other aid programs are well-funded. College has doubled in price in real dollars over the last two decades, aid programs haven't kept up, yet the percentage of high school graduates going on to higher education hovers at an all-time high. 

Most students, in other words, are entering the kingdom, one way or another. The real difference financial aid makes is in what happens when they get there. Spiraling tuition is forcing more low-income students out of the four-year sector into community colleges, and while you can get a great education in the two-year sector, your odds of ultimately earning a bachelor's degree are much lower. Without sufficient financial aid, a lot of students are forced to work near full-time, and while Sarah Vowell went on to the pages of the New York Times, studies show that working 30+ hours a week is a significant risk factor for dropping out before earning a degree. Or students grind through, but miss the experiences that make college so worthwhile. Or they finish, but buckle under the burden of debt (un-dischargeable in bankruptcy, thank you Sallie Mae) five or ten  years down the road. 

In other words, Pell Grants don't always make the difference between nothing and something when it comes to a college education. But they do make the difference between something and something worth having. 

Thursday, August 28, 2008

Commendable Commentary

This blog hasn't had comments for that long, and I'm hoping more people will use them as a chance for substantive dialogue that focuses on the topic of the post in question, as opposed to anonymous shot-taking and/or general complaint. In that spirit, let me heartily commend the second comment in this post, in which the author identifies herself by name and offers some intriguing new information and perspectives about inter-district choice and the example of Piedmont Unified School District in Oakland. I had written:

The starred school in middle is located in Piedmont School District, which is very affluent and literally built on a hill surrounded on all sides by Oakland Unified School District, a high-poverty district with rock bottom test scores that's been subject to state takeover in the past. There are four low-performing Oakland schools within a five minute drive of the Piedmont school and at least nine within 20 minutes. I think we can all agree that even under the rosiest of scenarios, the Piedmont school couldn't quintuple in size, or more, to accomodate transfer students.

To which she responded:


Hi: I live in Piedmont, which is now surrounded by very affluent areas of Oakland (including, I believe, the four top-rated elementary schools in Oakland, which sometimes SURPASS Piedmont's elementary schools in their API scores--Thornhill, Montclair, Joaquin Miller, and Crocker Highlands).

When Piedmont was chartered as a city 100 years ago, it was a dairy settlement way up above the city of Oakland, which at the the time was centered right next to the Bay. Over the past 100 years, Oakland has grown up and around pre-existing Piedmont. Home prices in Piedmont average about $300,000 more than similar houses across the line in Oakland. About $1.3 million compared to $1 million, for a typical 3/2 home in the three Piedmont zips and the corresponding Oakland zips (that is, Oakland and Piedmont are both in 94611, 94610, and 94618).

"Parcel taxes" for schools (because, of course, property taxes are strictly limited across the state by Prop 13) are now at about $1500/home above what a home in Oakland would pay (zero). Realistically, the PUSD would never open its doors in a serious fashion to Oakland residents, because the value of property across the town (3400 homes x $300K each = about a billion dollars) would drop by about a billion dollars.

But note that the big beneficiaries would NOT be high poverty communities, because surrounding areas are not high poverty. They are high-income--Montclair, Claremont Hills, Claremont Pines, Crocker Highlands, Ridgecrest, Piedmont Pines, Piedmont Avenue, etc.

Interesting! A couple of thoughts on this. As Erin notes below, some have critiqued the framing of our report, which estimates that "only" 10 - 20 % of students could benefit from inter-district choice, when that's in fact a lot of students and thus the findings could just as well be presented in more positive terms. Which is a fair point; realistically, improvement happens through the accumulation of multiple initiatives each doing their part.

But it's important to keep in mind that those numbers are a best case scenario given the assumptions we chose. That's the number you get if every single higher performing school opens its doors to out-of-district students and the maximum possible number of students choose to travel. As the comment notes, there are, in some communities, very powerful social and financial incentives for high-performing districts not to make that choice. That doesn't mean those barriers can't be overcome, but it's safe to say that commensurately large amounts of political and financial capital will be required to do so.

And that raises the issue, per Erin, of balancing costs and benefits. You can bribe high-performing districts to accept transfer students, but that by definition involves directing scarce resources to schools that likely have the fewest educational needs. Inter-district choice also creates signficant new transportation costs, born either by parents or the taxpayers, directing resources to activities that are fundamentally non-educational in nature. Connecticut spends something like $3,000 per student to bus Hartford kids out to the suburbs. That's about what some of the best urban charter schools spend above and beyond normal per-student allocations to extend the school day, provide extra tutoring, lower class size etc.

Inter-district choice can be a good policy for some students in the right circumstances. But it's not going to absolve us from the pressing need to build more, better schools, including more schools of choice, in the neighborhoods and communities where disadvantaged students actually live.

Technical Note: As I should have made clear in the original post, all of the schools on the Piedmont map are high schools. It's true, as the commenter notes, that there are some high-performing elementary schools in Oakland near the Piedmont border, and they're in an attendance area that feeds into a high-performing Oakland high school (the other star on the map). But there are still a whole lot more low-performing high schools in Oakland than high-performing ones, and the students there can't all transfer to Piedmont.

Say No to Cheap Choice

On Tuesday, Matthew Yglesias commented on the report ES released this week on interdistrict school choice (see below for more posts about this). Yglesias questions my use of the word “only” to discuss our finding that 10 to 20 percent of students would likely benefit from interdistrict choice. Instead he argues that for the students who do benefit, it’s worthwhile. This brings up an excellent question – if a reform is likely to impact a minority of students, but will substantially benefit those students, is it worth the costs? Or, more appropriately, how much in additional resources is it worth expending for the benefit of a minority of students?

This is a question that plagues many choice proposals, which often can only serve a minority of students. And with interdistrict choice, the costs can be pretty high, so policymakers would rightfully want to impact a substantial number of students, even if it isn't the majority. Effective interdistrict choice requires additional transportation to get students to their new schools, financial incentives to get higher performing schools to participate, and academic support for transferring students. It’s critical that a school district or state interested in implementing interdistrict choice carefully weigh these costs with a realistic estimate of the number of students who will benefit—in some areas it will be a lot, and in others only a few. A worse-case scenario is a policymaker trying to scrimp on these costs— introducing a “cheap choice” program that is ultimately detrimental both to goals of integration and student achievement.

Reality Time

Matt Yglesias observes the spate of union-sponsored Fenty-bashing at the Democratic national convention, driven in large part by the Fenty administration's proposal to pay teachers a lot more money in exchange for more accountability and less job security, and doesn't like what he sees. (Side note: let's all agree to apply some standards of objectivity and reasonableness in the use of the word "bashing." If you're, say, handing out flyers that call someone a "budget-shattering, union-busting, promise-breaking political boss whose poor performance and bad management are costing DC taxpayers millions of dollars," that's bashing. If you say "Fenty's policies would be bad for teachers and public education, and here's why," or, alternatively, "The union position is short-sighted and will degrade the quality of the teacher workforce," that's not bashing, which implies a certain level of name-calling, histrionics, and barely-concealed rage.) Matt notes that:

DC is, at this point, in better financial shape than the vast majority of American localities and also has much worse schools. Under the circumstances, it’s the best possible opportunity for teachers to get what Rhee’s putting on the table — generous reform that puts real resources on the table and thereby keeps teaching as an attractive career path even while building some additional accountability into the deal.
Teacher salaries have been stagnant for a long time. They don't get paid as much as other other well-educated professionals whose jobs require similar levels of training and hard work to do well. Teachers and their representatives in organized labor think this is unfair and would like it to change. And they're absolutely right to do so. It would be great to see teachers consistently making six-figure incomes. A lot of them deserve it, and it would send powerful signals to the job market about the nature and status of the profession.

But the idea that those kinds of dollars are going to arrive without some significant tradeoffs in terms of accountability and job security is a complete fantasy. It will never happen. And the circumstances under which it can happen are fairly uncommon: A powerful sense of need--i.e. a school district whose educational challenges justify the infusion of resources--plus leaders with access to those resources and the willingness to let teachers decide for themselves whether or not to participate. In other words, the deal isn't getting much better than this.

Critics have raised the usual objections about the potential for favoritism and bias in the evaluation process, the spectre of good teachers losing their jobs because they happened to get a particularly tough group of students one year, things went pear-shaped on testing day, etc. But let's think about that for a moment. Here you have a mayor and schools chancellor who've staked their careers and reputations on turning around the school system. To do that, it's vitally important for them to hire, retain, and support good teachers. It would, therefore, be shockingly dumb to start arbitrarily firing good teachers or otherwise treat them unfairly. Fenty and Rhee have every incentive to make sure their evaluation process is sound. If they don't, their jobs are the ones at risk.

This highlights the importance of understanding how the major threads of school reform fit together. Absent political or governmental accountability for results, it's perfectly reasonable to worry that management at various levels--city, district, school--could and will abuse their discretion. If nobody cares whether your students are learning, then sure, give a fat bonus to your buddy and fire the teacher down the hall who called you out for your incompetence. But when there's real accountability and public scrutiny, the incentives change, and policies like tying teacher pay to performance, defined in part by managerial judgment, start to make a lot more sense.

Wednesday, August 27, 2008

Space, Time, and Inter-District Choice

Just to amplify a few points Erin makes below about Education Sector's new report examining inter-district school choice: One of our main goals in conducting this analysis was to try to get a handle on how the generalized--and very worthwhile--idea of expanding school choice across school district boundaries plays out given real world contraints like geography, transportation infrastructure, and the uneven distribution of high-performing schools.

For example, in an upcoming report Erin will be running the same Geographic Information System (GIS) analysis for the city of Chicago. It will show that only a limited number of students there could benefit from the opportunity to transfer to other districts, particularly in high school. This is partly because of issues like capacity and distance. But it's also because Chicago was built next to a gigantic lake that contains no schools, good or otherwise. So while Chicago students might be able to travel north, south, or west to find better schools, they pretty much can't go east. These things matter.

The way school districts are designed also makes a big difference. Some states--Illinois is one--have hundreds of small districts. Marion County, Indiana, where I used to live, contains eleven separate school districts, including the traditionally urban Indianapolis public schools along with various large and small township school districts, including the tiny district of Speedway, which enjoys unusual wealth owing to its ability to levy property taxes on the Indianapolis Motor Speedway, where the Indy 500 is contested. Inter-district choice in Marion County would undoubtedly benefit many students.

On the other hand, many southern states operate large, whole-county school districts. The map below shows a low-performing school that happens to be located in the middle of the Polk County, Florida district, which encompasses over 2,000 square miles. It takes 45 minutes just to get to the county border from that school, much less find a better school on the other side. Inter-district choice isn't really an option there.



















Some critics of the report have raised the issue of our school capacity assumptions. It's true, as Dianne Piche notes below, that some schools may have more capacity than they'd like to admit. But others have suggested that, absent any definitive empirical evidence of how much successful schools could theoretically expand to accomodate new students, we should have either (A) made no assumptions at all, which is methodologically the same as assuming that schools have infinite capacity to expand, or (B) treated all possible assumptions as equally valid. Frankly, that doesn't make much sense, and the map below shows why.




















The starred school in middle is located in Piedmont School District, which is very affluent and literally built on a hill surrounded on all sides by Oakland Unified School District, a high-poverty district with rock bottom test scores that's been subject to state takeover in the past. There are four low-performing Oakland schools within a five minute drive of the Piedmont school and at least nine within 20 minutes. I think we can all agree that even under the rosiest of scenarios, the Piedmont school couldn't quintuple in size, or more, to accomodate transfer students. There are limits, and any responsible analysis of inter-district choice has to acknowledge that. Piedmont is, of course, somewhat of an extreme example, but that's why we ran the numbers for every single school in California (and Texas and Florida) using a moderate capacity assumption, to see how things play out in the aggregate.

Tuesday, August 26, 2008

Assumptions

In Dianne’s response below, she talks about two important assumptions we've made in ES's recent report on interdistrict choice--one assumption about driving distance and the other about school capacity. Richard Kahlenberg, an ES Senior Fellow and a well-known advocate of using interdistrict choice as a means to achieve economic integration also takes issue with the assumptions we made regarding these two variables, saying that we’ve artificially limited the outcomes by choosing a driving distance and a school capacity estimate that are too modest.

I disagree with Kahlenberg that the assumptions made in the report are somehow irresponsible, but I do agree that they’re debatable and indicate areas where, as Dianne points out, additional research would substantially further the discussion on the feasibility of interdistrict choice. (Click here to see a full explanation of our assumptions and their impact on the report’s results—also available on page 4 of the report in a full-page sidebar, in smaller, but not fine print).

First up, the driving time assumption. We calculated the potential of interdistrict choice based on the availability of higher performing schools located within a 20-minute driving radius of each lower performing school. It’s important to note that the actual travel time is likely longer because the estimate doesn’t account for traffic or for picking up students along a bus route.

But, even so, is a 20-minute driving time unreasonably short? It might be if you’re a parent desperate for a better school option and willing to transport your kids up to an hour on the bus, but for many parents, most of whom like the idea of their children attending a school that is nearby and easily accessible to them during the day, a 20-minute drive would simply be reasonable. And if interdistrict choice is going to work on a large scale, it needs to work with reasonable commuting distances to schools – distances that allow parents to volunteer, attend PTA meetings, and pick their kids up when needed.

Even if we did assume that parents and students would be willing to commit to longer commutes, our results wouldn’t change by much. This is because, under our model, if one student can travel an hour, then all students can travel an hour. Therefore, increasing the driving distance both increases the available school choices and the competition for those choices. The limits of choice aren’t so much about 20-minutes versus 60-minutes, they’re about how many good schools are out there, how many students are competing to get in, and how much capacity higher performing schools have to enroll students from lower performing schools.

Which brings me to the second assumption – school capacity. Dianne makes the good point that school capacity is a “moving target”. It’s difficult to determine the actual ability of higher performing schools to expand—there is little available data and capacity might change from year-to-year along with population shifts and budgets. The recommendation made by the Aspen Commission on No Child Left Behind to require districts to audit available space in schools would go a long way to removing some of the mystery around school capacity and may, as Dianne predicts, reveal much more space than we’ve assumed is available.

But in the absence of that data, we still needed to make an assumption about the ability of schools to expand to take in transferring students—and we assumed that schools could increase capacity by 10 percent. If we made no assumption about school capacity and instead threw our hands in the air in bewilderment, we would have ignored a hugely important variable in the interdistrict choice equation. By settling on one number as a starting point for discussion, we've been able to move the conversation about interdistrict choice to a place it needed to go—talking about the practical limits and realistic potential of interdistrict choice.

In the end, what I hope readers take away from this report, and what I found particularly interesting, isn’t just the bottom line numbers or debate about our assumptions, but the fact that the potential of interdistrict choice can vary greatly from one community to the next—in some areas, it can have a much bigger impact than the overall numbers might indicate. In East Palo Alto, CA, for example, 35 percent of students could transfer with interdistrict choice--compared with only 9 percent in Los Angeles schools.

And it is this implementation of interdistrict choice programs that is crucial --where will interdistrict programs be most effective and how can they be implemented to best serve the students who are most in need of access to better schools.

Dianne Piché on "Plotting School Choice"

If advocates for children were able to draw school district boundaries anew, nobody in their right mind would configure them with the high levels of inefficiency, inequality and segregation we find today in states like California and Texas (included in the study) and others like New Jersey, Connecticut and Ohio. Education Sector's report on interdistrict school choice underscores the fact that we have consigned large numbers of the nation’s poorest and most academically struggling children--children who are disproportionately African-American and Latino--to schools in districts with the worst track records and least capacity to educate them. Yet, we know that smart, thoughtful approaches to school choice--including providing interdistrict options and successful charter schools, along with parent outreach and incentives for receiving schools--can yield enormous benefits. Low-income parents are empowered and more satisfied. Parents of all races and income levels experience and come to value diversity. Students benefit in tangible and intangible ways. In St. Louis, for example (where I have represented the NAACP and schoolchildren), we negotiated the largest, longest-running inter-district program in the country. Outcomes for the Black students who choose to attend schools in suburban districts are demonstrably better than those who remain in city schools: they have access to more rigorous coursework, and they graduate and attend college at much higher rates.

The good news from this report is the finding by the authors that some 10-20% of eligible students could be accommodated via interdistrict choice under their hypotheses. The sobering news, of course, is that the political will is not quite there yet to help make this happen and that laws like NCLB will need to be amended to strengthen the interdistrict choice provisions.

Finally, while the report provides interesting geographic and demographic data for a handful ot localities, I would argue that its premises, while useful as a starting point, are incomplete in at least three respects:

First, parents who choose demonstrably better schools for their children (whether magnet, private, parochial or interdistrict public) are often willing to have their children transported longer than 20 minutes each way. In the Washington, D.C. area where I live, it is not uncommon for students to commute up to an hour each way to high-performing schools that promise greater access to rigorous coursework and competitive colleges.

Second, in my experience litigating school desegregation cases I have learned that school "capacity" is a nimble & moving target. It is used as a defense by parents and teacher in affluent communities to resist welcoming less advantaged students. Figures rise and fall with school budgets, housing patterns, the commitment of states and the federal government to enforce the law, and, unfortunately, racial dynamics. Recently, in Birmingham, Alabama, the school district argued it could not honor middle school students’ right to transfer out of a school in need of improvement because it lacked capacity in other schools. But when the U.S. Department of Education ordered compliance with the law, capacity was found and the right was extended to all eligible students.

Finally, although the report acknowledges the existence of preexisting choice--i.e., school choice made pursuant to state or local law, magnet programs, informal practices and the like--it does not address the impact on enrollment and capacity. For example, a high school’s enrollment increases and its capacity to accept NCLB transfers is reduced every time an affluent parent chooses to jump district lines and enroll her child in a neighboring district. Because many states and districts allow other forms of choice (with parents usually providing their own transportation and sometimes even making tuition payments to these better schools, in the case of interdistrict choice) and make it available before NCLB choice, there is likely to be more capacity than meets the eye in many schools. Additional research could be helpful in this regard.

--Dianne Piché, Executive Director, Citizens' Commission on Civil Rights

Down and Out of District

That's the title of a Beverly Hills 90210 episode in which Andrea is nearly found out for attending West Beverly High instead of her assigned high school, located in a lower-income part of town. While Andrea gets away with her illegal transfer, many students aren't able to cross district boundaries to attend a better school. In these cases, district boundaries serve as an artificial barrier to choice, often limiting school options to the low-performing schools within district boundaries -- boundaries that often reflect the racial and economic segregation of larger society.

It was this often arbitrary and segregating effect of district boundaries (and not the 90210 episode) that motivated us to look at the potential of interdistrict choice to offer more options to students in low-performing schools. To our surprise, we found that interdistrict choice on a large scale is unlikely to benefit a large percent of students - only 10 to 20 percent are likely to find a better school option (see the full report here).

Above, Dianne Piché, Executive Director of the Citizens' Commission on Civil Rights and longtime civil rights advocate, responds to our report and offers her insight on what it means for the discussion on desegregation and school choice. Thanks to Dianne for her thoughtful comments--I expect that they will spark some good discussion about our conclusions and what those conclusions might mean for the future of interdistrict school choice.

Sock Puppet

I had just assumed that when well-respected publications like Education Week decide to allow people to write anonymously under their good name, they make it clear that you can't do stuff like this. Apparently not.

Update: As I should have noted above, the post in question looks like it went up before the blog migrated to Ed Week. So they may very well have a "no sock puppet" rule.

Monday, August 25, 2008

The Schools We Need, Continued

A few additional thoughts on the post below about margins of error, etc., based on the comments in this and earlier posts. (An aside: My take on anonymous commenting is pretty much akin to my take on anonymous blogging: Why? It's a free country, nobody's going to yank you out of your house in the middle of the night because of what you write about No Child Left Behind. Identify yourself, we'll all be better for it. Particularly, I should add, if you're claiming some kind of expertise. If you're really a statistics professor, say so; I'm not giving handles like "StatsProf" any more credence than "Anonymous" or "SomeGuyYellingOnTheStreetCorner.")

First, some people have raised the issue of measurement error vis a vis the tests themselves. And it's true that (A) tests only cover a fraction of what we want to students to know, and (B) tests are an imperfect measure of that fraction. But the place to make allowances for that should be the process of setting cut scores. States don't require students to get 100 percent of the answers right to be deemed "proficient." (In fact, all states have a separate, higher "advanced" level which is also less than 100 percent.) Once states determine what less-than-100 score is proficient, it makes sense to build in some cushion to account for imperfections in the instrument, random variation, etc. This is particularly true if the test is being used for individual high-stakes purposes, i.e. graduation and grade retention policies. But having made those allowances, don't layer on new allowances with confidence intervals and tell the public that students are meeting NCLB performance thresholds when in fact they're not.

Second, there's certainly no unanimity in academia on the issue of confidence intervals. Some very qualified, well-trained people see it one way, some see it another.

Third, what's consistently lost in all of these discussions is the need to balance the risks of Type I and Type II errors. When implementing NCLB over the last six years, states have been almost exclusively interested in making sure that good schools aren't mistakenly identified as "in need of improvement" or "failing" under NCLB. And that's a legitimate thing to worry about. But they've all but ignored the risk of under-performing schools being mistakenly not identified as needing improvement. There's no way to completely eliminate both risks; states have to find a reasonable middle ground between them. Instead, many states have been obsessed with finding new ways to make sure there is absolutely no possible way for a good school to be falsely identified as underperforming, and in doing so have knowingly let schools and districts that are obviously not serving students well slide by for years and years. Of course, focusing only on minimizing the first kind of risk makes sense if you view NCLB as fundamentally illegitimate and malign, but if that's the case just say so and stop pretending your concerns are limited to proper use of statistics.

The Schools We Have, or the Schools We Need

Last week I wrote about the practice of applying statistical margins of error to the percent of students in a school who pass a test. It's a goofy idea, I said, because: "unlike opinion polls, NCLB doesn't test a sample of students. It tests all students. The only way states can even justify using MOEs in the first place is with the strange assertion that the entire population of a school is a sample, of some larger universe of imaginary children who could have taken the test, theoretically. In other words, the message to parents is "Yes, it is true that your children didn't learn very much this year, but we're pretty sure, statistically speaking, that had we instead been teaching another group of children who do not actually exist, they'd have done fine. So there's nothing to worry about."

Eduwonkette responded with her own take on the issue by cutting and pasting from Harvard professor Dan Koretz's recent book on educational assessment, in which he says:
This question was a matter of debate among members of the profession only a few years ago, but it is now generally agreed that sampling error is indeed a problem even if every student is tested. The reason is the nature of the inference based on scores. If the inference pertaining to each school...were about the particular students in that school at that time, sampling error would not be an issue, because almost all of them were tested. That is, sampling would not be a concern if people were using scores to reach conclusions such as "the fourth-graders who happened to be in this school in 2000 scored higher than the particular group of students who happened to be enrolled in 1999." In practice, however, users of scores rarely care about this. Rather, they are interested in conclusions about the performance of schools. For the inferences, each successive cohort of students enrolling in the school is just another small sample of the students who might possibly enroll, just as the people interviewed for one poll are a small sample of those who might have been.

In one sense Koretz frames the issue correctly; this is indeed all about inference. But he's wrong to imply that this is a methodological question best resolved by the consensus opinion of statisticians and assessment professionals. It's not. Rather, this really goes to the heart of how we conceive of public schools, what we expect of them, and how we hold them accountable for student learning.

By one of way of thinking, school outcomes are the result of a production function in which schools are constant and inputs, including students, vary. In other words, the school is what it is, with a certain amount of resources, certain number of teachers with certain qualifications, along with curricula, facilities, etc. Every year, the inputs (students) change. If, in one year, a brilliant group of students comes through the door, outputs (test scores) go up. If a very tough group arrives in the following year, outputs go down. If this is how you see things, then Koretz's analysis makes sense and sampling-based margins of error are fair--indeed, absolutely necessary.

The problem with this idea is that it assumes that schools are inflexible and un-improvable, inert black boxes that serve as little more than conduits for inputs and outputs. Accountability policies assume something else: that both students and schools can vary. That schools can, and must, change they way they teach to fit the particular needs of their students in a given year. If a cohort of particularly difficult students enters the system, and this becomes apparent as they move through first and second grade, by the time they hit the tested grades the school or district needs to reallocate resources and plan accordingly.

Statisticians have a weakness for black box thinking, because the box contains a lot of things that are essentially unmeasurable. You can't put a number on the relationship between a principal and her teachers, the quality of teamwork, the level of commitment and hard work among the staff, the sophistication and flexibility of the instructional plan. You can, however, put a number on student learning--an imperfect one, to be sure, but close enough to render reasonable judgments about school success.

Schools need to be organized, staffed, led, funded--and held accountable--for the performance of the students they have, not those they might have had, or wish they had, or had once or may have again. These students, this year, are the ones who matter. That conviction, and those that follow, are much more than a matter of statistics.