You are viewing the EdNews Blog archives.
These archives contain blog posts from before June 7, 2011
Click here to view the new Voices section of EdNews

Archive for the ‘Research’ Category

Critics wrongly dismiss NCTQ teacher prep study

Tuesday, December 15th, 2009

Who doubted that a new report (PDF) from the National Council on Teacher Quality (NCTQ) on Colorado’s elementary teacher preparation would unleash a small firestorm? For those who did doubt, yesterday’s Ed News story helped to set them straight:

In a letter to the Denver Area Superintendents’ Council dated Dec. 7, two University of Colorado education school deans echoed Sheehan’s criticisms of the study, and suggested that NCTQ may have an axe to grind. According to Lorrie Shepard, dean of the School of Education at the University of Colorado, Boulder, and Lynn Rhodes, dean of the CU-Denver School of Education and Human Development,

“NCTQ is a self-appointed teacher-quality advocacy group. Its founder, Kate Walsh, is an avowed critic of college- and university-based teacher preparation programs. NCTQ has not been approved as an accrediting body by either the federal government or professional associations.

NCTQ has already issued reports on teacher preparation in several other states, including Indiana, New Mexico, Texas, Utah, and Wyoming, using a predictable template. Although NCTQ claims to provide “comprehensive research,” their research methods and criteria are quite limited. Rather than focusing on teacher candidate performance outcomes as is expected in most present-day accountability and accreditation models, NCTQ bases its critiques on three narrow aspects of program inputs and standardized tests as outcomes.”

Part of the problem here is the heart of the debate lies deeper, over the value of the existing accreditation models. Why else go after NCTQ for not being something they never purport to be — namely, an “accrediting body [approved] by either the federal government or professional associations.” Such appeals to authority have limited value.

However, I agree it would be better to look at what practicing teachers already know. Three years ago the Independence Institute hosted an event titled “The Reading Crisis.” (For those with time on your hands, you can listen to the archived event audio online.) At that event, Dr. Jeannette Cornier presented the findings of her research on Colorado elementary teachers’ basic grasp of phonemic awareness and other key elements of Scientific Based Reading Research.

The results were deplorable. Large percentages of the 183 teachers sampled answered basic questions incorrectly. Isn’t there good reason to believe this problem contributes to the fact that one-third of Colorado public school students are not proficient readers? What’s the possibility that consistently better pre-service instructional training would obviate the need for some of the costly professional development that taxpayers fund through the K-12 system? Where is the incentive to change this vicious trend?

I would love to see a follow-up to Dr. Cornier’s study that covers Colorado elementary teachers’ understanding of basic reading AND math elements, and breaks down the results by their teacher training program. Maybe such a study already exists, but in any case it would be instructive to see how the results line up with NCTQ’s analysis of course syllabi. Because I think an excellent point is made:

Julie Greenberg, senior policy director for the NCTQ and co-author of the report, insists that the methods used are appropriate. “Our feeling is that we’re looking at the necessary conditions for teaching materials that teachers need to know,” she said. “If those building blocks aren’t in place, seeing what actually happens in a classroom won’t change the fact that they’re absent. The lack of these things can’t be compensated for.” [emphasis added]

And I’ve only touched on one major piece of the NCTQ study. In any case, the last thing we should do is let criticism of the study deter policy makers from scrutinizing how we prepare teachers to instruct students in the basics.

Popularity: 5% [?]

The disturbing rise of “advocacy tanks”

Thursday, November 12th, 2009

So what’s the difference between advocacy and research?  It seems to get fuzzier these days as the stakes in the reform debate gets ever more heated with increasing data access and less money.   There’s a scary trend developing where all interests in the various debates which include teacher unions, business leaders and foundations are using so called “think tanks” to further their particular agendas.

The latest and possibly scariest local entry is Kevin Welner’s Education and the Public Interest Center (EPIC) which appears to be a group of education professors funded by teacher unions and others to support advocacy briefs that claim charters, vouchers, student choice, student-based budgeting, on-line schools and standards don’t work.

EPIC looks like an advocacy think tank designed to try to shoot down anything that challenges the current way of doing public education other than adding more money to the system.  By the way I think we do need more money, I just wouldn’t continue to spend it in the same way we do now.

EPIC’s latest advocacy brief is the recently deceased Gerald Bracey’s last report.  I have to admit that I did sometimes enjoy reading Bracey’s pointed attacks on education reformers. I will miss him. But his last “report” takes the cake.

Bracey has the audacity to argue that high-quality schools will not do much to eliminate the achievement gap between whites and minorities.  He even suggests that we can’t define what high quality might mean.  He actually states that “politicians and educators ignore the evidence and continue to march under the misbegotten banner that “all children can learn.”

He sounds like a liberal version of Charles Murray’s pseudoscientific and arguably racist theories in “The Bell Curve.”  Poor kids are dumb and there’s nothing to be done about it in the classroom.  Murray says it’s their genes and Bracy claims it’s their environment.  In the end they both come to the same conclusion about the power of schools.

Having said all of this, I welcome the arguments and discussion from Welner, Berliner or Bracey, I just wish they were more honest about their non-objective advocacy and stop hiding behind their PhD’s and University affiliations.

Most of the statements in these briefs would never pass muster with the National Research Council or any other serious research body’s standards.  EPIC is mostly advocacy with some light policy research thrown in much like the American Enterprise Institute, the Independence Institute and countless other “advocacy tanks.”

Popularity: 4% [?]

Does teacher induction affect student achievement?

Monday, October 26th, 2009

An academic mentor of mine used to say that social science research almost always confirms common sense, or … it is wrong.  There is some wisdom in that, but I wouldn’t go quite as far as his more cynical conclusion – “we’ve learned one thing from 50 years of research on health and education – smoking is bad for you.”

As a social science researcher, I have always found the questions we study to be fascinating, but often the answers are frustratingly elusive.  Still, some recent research in education has done more than validate common sense, and has driven important changes in policy focus.

For example, by having teacher identifiers and longitudinal data in some states (Tennessee, Florida and a  few others), researchers have shown: 1) the great importance for low-income student learning of having good teachers for a few consecutive years, versus having bad teachers (yes, this validates common sense, but it shows that learning gains for low-income kids are possible under good teaching); and 2) traditional inputs into teacher pay (seniority and Masters degrees) have little or no association with student learning outcomes (less clearly associated with common sense).

This evidence points to a greater focus on teacher effectiveness, which we now are seeing in Race to the Top and elsewhere, greater equity in quality teacher distribution across schools, and more focus on teacher outputs and outcomes than on the inputs.  This is what evidence based research should do.

But a study on teacher induction programs released this week, brings to the forefront this issue of research findings versus common sense or common wisdom “on the ground.”   I’m particularly intrigued by this study because, at a conference last year, I observed a panel discussion of the first year of findings. Now the second year findings are out.

The study is “Impacts of Comprehensive Teacher Induction: Results from the Second Year of a Randomized Controlled Study,” by  Eric Isenberg, Steven Glazerman, Martha Bleeker, Amy Johnson, Julieta Lugo-Gil, Mary Grider, Sarah Dolfin, Edward Britton, and Melanie Ali –  Mathematica Policy Research, August 2009.

It is funded by the Institute for Education Sciences for 5 years. The authors are expert methodologists; 1,000 teachers in 400 elementary schools in 17 districts in 13 states are involved, and the districts had to agree to a randomized design where some new teachers get one of two high quality, nationally-respected induction programs, while other teachers get “induction as usual.”  This is the gold standard of research designs (and costs $17 million).

The findings: after two years, the teachers getting better induction programs do not show any increase in their student learning outcomes, compared to the control group.

So, either common sense is wrong and a great induction program for teachers doesn’t move student achievement, or there is something wrong with this study (doubtful to me), or 2 years is too short to see student learning outcome effects (possible, and a good thing the study is funded for 5 years).

Popularity: 8% [?]

The Beautiful Tree: don’t miss this book

Friday, October 16th, 2009

I’m not going to write about school finance, or teachers unions, or even the new NAEP scores. Not today. Instead, I want to make a nomination for “Education Book of the Year.”

I recently completed the marvelous book The Beautiful Tree by British education scholar and entrepreneur James Tooley. In short, it’s an eye-opening firsthand account of a journey that uncovers the determination of many of the world’s poorest people to secure private schooling for their children.

Tooley recounts his many travels into the slums and impoverished wastelands of India, Ghana, Nigeria, Kenya, and China. What he has uncovered through his years of extensive research is an amazing amount of children whose families pay private school tuition to for-profit operators.

Many of these schools not only are unregistered, but also either unacknowledged by or unknown to indigenous government education officials. And on most counts, Tooley finds the private schools deliver a better education to the world’s poorest children than do the government schools.

The Beautiful Tree delves into the deep debates surrounding education, international relief, and Third World development. The book even unravels some of the mythology surrounding British imperialism and native schooling. But not before many chapters that introduce you to a very real contemporary cast of incompetent bureaucrats, enterprising and humane school operators, earnest and determined parents, and children with great hope and promise. I could hardly put the book down.

Far from creating an oversimplified paean, though, Tooley confronts the strengths and weaknesses and proposes very straightforward and practical policy solutions — including, targeted school vouchers. (I didn’t say I wouldn’t discuss vouchers, did I?)

Whether or not you come to some or all of the same conclusions as the author, The Beautiful Tree offers some important arguments to wrestle with as well as some very interesting and engaging human stories.

Any book where the author’s passion comes oozing through every page tends to be much more enjoyable to read. Such is the case with James Tooley, who has put his money (and his feet) where his mouth is. He today works actively to raise funds for Third World educational development, breaking the traditional mold of foreign aid along the way.

The Beautiful Tree is a book you don’t want to miss.

Popularity: 1% [?]

Wrestling with public opinion on school reform

Friday, September 4th, 2009

As much as some may see us policy wonks as hermetically sealed from the real world, it’s important to remember that school reform doesn’t take place in a vacuum. We live in a democratic society, and our government is formed of many democratic institutions. A remarkable statesman and politician, Abraham Lincoln famously said of the thorny problem of slavery during the tumultuous 1850s, “A universal feeling, whether well or ill founded, cannot be safely disregarded.”

The general principle applies in all popular policy formulations – even the less grave and dramatic issues of our day. And especially in education, as it has been repeatedly observed that everyone has a notion of education policy because everyone has gone to school. To varying degrees, the politicians elected to enact these policies are obligated to take seriously credible measurements of public opinion if they are to continue in their legislative or executive service.

But what if we could better understand what shapes public opinion about some of the leading school reform issues of the day? A piece written in the new issue of Education Next by eminent (more…)

Popularity: 1% [?]

Boettcher evaluation: More facts, please

Wednesday, August 26th, 2009

I am generally leery of statements in education which begin “It’s a fact…”  I am even more so when these facts overwhelmingly support the organization making the claim in a sort of self-congratulations (though this is extraordinarily common).  So I turned to the recent commentary on the effectiveness of the Boettcher Teachers program in these pages with some caution.

IT’S A FACT: BOETTCHER TEACHERS PROGRAM GETS BETTER RESULTS

[...] Students in classrooms with Boettcher Teachers are scoring better on CSAP and district Measures of Academic Progress (MAP) tests than their non-Boettcher prepared peers, according the evaluation, conducted by The Evaluation Center and the University of Colorado Denver School of Education and Human Development.

While the text is far more modest than the headline (which implies the program produces the results), and unlike some others it does not quite claim causation when it witnesses correlation.  But the claim here, even couched, is pretty clear: (more…)

Popularity: 4% [?]

One of our bloggers in a donnybrook

Wednesday, July 29th, 2009

Holly Yettick, one of our bloggers, recently authored a study that says major media outlets give more weight to think-tank studies than peer-reviewed academic research. (Here is the press release). This, she says, increases the likelihood of ideologically biased work being reported as something like fact.

The report has generated some heat. Take, for example,  this blog post from Kevin Carey of the Education Sector (hardly a bastion of right-wing thought). He concludes his post with this zinger of a paragraph:

In the end I think the marketplace of ideas is quite a bit more efficient than Yettick believes. Reporters aren’t all idiots and think tanks don’t succeed through P.R. witchcraft. If the media isn’t covering your research, it’s probably not my fault.

I’d love to hear from Holly or any others who have read the report and reaction to it.

Popularity: 2% [?]

Give students a ride to the school they’d choose

Tuesday, July 21st, 2009

As a fellow blogger here, Dr. Paul Teske may not have wanted to toot his own horn about the new study he co-authored for the Center on Reinventing Public Education. But based on careful surveys of parents in Denver and Washington DC, the report Drivers of Choice (PDF) is important for advancing the education reform debate about a very practical aspect of school choice policies. I’m glad Jeremy Meyer picked up the report with a story in the Denver Post.

First of all, the fact that the idea and practice of school choice (albeit somewhat limited) has grown into sufficient familiarity and acceptance in these two major American cities is noteworthy in itself. Drivers of Choice moves beyond the increasingly clear answers to questions about whether choice is a desirable and effective policy.

Instead, the Denver-based team of authors sought to find out how much limitations on transportation options also limited exercise of school choice for middle- and lower-income families. The short answer? (more…)

Popularity: 1% [?]

A cornucopia of charter studies

Wednesday, June 17th, 2009

Several important charter school studies, with relevance to Colorado, have come out in the past few weeks.   This is particularly important at a time when U.S. Education Secretary Arne Duncan has been arguing that states should embrace charters more, and not impose caps on the numbers allowed within their state (Colorado does not have a cap).

The required Colorado state evaluation study, written by Dick Carpenter and Krista Kafer, provides some excellent data on the state of Colorado’s charters.

This week, the DC-based Center for Education Reform, led by Jeanne Allen, a strongly pro-charter group, released its 2009 report card on state charter laws – as per last year, Colorado ranks 9th best in this study, for our charter law and its various features.

Most recently, CREDO (Center for Research on Education Outcomes) at Stanford, came out with a multi-state study of charter longitudinal growth, called “Multiple Choice: Charter School Performance in 16 States.”

This is a very valuable study.   The big take-away is that, on average, charter students (more…)

Popularity: 1% [?]

Cows: sacred. Oxes: gored

Thursday, June 11th, 2009

The Harvard economist Roland Fryer did a recent study on the Harlem Children’s Zone (HCZ).  The NYT’s usually reliable David Brooks sort of botched it.  That’s a shame, as it is worth an unfiltered read.  To whet your appetite for original (in every sense) research, here are two cows Fryer comfortably gores.

To begin, it is a trusim that low-income children do better in schools with more high-income kids.  Most people have always assumed that this difference is largely explained by income (peer group).  Fryer points out that might not be the case:

This suggests that a better community, as measured by poverty rate, does not significantly raise test scores if school quality remains essentially unchanged.  Additionally, and more speculative, there is substantial anecdotal evidence that the Children’s Zone program was unsuccessful in the years before opening the charter schools. Indeed, the impetus behind starting the schools was the lack of test-score growth under the community-only model. (p. 22)

That first sentence is pretty radical.  The usual assumption is that wooing the middle class back to urban districts (more…)

Popularity: 3% [?]

Colorado Health Foundation Walton Family Foundation Daniels fund Pitton Foundations Donnell-Kay Foundation