Get ready to see a cheer from those who oppose any type of student data used to evaluate teachers after a report by the Economic Policy Institute is released late Sunday.  The report titled, “Problems with the use of student test scores to evaluate teachers,” is already being heralded by anti-test groups like Fair Test.  The report is actually a nod to policies  like SB191 which state that student data should only play a part in teacher evaluation.  This is something that I and other supporters emphasized in our support of the bill.  The report says:

“A review of the technical evidence leads us to conclude that, although standardized test scores of students are one piece of information for school leaders to use to make judgments about teacher effectiveness, such scores should be only a part of an overall comprehensive evaluation.”

The report goes on to conclude:

” What is now necessary is a comprehensive system that gives teachers the guidance and feedback, supportive leadership, and working conditions to improve their performance, and that permits schools to remove persistently ineffective teachers without distorting the entire instructional program by imposing a flawed system of standardized quantification of teacher quality.”

I am good with that.

Larry Ferlazzo, who blogs for the Teachers Leader Network, describes such an evaluation system currently in place at his high school in CA.  In his blog (as covered by the Washington Post) Ferlazzo describes an evaluation process that is not done “to” teachers, instead it is done “with” teachers.  This includes the use of student data that does not drive instruction, but it informs instruction.  (I have  stopped using the term “data” and in its stead use the term “information,” as “data” has grown into a controversial topic, even an impediment for discussion with many teachers).

Ferlazzo goes on to describe how his school uses multiple forms and types of data that should inform one’s practice.  When Ferlazzo had a year of poor test results, the administration did not rush in with punitive measures.  They looked at possible mitigating reasons, evaluated whether additional resources were needed and kept up with his usual yearly observations.  The following year his students were back at prior year’s levels.

Ferlazzo also relies on colleagues, students, and parents for feedback.  Colleagues observe his class on a regular basis, providing feedback on the learning taking place.  Note that the feedback is on the learning and not the teaching.  Ferlazzo also relies on something that I see missing in many teachers: self-reflection.  Ferlazzo asks himself a question that Robert Marzzano asks of teachers: If I was a student would I want you as my teacher?

Ferlazzo sums up his take on evaluating teachers:

“[Evaluations] underscore the importance of providing resources so well-prepared administrators have more time to observe teachers – of making sure teachers have regular opportunities to observe each other and give constructive feedback – of giving educators common time to prepare and evaluate assessments that show higher-level thinking skills – of making it possible for all school staff to engage more with parents. These are the ways we can help teachers become the best that they can be.”

Popularity: 9% [?]

“The CSAPs are here! The CSAPs are here!” Or more accurately, “The CSAPs have been here, we just waited two weeks to let you see them!”

I saw my school CSAP results a few weeks ago. Why the delay in their release to the public? Nefarious politics at play? Quite frankly I don’t care. What concerns me most is the way schools and districts respond to the results.

Picture district administrators, principals, and teachers pouring over the CSAP results as if they were checking lottery numbers and asking, “How’d we do?” As if it was a crap shoot. A better metaphor for CSAPs is an autopsy. When you perform an autopsy you already know the person is dead, you want to try and figure out what killed them. It’s too late to do anything for the dead person! Well, it’s too late to do anything for those students who took the CSAP. Let’s shrug our shoulders and hope we do better next year.

In education jargon, CSAPs are summative assessments. Summative assessments are end of the unit, or end of the semester assessments that should show what a student knows or is able to do at a given point and time. We usually assign grades based on summative assessments. There is no going back to remediate based on summative assessments.

Another type of assessment and as the research points out, a more effective one is the formative assessment. Formative assessments are used to see how a student is progressing and based on the results what, if any, remediation needs to be done to get the student on track to proficiency.

Instead of an autopsy, formative assessments are checkups. The research tells us that formative assessments, and the appropriate response to their results, are the MOST effective way to improve student achievement. Why am I boring you with this explanation? Because CSAP results should not be a surprise for any school.

If a school is using formative assessments properly they should be able to predict, with some certainty, how their students will perform. If there is a discrepancy between the CSAP results and the formative results a disconnect exists between what the school expects the students to know and what the state expects. Or there may be a problem with the school’s formative assessments. These two issues can be rectified if, and that is a big if, schools are using formative assessments.

I am not arguing for the elimination of CSAPs; they are used to hold schools accountable. The public has a right to know how schools are performing. I question the focus that districts and schools place on them as ways to improve student achievement. You’d be a fool not to take them seriously. But the results should support what you already know.

Here’s a report I’d like to see from the state: How did schools perform on CSAP based on a school’s prediction? The closer the correlation and I would argue the better schools perform.

It is one thing to know what ails you when you are alive; it’s another to find out after you are dead and gone.

Popularity: 34% [?]