Student Growth Percentiles and Teacher Evaluation: More Questions than Answers

by Maren Johnson 

Just this month, OSPI released a new kind of data: Student Growth Percentiles (SGP).  What are student growth percentiles?  In short, SGPs describe a student’s growth in state test scores as compared to other students with similar prior test scores.  Here’s a five minute video:

  

You can find Student Growth Percentiles for your specific school or district here: http://data.k12.wa.us/PublicDWP/Web/WashingtonWeb/PublishedReports/PublishedReports.aspx 
or http://bit.ly/1lE2Pi9

What are student growth percentiles for?  Teacher evaluation is one potential use, and will be an issue in the upcoming legislative session.  Washington state recently received a high risk warning from the federal government regarding teacher evaluation.  The issue?  Whether state test scores “can” or “must” be used in teacher evaluation—the U.S. Department of Education is saying that state test scores must be used in order for Washington state to continue to receive a NCLB waiver.  We’ve written extensively about this waiver on our blog—see posts from Mark, Kristin, Tom, and myself.

One issue with including state test scores in teacher evaluations?  Very few teachers in Washington state even teach classes associated with a state test!  The number of teachers with state test data has been estimated at 16% at the most by OSPI—see the chart. Student growth measures

How do you evaluate teachers with state tests when these teachers don’t even teach courses that are tested?  In Tennessee, teachers without test scores were able to choose a test for their evaluation, leading to some unusual conversations, “The P. E. teacher got information that the writing score was the best to pick,” said the art teacher. “He informed the home ec teacher, who passed it on to me, and I told the career development teacher. It’s a bit like Vegas, and if you pick the wrong academic subject, you lose and get a bad evaluation.”   In Florida, teachers have been evaluated using school wide test averages, meaning that some teachers are evaluated based on test scores from students they have never taught.  North Carolina attempted to test students of all teachers in all subject areas with 52 different standardized tests.  All these approaches have proved problematic.

Continue reading

OSPI, KUOW and the Seattle Times

Triangulation-methodBy Tom

By now you’ve probably heard that Washington State’s Office of the Superintendent of Public Instruction has agreed to provide the Seattle Times with a large amount of data concerning student test scores, attendance records, discipline records and demographics. They will also provide the newspaper with staff data. To be clear, this is data that is not already available to the public.

It seems clear why the Seattle Times wants this data. They are in the business of selling information. If they can get a better understanding of what’s happening in our state’s schools, they can package that information into news articles and sell it to the public. That seems obvious. What isn’t clear – at least to me – is why OSPI has entered this agreement. I honestly don’t see what they stand to gain by providing The Times with data that isn’t already released.

This bothers me at two levels. As a parent, I’m not crazy about my sons’ scholastic information being sifted through in some newspaper office by a bunch of reporters who are essentially looking for a story. It’s not that our family has anything to hide, but it’s still our information, and it should be our decision on who gets to look at it. The Times has tried to assuage those concerns by maintaining that the information will be “de-identified,” but as KUOW pointed out, it wouldn’t take much effort to use all the data to triangulate which student earned which test score or which student was suspended for which offence. That bothers me.

I’m also bothered as a teacher. It seems clear to me that The Times will have the capacity to report test scores aggregated at the individual classroom level. If you’ll remember, The Los Angeles Times did this a few years ago, and the fallout was disasterous. Whether the Seattle Times is planning this or not, we’re not sure; but it sure looks like they’ll be able to.

The problem is that when a specific teacher’s student test scores are published, they’re devoid of context, because that context would breach confidentiality. Here’s an example: two boys in our school recently lost their stepfather. He was killed violently while in the process of committing a felony. This had an adverse effect, not only on those two boys, but their teachers and their classmates. And when I say “adverse effect” I mean an effect that will probably show up in student test score data. Statisticians call this “noise,” which refers to random happenstances that push or pull data either up or down. They call it noise, because when you aggregate data, positive and negative noise tends to balance out, and the aggregated data isn’t affected. The negative effect of a homicide, for example, could be balanced by the positive effect of another family in the same school whose father got a huge promotion and raise.

But that doesn’t work so well when you drill down to the classroom level, where what remains of our privacy protections prohibit us from providing the context of our students’ test scores. Consider my classroom. I voluntarily took all eight IEP kids in our school’s fourth grade. This was a decision that worked well at the school level; by placing all eight of those kiddos in one class, I could more easily collaborate with the reading resource teacher. Instead of pulling out two or three kids from three different classrooms, each of which is at a different place in the curriculum, she can pull her whole group out from one classroom and focus on the specific skill that they’ve been working on. It works great at the school level, but it’s not going to look so great (for me) if and when my students’ test scores are published in The Times.

It’s great that the Seattle Times is taking such a keen interest in education. They don’t always get it right, but sometimes they do. And obviously, the more information they have to work with, the better. But it seems to me like this agreement gives them access to more information than they can be trusted with.

And that bothers me.

Snow Days


Snow-DayBy Tom

Snow Days are literally, if not figuratively, a gift from above. They usually come with some warning, and frequently don’t come despite warning, which is why they always come as a surprise.

Snow Days, of course, aren’t much of a gift. They’re more like a bad loan. We trade a day with inclement weather and 8 hours of daylight for a day with 16 hours of daylight and 70 degree weather. That’s a horrible deal.

And as much as we might think we need a day off now, that need will be far greater in mid-June. Trust me.

But of course Snow Days are neither a gift nor a loan. They’re a response to nature. Moisture blows in off the ocean over a mass of cold air and precipitation falls in the form of snow. Snow makes it hard for vehicles to get around, so schools close for the day. And everyone sleeps in.

And for me, the beauty of a Snow Day is that act of yielding to nature. They remind us that we are not fully in charge here. We can predict snow, we can hope for it, we can even pray for it, but we can’t order it. It either happens or it doesn’t.

And when it does happen, it makes no sense to wish that it didn’t happen or worry about the plans we made that won’t reach fruition.

Just let it happen.

And enjoy it.

Common Core: Irony, Commerce and the Clock

File52a4a9f585e15By Mark

For English Language Arts 9-10, Common Core standard #8 for Informational Text is this:

Delineate and evaluate the argument and specific claims in a text, assessing whether the reasoning is valid and the evidence is relevant and sufficient; identify false statements and fallacious reasoning.

I thought of this when I read a rant recently about how Common Core required education about safe sex rather than abstinence. This was the same week I read two different assertions: one claiming that Common Core specifically outlawed the teaching of cursive, the other claiming that cursive was now required. A few weeks ago I was lectured by a parent about how Common Core was forcing kids to just memorize a list of facts and spit them back on a test. My school year this year started with a colleague upset at the required reading list identified by the Common Core State Standards for high school English.

A seven-second Google search enabled me to "evaluate the argument and specific claims… assessing whether the reasoning is valid and the evidence is relevant and sufficient" and "identify false statements." 

1. Common Core does not address issues of sex education…

2. Common Core does not address handwriting or cursive in the standards…

Continue reading

Teacher of the Year is Dyslexic

Jeff Dunn 1

Our guest blogger, Jeffrey Dunn is 2014 Regional Teacher of the year from ESD 101. Jeffrey is an educator, cultural critic, & backwoods modernist currently teaching in Deer Park, Washington. He invites others to read bell hooks, Paulo Freire, and Richard Brautigan.

******************************************************************************************************************** 

Try and imagine the impact this fact has on my students. No longer am I a model of all that is correct. No longer am I the authority on all that is academic. In this case, I am learning disabled as defined in Washington State law (WAC 392-172A-03055). This law reads that learning disabilities may include “conditions such as perceptual disabilities, brain injury, minimal brain dysfunction, dyslexia, and developmental aphasia.” In short, I am not the model of perfection students are led to believe all we teachers are.  

Researchers from the Yale Center for Dyslexia and Creativity's Sally Shaywitz (Overcoming Dyslexia) and the College de France and  Institut national de la santé et de la recherche médicale'sStanislas Dehaene (Reading in the Brain) estimate that between 10-20% (call it the midpoint, 15%) of all human populations are dyslexic (variation  is a result of definition and assessment practice). Think of it, in any class of 25, we should expect 4 of our students to be dyslexic. My thirty-six years of teaching experience has proven this statistic to be true.

Continue reading

Let’s Build a Waiver Loophole

LoopholeBy Tom

Twelve years ago, George Bush signed “No Child Left Behind” into law. Among other things, the law requires that by the end of this school year every student in America has to meet standard. That level of success will never happen, of course, not even in Finland, but no one has bothered to change that part of the law. Instead, the Obama Administration has used that law as leverage to advance their own educational agenda, which includes expanded school choice, adoption of the Common Core State Standards and tougher teacher evaluation laws. They’ve done this by granting waivers from the law's punitive aspects to states that adopt certain policies.

Washington State received one of those waivers, along with 31 other states. And for the most part, we’ve toed the line. We now allow charter schools, we’re transitioning to the CCSS, and we have a brand-new Teacher and Principal Evaluation Project. (TPEP)

But there’s a problem. As written, TPEP allows state assessment scores to be used for teacher evaluation. The feds want TPEP to require that they be used. The feds have recently notified our state, warning us that we risk losing our waiver unless TPEP is changed so that it mandates the use of state assessment data. 

As a teacher, I can see no possible way in which state test scores can be used as a valid basis for my evaluation. I teach fourth grade; my students took a state test last year and they’ll take another one this year. But it’s not the same test. Last year they took a third grade test and this year they’ll take a fourth grade test. The smart kids in my class passed their test last year and they’ll probably pass their test this year. The kids who are struggling this year didn’t pass their test last year and they’ll have a tough time passing this year’s test.

Continue reading

More on Coverage vs. Learning: Student Growth

220px-Johann_Heinrich_Füssli_054By Mark

Last month I shared my thoughts about how "coverage pressure" nearly led me to move on before my students were ready. My decision to slow down and focus on my students' skills rather than simply plow forward resulted in far better student performance both on that essay as well as the next essay they are currently writing for me. I have had several students voluntarily tell me that they understand what to do far better now because we slowed down and spent more time digging deeper.

The new evaluation law requires that all teachers be able to demonstrate how their planning and implementation results in student growth toward an important content standard or goal. As I wrote that piece linked above, a minor epiphany occurred to me: coverage of content and student growth are not the same thing.

Continue reading

Using Teacher Evaluations for Human Resource Decisions: Unintended Consequences?

image from http://aviary.blob.core.windows.net/k-mr6i2hifk4wxt1dp-13120306/7bcaca66-dc03-4381-9172-01cd3fd5a88a.jpg

by Maren Johnson

Earlier this year, Washington state received a high risk warning from the federal government regarding its teacher evaluation system. One issue: whether state test results can be used in teacher evaluation, or whether they must be used. Randy Dorn has requested that the state legislature address this issue in the upcoming session.

The high risk warning letter concerns one of the "inputs" of teacher evaluation–the potential use of state tests. Yesterday, OSPI issued a report concerning one of the "outputs" of our evaluation system–human resource decisions. The report, "Using Teacher and Principal Evaluations to Inform Human Resource Decisions," was put together by OSPI and the education research organization American Institute for Research (AIR). They surveyed and conducted forums with Washington stake holders and looked at national trends. It includes interesting data about teacher and administrator views–see the graph up to the left.

Clearly, evaluation results can already be used in human resource decisions such as non-renewal. Recent changes to the law mean that by 2015-2016, evaluation results will also be included in human resource decisions such as layoffs, RIFs, transfers, and moving from provisional to continuing contract status. Some districts are using evaluation results for decisions on leadership opportunities and professional development. This affects a lot of people–we need to have a good system here. 

An interesting section of the report talks about some of the unintended consequences of using evaluations in human resource decisions. A few quotes:

"Teachers expressed a desire to use their focused evaluations as an opportunity to try new strategies that might not result in a Proficient rating. Some teachers would be deterred from trying new approaches if employment decisions would be based on those results."

"By using teacher evaluation data in HR decisions, particularly employment decisions, participants worried that teachers would begin to compete with each other rather than cooperate to improve student learning."

One striking trend that emerged in the report was time.  This is the first year that ALL school districts in the state of Washington are using TPEP evaluation.  Educators wanted time to ensure that both evaluators and those being evaluated received appropriate training, and also wanted time to test out the new system itself.

The report states (p. 13) that in the upcoming legislative session, OSPI is pursuing a change to current state law that would delay the use of evaluations in human resource decisions until the 2016-17 school year. A delay like this is a good idea: let's try our new system out before increasing the high stakes consequences attached to it! We need to get this right.

 

The Smarter Balanced Assessment

Computer testBy Kristin

The first time I tried taking a practice Smarter Balanced assessment I almost lost my mind.  I was overwhelmed by the user interface, which required me to scroll up and down through a long skinny column of text.  I was defeated by my inability to mark up the text, see the questions and text at the same time, and the test's awkward expansion tab which allowed me to widen the text's column but then prevented me from seeing the questions.  With a big knot of anxiety in my stomach, a headache, and a sense of failure I shut it down without answering even the first question.

When this video went viral, I cheered the student's every word.  Yes, I thought, this has all gotten out of hand!  But then I remembered how much I really liked both the Common Core and its intent – that every student in the country be held to the same high standards.  I like the standards, and I like how well they're aligned from K-12, so I decided to try the SB assessment again and guess what?  It's a good test.

Continue reading

How do you deal with Helicopter Parents?

ApacheBy Tom

I was reading the Seattle Times the other day when I came across an editorial by the venerable Lynn K. Varner. In it, she describes an essay written by a guy named Ron Clark who quit his principal job because he was fed up with dealing with over-involved parents.

That’s too bad. It sounds like Ron Clark was a good principal, and it’s unfortunate that he was essentially run out of town by people who actually love him. He’s not alone, of course; the education world is awash with tales of helicopter parents who badger their children’s teachers and principals with complaints, questions and comments. They want to know more about a grade on a test. They want to suggest the next field trip. They want to know why their child is sitting in the back of the room. They wonder why their daughter is always picked fifth in kickball.

What they don’t realize is that in a typical elementary school there are 26 kids per class, and twenty classrooms in the school. A teacher deals with fifty parents each year; a principal deals with about a thousand. If every parent contacts their child’s teacher twice a week, either by voice or email, that teacher has to produce one hundred responses. If each response takes three minutes to compose and send, that’s five hours. That’s a lot. Nothing, though, compared to the principal. If she gets only one message per parent per month, that’s 250 responses per week. Her responses, of course, take much longer, since she probably has to find out exactly what happened in whatever classroom the child is in. If this takes ten minutes per message, then…well, you get the idea.

My point is this: teachers and principals in some schools spend an incredible amount of time dealing with parents. Granted, some of this time is well spent. Dealing with parents is an important part of our job. Parents have every right to advocate for their children and we have the responsibility to address their concerns. And there are legitimate concerns that do need to be addressed.

But this should even out across schools. There’s no reason to think that parents in school A, in the affluent, well-connected suburbs, should have more legitimate concerns than parents in school B, twelve miles away, in the high-risk low-income area. (If anything, they should have less) Yet, it seems that wealthy, connected parents have more concerns – and send more messages – than parents in less affluent areas.

In fact, educators in high-needs schools seem to have the opposite problem. They can’t seem to get parents involved at all with their kid’s education. They have low turnout for events, fund raising efforts are futile and permission slips go unsigned.

Then there’s my school. Right there in the sweet spot. Our parents are generally supportive, yet generally hands-off. Permission slips get signed, but emails go unsent. There are well-packed lunch boxes in every backpack, but no helicopters in the hallway.

And that’s just fine with me. When I tell my district colleagues from the rich side of town that I get about two parent emails per month, they ask if we have any openings. I get the same response from teachers in the other end of town when I tell them that I don’t have to buy any coats or shoes for my students.

Life in the sweet pot. And for that I’m thankful.

How about you? Which side of the sweet spot is your school? And how are you coping with it?