Category Archives: Education Policy

New Study: Teachers Who Pass ProTeach are better than Those Who Don’t

Cedar leavesBy Tom

A new study commissioned by Washington’s Professional Educator Standards Board shows that ProTeach – our teacher licensing assessment – seems to contribute to an increase in student learning. The study was conducted by UW Bothell’s Center for Education Data and Research (CEDR). It was a complicated study, but essentially they compared teachers who passed ProTeach with those who didn’t by looking at their students’ test scores using Value Added Models (VAM).

The main conclusion reached by CEDR is that teachers who passed ProTeach correlate to higher student test scores, especially in reading. Not so much in math. It's worth noting that this is essentially the same conclusion they drew conducting a similar study on teachers who earned National Board Certification. The study also found the effect was greatest for those teachers who scored high on Entry 2; the one that concerns classroom management and family communication. I found that interesting; it seems more likely that Entry 3 – which is all about teaching and assessment – would be the one more closes associated with higher test scores. I guess that goes to show how important classroom management is. Overall, the results seem to indicate that ProTeach is an effective measurement of teacher quality, which must make the PESB feel relieved.

Of course, we can also look at these results from another direction. Maybe they indicate that VAM is a valid measurement, at least for reading instruction. Personally I found the entire report a little presumptuous; strongly implying that VAM is the gold standard and that teacher performance assessments like ProTeach are valid to the extent they correlate with student performance assessments like VAM. I may be biased (I’ve never been a big fan of VAM), but I place a lot more credence on an evaluation that focuses on what teachers are actually doing when they teach than an evaluation that looks at student performance, which is effected by a myriad of factors that include teacher quality. So perhaps the fact that VAM results and ProTeach results are correlated might show that VAM is legitimate. At least in reading instruction.

In a larger context, it seems to me that if there’s a place for VAM, then this is surely it; used on aggregated data like in this study. Where VAM is not appropriate is when it’s used on individual classrooms and individual teachers. That’s a complete travesty. It’s also a shame, because advanced statistical analyses – like VAM – can be invaluable when it comes to showing which instructional practices are effective and which aren’t. And I’m here to tell you: teachers across the country who are evaluated using VAM hate it with a passion you don’t often see in education. If we manage to steer clear from that mistake in Washington, I can see the day when TPEP reaches maturity and we have a large database of teacher evaluations and researchers like the folks over at CEDR can use metrics like VAM to help us understand which teacher practices are most effective.

But for now, we’ll have to settle for what we have: a somewhat obvious conclusion that tells us that good teachers produce good students. 

Want innovation in the classroom? Get teachers involved in Policy

image from http://aviary.blob.core.windows.net/k-mr6i2hifk4wxt1dp-14031620/71248eaf-3628-450a-8a5b-67a49178f444.png

 

by Maren Johnson

I spent the weekend in Washington DC at the Teaching and Learning 2014 Conference. It was dazzling. Famous and thought provoking speakers, incorporation of art and music, huge diversity in education viewpoints and experience.

With all the hubbub over the big names at the conference, what I'm heading home thinking about is a session led by a middle school science teacher from Washington state. From the small town of Cheney, no less.

Teacher Tammie Schrader's session was titled, "Coding in the Classroom." I went into the session expecting to learn a bit about coding itself, and perhaps a bit about how to use coding to teach concepts in life science. I came out of the session thinking about innovation and education policy.

Tammie started out the session by introducing herself and her classroom programs. She has been facilitating student coding in her science classes for several years now. That, itself, is innovative, but not extraordinarily unusual.

Then Tammie started talking about education policy. My ears perked up. What was going to be the tie-in here? I've been to sessions on innnovative instructional methods. I've been to sessions on education policy. I have rarely been to a session incorporating both.

Tammie's point? She wanted to do cutting edge things in her classroom. In order to be free to do these things, she needed to be released from some of the usual considerations of what might be expected in a classroom. There were a few non-negotiables, however. She would still need to assess; she would still need to show student growth. She wanted to assess and show student growth in a way that would fit her classroom. The solution? Get involved in policy. Tammie has done this, in a big way, at state and national levels.

I thought to myself, "This woman's message needs to get out there." So there I was, like the paparazzi, taking photos and tweeting. Not that Tammie isn't already well known in many education circles, but I wanted to do my part!

image from http://aviary.blob.core.windows.net/k-mr6i2hifk4wxt1dp-14031621/8e1854ea-84f9-461c-90bc-4e482f91c4cc.png

The policy involvment has allowed Tammie's innovative classroom work to become systemic. Tammie has worked on state assessment committees and on designing frameworks for Career and Technical Education. She helped write the state science test. Because she knows what students are expected to do, she's not ignoring the state science standards or the Next Generation Science Standards. She's not letting all of that go. She's just helping to shape policy and then use it in a way that helps herself and other teachers be innovative in their classrooms.

Tammie has spent time talking to policy makers at all levels. Having a teacher involved in these areas allows education policy to encourage innovation as opposed to stifling it. Want innovation in the classroom? Get teachers involved in policy.

HB 2800

boxesBy Mark

I strongly believe that civil consideration of all sides of an issue are important for a literate society.

So let's take the Inslee/Dorn joint venture, House Bill 2800, which adds to RCW 28A.405.100 at section 2(f) a passage that begins on line 31 of page 3:

"Beginning with the 2017-18 school year, when relevant to the teacher and subject matter, student growth data elements must include results from federally mandated statewide student assessments."

This language is also inserted elsewhere in the document where it is relevant to define student growth.

Based on what I am reading, I hesitate to boil this issue down to a simple pro v. con. This issue, as are most, is more complicated that our society's convenient dualistic reduction.

Continue reading

Inslee Fought The Law and The Law Won

DownloadBy Tom

I was at a staff meeting once in which a colleague made a presentation. She wanted us to take on some new initiative. I can’t remember what it was, since we voted not to do it. She came to me afterwards and asked what she did wrong. “You didn’t do anything wrong,” I said. “You were clear and articulate. You explained what the program was about and told us why it was a good idea. Then we thought about it and decided not to do it. That happens sometimes.”

I tell this dull story because it sounds like what happened in Washington D.C. last weekend. Governor Inslee went out there and explained to Education Secretary Arne Duncan why our teacher evaluation system should be good enough to obtain the NCLB waiver, even though it clearly doesn’t require the use of state tests like the feds want. Governor Inslee, I’m sure, was every bit as clear and articulate as my colleague, yet in the end Duncan said no.

That happens sometimes.

So now what? So now Inslee is going to help the legislature pass a bill that will change TPEP in a way that the feds like. And then we’ll get our waiver, which will allow the state more freedom to spend $40 or so million dollars. And we also won’t have to send home letters to our parents telling them that our schools are bad.

And as for us? The teachers in the classroom? We get to use state tests to measure student growth. Of course by “we” I mean the 16% of us who actually teach in state tested grades and subjects. Everyone else gets to use meaningful assessments that reflect what they actually teach every day.

Personally, I’m trying really hard to get upset about this. Really hard. But all I can muster is a sense of disappointed resignation. Sure, our new evaluation system is damaged, but the damage is only to those of us who teach state-tested students, and since the student growth part of our evaluations are supposed to use “multiple measures,” state assessments will only matter to a slight degree to a small number of teachers. And there’s yet another caveat: we’re switching to a new student assessment system. This year is the field test. Next year is the first year; the year we gather base-line data. The year after that is the first year in which we could actually misuse the assessment for teacher evaluations, and since CCSS promises to be the essence of professional development for the foreseeable future, there’s every reason to expect student test scores to rise, at least in the short-term.

While I would like to see a way around using student test scores for teacher evaluation, what I would love to see is a reasonable, rational US Congress completely rewrite ESEA, better known as NCLB. Remember, all the nonsense we’re going through right now is an effort to secure a waiver from the onerous sanctions of that ridiculous law. ESEA, as it was originally conceived decades ago, was designed to provide support for our country’s high-needs students. If Congress could set aside their bickering long enough to write a law that actually did that, we wouldn’t have to worry about all this crap.

Dream on, Tom.

Inslee and Dorn: “Can,” “Must,” and “Will Not.”

George is watchingBy Mark

I'm not sure I understand. 

Did Jay Inslee travel to Washington, D.C., solely to tell Arne Duncan that our Washington will do whatever the USDE wants? And this was initially heralded as "progress"?

The Governor's office has issued this press release, which is thin on details and basically says a bill will be proposed soon by Dorn and Inslee that will include requirements for statewide assessments in 2017-18 (which I thought was already the works) and a recommendation from the TPEP steering committee (about what, it is unclear) by 2016-17. The media seems to interpret this is as a victory for "must" over "can" which, as I've already pointed out, does NOTHING to actually make our teacher evaluation system better for kids, nor does it make teachers more accountable."Must" over "can" only means we have to budget to spend more money on standardized testing instead of more money on making student learning happen. My weak metaphor, considering my goals to get healthy this year: we're buying a very, very expensive scale (and an invalid and inaccurate one at that) instead of investing in healthier lifestyle.

As of my groggy pre-workout-and-coffee reading this morning, the Dorn-Inslee bill doesn't appear to have been released for me to examine the text. If the bill holds back on changing the law, and the waiver is granted pending the TPEP steering committee recommendations in 2016-17 (a.k.a. kicking the can down the road), then I suppose I'm satisfied–I just hope the steering committee has the guts to do and say what Inslee apparently didn't. If the bill proposes the same word change as the bills that already died in the legislature, then the fight picks up again. But seriously, everyone: Stop playing games and give us the waiver. We're doing the right thing. 

With renewed focus on "can" and "must," I guess I'll repeat: Our teacher evaluation system may not be perfect (though I think the strengths far outweigh the weaknesses), but including a "must" around test scores will not hold more teachers accountable, will not impact student learning, and will not improve the profession.

NEA President is Concerned about Common Core Implementation

070309 Petco 2By Tom

As you may have heard, NEA President Dennis Van Roekel had some sharp words to say about the rollout of the CCSS. He called the implementation “completely botched.” His assessment is apparently based on feedback he’s received from NEA members over the past year. There’s no way to interpret this as anything other than a major blow to proponents of the Common Core. The NEA – our nation’s biggest teacher organization – has been one of the strongest supporters of nation-wide standards and has consistently pledged to use classroom teachers as “ambassadors” to spread support for CCSS.

I certainly can’t speak for all NEA members, but I can speak for myself. When I first started teaching, thirty years ago, standards were effectively hidden; curriculum companies seemed to know what students should know and be able to do at each grade level and they used that information to write and publish textbooks. Teachers were simply consumers; we used what they wrote and didn’t ask too many questions.

There was an attempt in the early 90s to create a common national set of standards, but it was defeated by conservatives who argued for local control over education. Each state subsequently began to write and implement its own educational standards.

Then came 2001. With NCLB, our lawmakers decided that every school had to get every kid “up to standard” within twelve years, something not even Finland could ever achieve. Making it even more ridiculous was the fact that by that time every state had its own standards and assessments. Actually, some states didn’t even have standardized assessments.  

As the sanctions required by NCLB began to loom large, Obama became president. He decided to use the threat of those sanctions as leverage for his own reform agenda, which included the Common Core. Not surprisingly, 45 states and DC signed on, partly because they liked the standards, but partly because they wanted a waiver from NCLB sanctions.

As a teacher, I embrace the standards from an instructional perspective. The standards themselves make sense; they’re narrower and deeper and for the most part seem developmentally appropriate, at least from my perspective. But what really appeals to me is the fact that they’re (mostly) national standards. Not only will curriculum publishers have more consistent targets, but it opens the door for collaborating at a scale never imagined before.  

But with the standards came the assessments. When I first started scrolling through the fourth grade SBAC language arts assessment, I remember thinking, “Wow, this will be challenging for my students. But I’m sure there will be support and with that support I’ll be able to get my kids to achieve something remarkable.” And in my state and my district, that support has started to materialize. We’re focusing on CCSS-related instruction in district professional development time, and I hooked up with an awesome training in an instructional model called Literacy Design Collaborative.

But there’s a problem. The implementation of Common Core and its attendant assessments are unfortunately occurring while teacher evaluation is undergoing a major shift. Teachers are, for the first time, being assessed in part on the basis of student growth; student growth which is – or soon will be – measured by brand-new assessments based on a brand-new set of standards.

Teachers are, quite predictably, freaking out over all this. It’s one thing to change the standards and the tests used to measure those standards. It’s another thing altogether to use those tests for teacher evaluations before teachers have a chance to fully delve into those standards and understand what the assessments are actually demanding from our students.

That’s exactly why Dennis Van Roekel is calling for a “course correction.” It’s a simple request to slow things down to a manageable pace. Let us get to know the standards. Let us understand the tests. And then, down the road, maybe we can use those tests as part of teacher evaluation. Or maybe not. But to press on both fronts right now is counter-productive. The only way to ever successfully implement the Common Core is to get teacher buy-in.

And the only way to insure that the Common Core is not successfully implemented is to alienate those same teachers. And that seems to be what’s happening. 

Inslee and Arne: If I Wrote the Governor’s Talking Points

500px-Seal_of_Washington.svgBy Mark

Now that fear-inspired changes to teacher evaluation law (to include "must include state tests" rather than "can include state tests" under the ominous threat of losing our NCLB waiver) are effectively "dead" in our state legislature, Governor Inslee will be meeting with Arne Duncan in D.C. this Monday, February 24th, to seek some sort of agreement that keeps the two Washingtons copacetic.

Regarding our teacher evaluation law, this is what I hope Governor Inslee communicates to Secretary Duncan:

1. Our current teacher evaluation law, though it does not require state test scores, does something better: as written it holds every single teacher in the state of Washington accountable for demonstrating student growth. State test scores, at the very best, could "hold accountable" roughly 16% of teachers. The current law sets a higher bar.

2. Our current teacher evaluation law recognizes the reality of the learning process, and thus requires that teachers do not simply demonstrate student achievement, but instead must demonstrate a change in student achievement between two points in time; change that must be based on multiple measures (RCW 28a.405.100:2f). The current law demands more from our teachers.

3. Our current teacher evaluation law includes language that requires that student growth data not simply be used for data's sake–student achievement data must be "relevant to the teacher and subject matter" which helps ensure that data used to evaluate teachers is actually reflective of that teacher's impact on student learning; this is unlike other states where, say, the PE teacher's evaluation is based on the building's state reading test scores. Washington's current law holds teachers accountable for what they are actually charged to teach.

The simple conclusion: We deserve the waiver.

Continue reading

Randy Dorn Favors Using Achievement Tests on Teacher Evaluations

20110830-203622-pic-719702789By Tom

In a recent guest editorial in the Seattle Times, Washington State School Superintendent Randy Dorn spoke in favor of using student achievement tests on teacher evaluations. Basically his rationale boils down to two reasons:

1. The state’s NCLB waiver is at risk. The Department of Education granted us a waiver from the onerous requirements of NCLB, but takes a dim view of our teacher evaluation system’s provision that student test scores can be used for evaluative purposes, instead of mandating that they must.

2. Using student test scores will make teacher evaluations more consistent, since these are tests all students must take, as opposed to district-based tests, which vary from district to district.

Let me respond to his second reason first, since it’s the weakest. As we’ve reported time and again on this blog, a main argument against using student test scores is that they aren’t consistent. The fact is, only a small minority of teachers teach in “tested” grades or subjects. Consider my school, which has 34 certificated employees. These include four music teachers, one PE teacher, one librarian, six special education teachers and one counselor. We also have three kindergarten teachers, four first grade teachers, three second grade teachers, and three third grade teachers.

None of these people teach grades or subjects for which state achievement tests could be used for their evaluations.

We also have three fourth grade teachers, three fifth grade teachers and two sixth grade teachers. That’s only eight teachers. Eight out of 34 teachers – less than 24% – for whom state tests could be used. The rest of our faculty would have to use district or classroom based tests. Yet Mr. Dorn argues that using state tests would be more consistent? How?

On the other hand, his other argument – the risk of losing the waiver – does make sense. I have to assume that Randy Dorn, Governor Inslee, or both of them have asked Washington’s congressional delegation to press Department of Education officials about the true risk to Washington’s waiver. And the fact that Mr. Dorn is still arguing in favor of capitulating to the DOE’s demands means he doesn’t think they’re bluffing. Either that or he just doesn’t want to take the chance that they aren’t.

And that’s where he and I agree. Like Dorn, I’m not willing to gamble that much money ($38 million) for the sake of fairer evaluations for teachers like me. Put another way, I’m willing to use state achievement tests instead of more meaningful district or classroom based tests as part of my evaluation if it means ensuring our NCLB waiver.

Adjunct Math Instructor right after College: What was that like?

Community collegeBy Maren Johnson

I had just graduated from college and I wasn't sure what I was going to do next: Graduate school? Peace Corps? I didn't know, and I needed an interim job while I figured it out.

I answered an ad in the local paper to be a math tutor for a nearby community college. I got a call-back after the interview—they didn’t need me for a tutor, but there were two math classes starting the following week—would I be willing to teach them? I was very surprised by the offer, but I thought, “What an opportunity!” and said yes almost right away.

And why was this community college willing to hire a 22 year old biology and French major, who had graduated just 4 days previously, to be their new math instructor? I perhaps should have done more inquiring–I knew nothing at that point about the ins and outs of education employment, and the world of being an adjunct instructor.

The job paid very little, but by living in the bedroom of a house I shared with some college friends, I was able to make it work, at least for the short term. I taught evening classes which ended at 9:00 pm, and then had to drive home across town afterwards.

With no office or regular classroom, I held “office hours” on some chairs near the building entry way, providing assistance to students with their math as crowds strolled by.

The perks of the job? I had interesting colleagues, and I did help a lot of students learn some important math.

This turned out not to be enough as I could not support myself. After two quarters as an adjunct instructor, I ended up joining the Peace Corps. At least as a Peace Corps Volunteer I would have health insurance. I taught math while I was in the Peace Corps, and then became a high school science teacher.

Why am I writing about this now? The adjunct issue has recently seen some federal interest. With a surprisingly humorous title for a congressional paper, the Just-in-Time Professor report, authored by staff of the US House Committee on Education and the Workforce, notes that 50% of all higher education faculty are now adjuncts. Other estimates put the figure at 60%.  The report states that these contingent or adjunct instructors have “no job security from one quarter to the next, work at a piece rate with few or no benefits across multiple workplaces, and far too often struggle to make ends meet.” I’m here to tell you from personal experience that is no exaggeration.

A full time adjunct might make only $21,000 a year, according to a recently posted article about the issue. The work performed by adjunct instructors is critical to our education system—they provide a foundation in basic skills to students who are pursuing two and four year degrees. Adjunct instructors deserve a living wage. It is shocking they do not receive one.

Squeezing the Joy out of Teaching

Red_geranium_largeBy Mark

Common Core State Standards, TPEP, data-collection, student growth. These have all been the culprit in many conversations with teachers wherein they, with understandable sadness, talk of how all of these new initiatives and expectations are squeezing the creativity and joy out of teaching. I empathize with where these teachers are; I even wrote here a while back about the sense of mourning I felt as I began to align my course content to the Common Core.

When I was in the ninth grade, we found out that my mother had breast cancer. As a family before and even during this, we experienced little strife–I had it quite good on our little farm in the middle of a blank spot on the map of Oregon–but we were not particularly emotional, super touchy-huggy, or all that. (When we were first together, my wife, lovingly, equated my family's mealtimes to a board meeting.) After the cancer diagnosis, I'm sure the experience for my mother and father was very different, but I remember only the simple resolve with which my parents approached her cancer as a task to be taken care of–it is what it is and now we need to do something about it. Surgery and a slew of pills took care of the first round of cancer. It returned again a couple of years later, and surgery again was, thankfully, enough. My mother has been cancer-free since.

Continue reading