Category Archives: Assessment

The English Problem

Posted by on
Assessment, Current Affairs, Education, Education Policy, Life in the Classroom, Literacy, Mathematics

File3561335707875By Mark

For several years, my building has been identifying and aligning curriculum to standards–first state standards and now Common Core Standards–with part of this process being the identification of the Power Standards! each unit of instruction is to focus upon.

Simultaneously, we are gearing up for a new teacher evaluation system which figures heavily on a teacher's ability to define what his/her students' learning targets are and assess and document student progress toward those targets.

To an extent, both have been an uneasy fit for me as a high school English teacher. It is not so much in the philosophies underpinning these movements. It is that no one that I talk to seems to understand what I've started calling "The English Problem."

Continue reading →

Staying Informed about a Moving Target

Posted by on
Assessment, Current Affairs, Education

File7021334426465By Mark

I do not envy my colleagues who teach high school math.

In the few years I've been teaching, I've watched the mad dash and scramble to react to the nearly annual changes in statewide math assessment. At this point in our building (as I'm sure is the same in every high school), students are working toward three different sets of graduation requirements related to math credit and assessment requirements. From WASL to HSPE to EOC. If only it were just a name change…

As a language arts teacher, I have witnessed relatively little change in terms of the content and skills demanded of my students in our high school statewide assessment. Our HSPE is essentially the WASL. I still feel that the test assesses the basic skills that ought to be expected for a student to earn a diploma that has any value.

I've tried to stay informed about the current state of assessment in Washington, but as it is an ever-moving target–with many moving parts–it is easy to miss something. And I missed something that I think is rather significant. I feel kinda dumb for having missed it. I'm sure somewhere along the line it was announced in a staff meeting or mentioned in an email, but the fact is, I missed it.

Continue reading →

SB 5895: The D-Word

Posted by on
Assessment, Education Policy

Z1DGoNBy Mark

Teacher evaluation is back on the radar. Senate Bill 5895 is due to be heard by the House Education Committee on February 16th (CSTP has produced a summary for quick review, but the whole bill is linked above).

One of the sticking points for me–of which there often many in any policy–has to do with the provision that at least three of the eight dimensions on which I am to be evaluated must be supported with student growth data.

There's that d-word again. 

Luckily, I found language in the bill clarifying "student growth data":

Continue reading →

The Four Point Scale…. again.

Posted by on
Assessment, Current Affairs, Education, Education Policy, Games, Life in the Classroom, Professional Development, Social Issues, Teacher Leadership

Elephant-clockBy Mark

I sat at a table with two other teachers, two building administrators, and the top two admin from the district office. We'd spent the better part of an hour sorting through the assessment rubrics and frameworks associated with the new teacher evaluation system mandated through legislative action in Senate Bill 6696. 

Silence settled on us all at once. The weight of what we were examining suddenly became overwhelming. 

Like so many things in education, the ideas and philosophies behind this new evaluation system (in brief: a shift from the binary satisfactory/unsatisfactory on a menu of teacher behaviors to a four-point continuum of evaluation using as many as sixty individual descriptors of teacher practice) we could all agree were sound, necessary, and powerful both in terms of evaluation and potential professional development.

But as we began to picture how it all could transition from philosophy to action, the beast began to be revealed.

Continue reading →

The Four Point Scale

Posted by on
Assessment, Current Affairs, Education, Education Policy, Life in the Classroom, Professional Development, Teacher Leadership

CRW_3531By Mark

Senate Bill 6696 has put into motion changes in the way teachers are evaluated.

First… the relevant language of the bill (from the link above):

Evaluations. Each school district must establish performance criteria and an evaluation process for all staff and establish a four-level rating system for evaluating classroom teachers and principals with revised evaluation criteria. Minimum criteria is specified. The new rating system must describe performance on a continuum that indicates the extent the criteria have been met or exceeded. When student growth data (showing a change in student achievement between two points in time) is available for principals and available and relevant to the teacher and subject matter it must be based on multiple measures if referenced in the evaluation.

Classroom Teachers. The revised evaluation criteria must include: centering instruction on high expectations for student achievement; demonstrating effective teaching practices; recognizing individual student learning needs, and developing strategies to address those needs; providing clear and intentional focus on subject matter content and curriculum; fostering and managing a safe, positive learning environment; using multiple student data elements to modify instruction and improve student learning; communicating and collaborating with parents and the school community; and exhibiting collaborative and collegial practices focused on improving instructional practice and student learning. The locally bargained short-form may also be used for certificated support staff or for teachers who have received one of the top two ratings for four years. The short-form evaluations must be specifically linked to one or more of the evaluation criteria.

Here in southwest Washington, ESD 112 is leading a group of districts who are beginning the process of adapting and implementing the evaluation procedures described in this bill. Of course, the first step is a careful reading of relevant parts of SB 6696. 

There are two elements of the language above that I like in particular. To begin, there's this:

Continue reading →

NCLB 2.012

Posted by on
Assessment, Current Affairs, Education, Education Policy, Elementary, Literacy, Mathematics

By Rob

In a comment on my recent blog post Tom asks: "How can we rewrite the federal education bill so that it actually helps student learn?" This is a huge question. The difficult issues of funding, evaluation, accountability, standards, and testing must be addressed in a politically feasible manner. I don’t know what is feasible but I'd advocate for these ideas-

Standards: I support national standards. As a population we are more mobile than ever and there should not be a drastic difference in the curricular content among states. This requires a level of monitoring and evaluation of states and educational systems. Currently this evaluation and monitoring is done by comparing the separate standardized tests in each state. Although these tests are given to every student multiple times throughout their schooling it is difficult to draw definitive conclusions since these tests vary in rigor and content. Our testing system needs reform.

Testing: Evaluation and monitoring of education systems is necessary for oversight and informed policy decisions. However this does not require the current two week assessment window, every child tested, a huge financial cost, lost instructional time, and enormous pressure on educators and students. Instead this should be done with a smaller randomized sample of students and less impact and intrusion on instruction.

Summative tests, currently the HSPE and MSP (sort of), are assessments of learning given at the end of a particular educational stage. Passing these tests is necessary for students to receive credits or in some cases progress to the next grade. Presently these are a part of a broken testing system. With rare exception, the students who come into the tenth grade performing far below grade level are the ones who are not going to pass the High School Proficiency Exam.

This idea isn’t new but I support summative tests at grade 3, 5, 8, 10, and 12. Students should not exit that grade until they are proficient. How can a fifth grade teacher instruct a student on comparing and contrasting an author’s inferred message when the student is struggling to sound out every third word? How can an eighth grade math teacher approach the Pythagorean Theorem with a student who struggles to multiply?

I’ve heard teachers say (myself included) I could teach 35 students if they came to me proficient in the previous year’s content. Let’s go with this idea-

It begins with half day Pre-K for all students and full day kindergarten. Before they leave kindergarten they need to know their letter sounds, numbers, reading behaviors, and should be able to read and discuss the events in a predictable text. Those who are proficient enter a first grade class capped at 24 students (35 is too many first graders for any teacher no matter how academically proficient the kids are). Those who are approaching proficiency enter a first grade class capped at 16. Those far below proficiency enroll in a class capped at 12.

Schools would use their ongoing formative assessment in grades 1,2,4,6,7,9, and 11 to reconfigure classes and to carry the model forward. The student who enters second approaching standard but exits meeting standard would enroll in the third grade class with the highest student-teacher ratio.

This model has imbedded funding implications. The schools with the highest performing students would have higher class sizes and would be cheaper to staff as long as they continued to maintain high student performance. The schools with lower performing students, ostensibly with underserved populations, would have a lower teacher-pupil ratio and would receive more funding.

This model is not without its challenges. Schools would need to take great care not to track students by providing some students with continual remediation while others engage in higher order thinking. I believe smaller numbers of students is important when serving struggling students in reading and math it is also important for students not to be ability grouped for other content areas.

Can somebody tell me why this wouldn't be an improvement? Maybe this idea isn’t ready to be written into law but couldn’t congress earmark some funding so some districts could try it?

 

Corrective Action

Posted by on
Assessment, Current Affairs, Education, Education Policy, Elementary, Life in the Classroom, Literacy, Teacher Leadership

Graph Down Arrow

By Rob

My school is in the third round of No Child Left Behind sanctions.  Among other procedures these sanctions call for ‘corrective action’ to be taken. 

Arriving at this point wasn’t a surprise.  It’s taken many years to get here.  Our school has been labeled ‘failing’ for a while but only after seeing last year’s test results do I feel like we’ve failed.  No teacher at our school wanted to enter the third round of NCLB sanctions.  Round 2, Schools of Choice, was embarrassing enough. 

There was pressure to improve our school’s test results.  I sensed a change in the tone of my evaluations.  Many new teachers were not hired for year two.  A veteran teacher was removed.  It seemed to me that the pressure was high and morale was low.

Perhaps other teachers felt this pressure more acutely than I.  Last year many of them have transferred elsewhere.  Of 23 classroom teachers 11 are novice (in their first or second year).  In my tenth year teaching I’m the second most experienced teacher at our school.

I’ve wondered how we’ve arrived at this unfortunate point.  Each fall we receive our state’s standardized test scores.  Teachers, energized and committed, face the challenge.  We’ve created systems for tracking student progress, providing extra support, engaging families, growing professionally, and improving instruction.  I believe some of these systems have been of great benefit to students.

While I thought these systems were beneficial our data never really showed it.  Here’s what it shows: (click the picture for a clearer view) 

Capture
In 2011 our scores dropped 30% to under 40% of students passing the 4th grade reading MSP.  The year before 71.4% of students passed the 3rd grade reading MSP.  The test didn’t get harder.  The state average pass rate remained flat.  This isn’t isolated to one grade.  Our 3rd grade reading pass rate fell 13.1% from the previous year.  Our 5th grade reading pass rate fell 32.8% from the previous year.

This drop in performance is startling.  So what happened?  Who knows?  I wish I had more answers and fewer questions.

Did the students consistently miss a particular type of reading comprehension question?  That could be addressed with an adjustment to the curriculum.

With a 37% mobility rate could the students who left be the ones who passed in 2010.  Might they have been replaced with students who didn't pass?  How about the families who left because of school choice (a NCLB sanction for schools in step 2 of improvement)?  Did the student population change significantly?  Are we comparing the same students from year to year?

Did students who narrowly passed the MSP in 2010 narrowly miss passing in 2011?  Did a slight drop in performance signify a drastic drop in the percent of students meeting standard?

Did significant numbers of non passing students come from specific classrooms?

Could school community, teacher morale, and the shame & blame policies of NCLB account, at least in part, for a dramatic drop in student performance?

Answers to these questions are important as a school undergoes “corrective action.”  I don’t know if anybody is asking these questions.  I don’t know if answers are available.  But I’d like to know exactly what problem I’m correcting and we all deserve a clearer answer than ‘you didn’t meet adequate yearly progress again.’ 

Testing the Limit

Posted by on
Assessment, Current Affairs, Education, Education Policy, Elementary, Life in the Classroom, Literacy, Mathematics

ScantronBy Rob

Great investments have been made to collect and use data.  The role of assessments and use of student data has shifted and it has changed the nature of education.

The standardized test, Washington’s Measurement of Student Progress, is analyzed extensively to meet the requirements of No Child Left Behind.  It is used to identify schools as “failing to meet adequate yearly progress.”  It is used to rank-order schools.  New metrics which control for the impact of poverty use this data to compare effectiveness among districts.  This assessment comes at a great cost- financial, time, lost instruction, grading, and tools for analyzing.  The information gained from it could be found with a smaller sample size and at a lower cost.

The Measurement of Academic Progress (MAP) tracks student growth across a school year.  This test is completed by students on a laptop in a separate classroom.  Our technology and curriculum coach devotes weeks to setting up the computers, scheduling, and proctoring each class.  The list of goals compiled for each student is exhausting and includes standards not covered for months or years or, depending on the curriculum, not taught at all.  I am pleased when the assessment result matchs my analysis of the student but often it doesn’t.

I get very little actionable intelligence from the results of my MSP or MAP scores.  But increasingly I have to answer for the results. 

The emphasis on testing extends far beyond MSP and MAP.  Over the course of the school year my students must complete 32 mandated “common assessments” with the score recorded into a database.  How the scores are used I have no idea.  Increasingly these assessments feel more like an audit of my teaching than a tool for improving student learning.

Students also complete regular math and spelling quizzes.  This is an additional 85 assessments.  While these tests tie closely to the content they contribute to the culture of ‘no child left untested.’  My students are expected to demonstrate their proficiency 117 times throughout a 180 day school year.  They are second graders.  In third grade the assessment load will increase.

This certainly wasn’t my experience in elementary school.  It wasn’t even the experience of my students ten years ago.  And this emphasis on testing isn’t preparing my students for adulthood:  The last assessment I took was four years ago.

One form of assessment has been overlooked by policy makers and more attention should be paid.  It is the teacher’s ongoing examination of student progress and understanding.  Teachers use this information to inform their practice and to adjust lesson pacing.  It gives teachers an indication of what to re-teach or where to extend.  It allows teachers to identify struggling students while there is time to arrange extra support.  It requires acute observation and meaningful interactions with students.  This process is at the heart of teaching; it’s where the magic happens.  It happens every day… except when we're testing.

 

New Standards, Part 2

Posted by on
Assessment, Current Affairs, Education, Education Policy, Life in the Classroom, Literacy

Wheels By Mark

One of the wheels I reinvent each August is this chart wherein I build the scope and sequence for my courses, identify the timelines as well as major formative and summative assessments, then list which EALRs/GLEs those assessments address so that I can be sure I've fulfilled my obligation. Sounds fun, eh? Yeah, I'm a fun guy.

As I posted recently, the State of Washington is shifting from the old standards for Language Arts (farewell EALRs and GLEs) to the new Common Core standards. Ultimately, I like the wording of these "new" standards better (and for some reason, I can just understand many of them better). There are changes, to be sure, but even within those changes I can easily see ways that "what I already do" could be tweaked a bit to fit that instructional goal.

This post, however, is my attempt to help illuminate the complexity within teaching that these standards illustrate. (I cannot even begin to imagine what this same post from an elementary teacher might look like!)

Continue reading →

The Skills Gap…again

Posted by on
Assessment, Current Affairs, Education, Education Policy, Mathematics, Social Issues

File000106140795 By Mark

NBC News ran a story last night about Siemens and their 3400 un-fillable jobs despite an abundance of job-seekers out there right now. The segment (embedded below) also featured small businesses who also have an abundance of openings–one owner noting something to the effect of "we can buy all the equipment we want, but it's no good if there is no one skilled to use it."

The piece discussed the "skills gap" between what the jobs require and what the prospective employees were trained for or capable of doing… and thankfully stopped just short of blaming American public school teachers for causing this, the failing economy, or current debt crisis in Europe.

The solution to the skills gap, according to the report, was more training (not testing) in math and science. Okay, that's fine. But how about training in skills?

Several of us here at SfS have beaten the drum about the need for more investment in vocational and career and technical education at the high school level. This got me thinking: what if we took every penny currently dedicated to statewide testing and test prep at all levels and instead invested it in vocational and CTE programming starting even well before high school? What about devoting funding toward funneling kids toward voc/tech speciality schools after high school instead of always talking about "college readiness" as if enrollment in a four-year is the only indicator of a school's success?

Alas, in a cursory search, I was unable to find clear numbers about the cost to taxpayers to adminster and assess all the state tests. Certainly, vocational and CTE programs can be quite expensive due to specialized equipment or facilities needs, but still, I feel like when we look at the problems facing the country, we're mismanaging our investment. 

One of the first and most important lessons I learned as a pre-service teacher was to examine the needs of my students and adjust my response, rather than just dish them a canned curriculum regardless of their needs. When I consider what our economy and country apparently need from public schools, it isn't kids who can pass tests. We need kids with skills… and report after report highlights that skills gap. Our schools apparently are not arming the emerging workforce with the tools they need to be successful.

Instead of using tests to punish schools for what we're supposedly not doing, why not fund programming to help schools do what we ought to be doing?

(Sorry about the ads in the video below. I usually open another window and check my email, but you can multitask however you choose.)

Visit msnbc.com for breaking news, world news, and news about the economy