The Day the State Super Came to Town and I Wasn't Invited.

Alright, I'm 10 days into the new school year and I feel like I can safely say that I've been assigned to teach an incredibly pleasant and thoughtful group of sophomores. I can also say with some confidence that a great deal of my time has been spent, not on effective ways to reach students, but on excessive pre-tests, the teacher evaluation system, analysis of standardized test questions, the planning of remediation for standardized tests, and other such nonsense that has little to do with what's in the best interest of educating children.

Fortunately, Ohio's Superintendent of Instruction Paolo DeMaria visited the city where I live to participate in a workforce development summit yesterday, and was able to provide an explanation for my focus on standardization and assessment.

According to Elyria's Chronicle-Telegram he explained...

As we continue to watch the economy change, as we continue to watch our global competitors competing against us job for job and dollar for dollar, as we watch other states compete against us job for job and dollar for dollar, a decision was made to raise those standards. We need to raise them higher so more and more students are graduating from high school ready to succeed. We saw too many examples of students getting high school diplomas with hopes of enrolling in a place like Lorain County Community College and you know what — their academic skills just weren’t quite there.

He is right. We have watched our economy change as his colleague, Governor John Kasich drastically cut funding to municipalities eliminating thousands of jobs statewide. Kasich also cut funding to public schools which necessitated cuts of teachers and valuable programs which prepared students for the workplace. My school had a functioning television studio which drove student interest and increased their motivation. It was eliminated, along with some sports, art, instrumental music, and libraries.

DeMaria would be well served to look into some history at the ODE and perhaps some educational philosophy. First of all, students who participate in the arts, sports, and extracurricular programs have a greater likelihood of success. Eliminating them would seem to be counterproductive. Second, what we have implemented in the state of Ohio has little to do with a "decision to raise those standards," as noble as that sounds. What the state legislature and the ODE have implemented is an increasingly excessive and convoluted assessment system that first employed PARCC, now AIR, test questions from Nevada, Utah and elsewhere that they're using as a high stakes measure of students, teachers, and public schools, all while they obstruct similar measures at the charters they claim are effective.

With all due respect, Mr. DeMaria, we have used high stakes assessments for more than a decade and not closed the achievement gap. Furthermore, under the current administration and leadership in the ODE, Ohio has dropped in its national education ranking from 5th to 23rd. These policies are not working.

In another passage the Superintendent uses the introduction of the 3 point line in basketball as an analogy for our increase in standards in order to make students college and career ready...

That created an incentive for the system to recalibrate, coaches started coaching more players to say, ‘We value more this particular skill.’ It’s a great analogy for what’s happening in our economy, where people are saying, ‘We value these particular skills.’

The system stepped up, and you began to see many, many more opportunities and skills are developed to meet that challenge. That’s what’s happening in K-12 now. We’re not quite at it. We’re still used to making those 2-point shots, taking shots from the foul line. But more and more, we are up to helping our students become those 3-point shooters.

My first thought was, 3rd graders can't shoot three pointers, and the 3rd grade guarantee is unfair. Get rid of it.

Oddly, I see this analogy as an argument against the standardization he is celebrating. I'm not a basketball coach, but I'm willing to bet that they don't coach every player to shoot threes. It seems far more likely that, like a good teacher, coaches look at a player's specific skill set, interest, and potential and encourage them to develop certain parts of their game.

Our overuse of standardized testing does just the opposite, it forces us into very specific content area boxes, with a certain language and little room to move. When students score poorly and need to retake assessments for graduation, we provide remediation. More often than not this remediation is not developing academic skills, but test taking skills. That's a different matter entirely, but everybody has to shoot the damn three pointer in order to graduate.

Actual academic and workplace skills are typically soft skills that are difficult to assess using a standardized measure. None of this is nearly as simple as that. Creativity, teamwork, motivation, resilience, skepticism, problem solving are often the skills best developed by the programs we are eliminating, not standardization.

At the article's conclusion, DeMaria finished with a comment on the coming school report cards...

Anytime you make changes that reflect higher expectations, it sort of sets a recalibration of the overall measures. I think it also reflects that we know we have to continue to make changes to the system. There are a lot of tools in the toolbox to gauge the value of an education, the value of a school district in the community. This is just one piece of it. I think it does shed some light on where things are in terms of the main academic categories and the way different student populations are being treated.

While I don't think continual changes are a great idea, as evidenced by the state's mess of an assessment system, I do agree with a piece of this statement. There are a lot of tools to gauge the value of an education. So why do we continue to place so much weight on a score on a standardized test?

Predictions.

That's T-bone. Now, this may sound like I've lost my mind, but I think he knows that I go back to school next week. I know what you're thinking, "Did you tell him?" 

No, I did not. I'd been waiting for the right moment to break the news, but as I said, I think he knows. T-bone has been trying to make the most of our last few days of summer, spending more time inside, sitting on my lap with his eyes lidded like the Buddha, spending more time sitting on my lap before he invariably becomes agitated and claws the hell out of my arm (distinctly not Buddha-like). He has also more frequently insisted that we sit together on the backyard grass for long conversations before he invariably becomes agitated and, well, you know.

Whether T-bone is as intelligent (or sociopathic) as I suspect or I've simply spent too much time with my cat this summer matters little. School starts next week and I'm getting excited. In the absurdity of my excitement, I thought I'd make some bold (and some not so bold) predictions...

#1) Scores on this year's report card for nearly all schools will be far poorer than prior years because of a second year of new assessments. The ODE will admit as much, and discuss the time and effort that are being put forth to improve student achievement (read scores), as well as the importance of accountability. The ODE will release new information on the assessments which will be impossible to find on their website.

#2) Furthermore, the ODE will persist with the propaganda that standardized tests are necessary to assure that our children are college and career ready (without any mention of the limitations in the use of standardized tests for this purpose), and schools unable to meet arbitrarily set achievement levels should be taken over by the state and/or opened to private corporate management firms, what they will call public charter schools.

#3) Predictably, those schools and districts with the lowest scores will be those who serve our society's most vulnerable populations as the assessments prove once again that they are best at measuring economic standing.

#4) In response to implicit and explicit threats from the ODE, school districts will purchase more hardware, software, and educational materials, while students get more "screen time" in school in the interest of improved scores. Everyone will swear that this is NOT "test prep," but rather a means to assure that your child is able to compete in a global economy. We all know it's test prep.

#5) New State Superintendent of Schools Paolo DeMaria will continue to insist that he welcomes the feedback of all stakeholders in education, from parents to principals, from teachers to students. As emails and the responses to surveys pile up, no results from the feedback will be made public, nor is any response evident from the Superintendent himself aside from his ongoing support of charter schools.

#6) ECOT will continue to ignore its detractors who point to its 30 something percent graduation rate by arguing that it has the largest graduating class. Their ability to ignore facts, fail to grasp simple statistics, and completely miss the point for the sake of profit will make even those who accept the largest campaign donations from William Lager begin to flinch a bit. But not Dave Yost, our brilliant state auditor who already rewarded ECOT's excellent record-keeping. He'll continue to deflect the blame as he keeps one eye on the governor's office.

#7) Based upon the alarming percentage of high school students, likely 30 - 50% in some districts, who are not on pace to gain their 18 points to graduate, a larger collective outcry of students, parents, teachers, and other stakeholders will be heard demanding a remedy to this untenable situation. The overarching goal will become completely disconnecting high school graduation from standardized test scores. In response, the ODE will once again explain the completely inadequate 3 paths to graduation.

#8) Meanwhile, in districts around the state, teachers like myself will do our best to set all of the above bullshit aside, in order to have some fun, keep it weird, and teach some kids. And when they respond well and find success we'll champion their accomplishments. And when they have some difficulty, or everything seems overwhelming, we'll try to find some pragmatic solutions. After all, we didn't get into this business for profit or power, or in the interest of furthering a political agenda.

Hey, T-bone, I'm going back to school next week.

Problems in the Paradoxes.

“It has always seemed strange to me...The things we admire in men, kindness and generosity, openness, honesty, understanding and feeling, are the concomitants of failure in our system. And those traits we detest, sharpness, greed, acquisitiveness, meanness, egotism and self-interest, are the traits of success. And while men admire the quality of the first they love the produce of the second.”                                                                                                                                                                     - John Steinbeck Cannery Row

It's been awhile since I've written anything education related, having been focused on some creative things, as well as rereading both Cannery Row and The Outsiders, checking in on my garden, and hiding in my basement for the duration of the RNC.

I have made time to endlessly harass my Department Chair and our Associate Principal tasked with state testing to see the American History scores of my students. It's been nearly a month since the state required itself to submit them to districts, and I've yet to hear anything. I know that the scores will be lower overall when compared to the Ohio Graduation Test. The new assessments are an entirely different monster. I can only assume that my colleagues are withholding my scores for the sake of my sanity. I would like to take a moment to first assure them that I can handle the information, and second say, let me see the scores already.

They may just think I'm a raving lunatic, or have no idea why I'm so concerned. They're busy people with many other matters to attend to, I'm sure. The truth is, I take all of this very personally, as many teachers do. Just like it was my responsibility to assure that my students passed the Social Studies OGT, it is now my responsibility to assure that my students score a 3 on the American History test (2.57 being the average necessary per test to reach 18 points to graduate). If I'm pragmatic, then I need them to score 4's and 5's to compensate for the Math scores that have been abysmal according to reports.

Perhaps my mentality is wrong. After all, our standardized testing system in Ohio is excessive in its high stakes, has little validity because of its constant state of flux, and like all standardized tests measures little more than relative poverty. No matter how great a teacher I become, it is improbable that my influence can overcome the harsh reality of economics.

Because of this and a multitude of other social, psychological, physical, environmental and academic issues, there is no realistic way that I can assure that my 140 or so students will score a 4 or 5. I mean no offense to my very intelligent, hard working, and charismatic students, but standardized testing systems are designed to fail a certain percentage of students. The cut off for proficiency is set after the tests are graded. Last month the state school board decided to change the cut score for Geometry so that 52% scored proficient or above. The flip side to that, of course, is that 48% of kids failed to earn adequate points to stay on a path to graduation. 

So, why am I so concerned about scores on an American History assessment that is a part of a testing system in which I am in wholehearted disagreement? Because these are my students and their concerns are my concerns. They are dealing with high school, a time in one's life that is difficult and confusing enough without a systematic attempt to prevent your graduation. All I'm trying to do, as their teacher, is to make life a little bit easier, and effectively instill some content knowledge, skills, and critical thought.

Now if you did watch the RNC this week, my comments run contrary to the prevailing conservative opinion of public schools and their teachers as expressed by Donald Trump, Jr., "Our schools used to be an elevator to the middle class. Now they’re stalled on the ground floor. They’re like Soviet-era department stores that are run for the benefit of the clerks and not the customers, for the teachers and the administrators and not the students. You know why other countries do better on K through 12? They let parents choose where to send their own children to school."

I'm going to ignore the comment about parents in other countries taking widespread advantage of school choice. They don't. I'm more concerned about the persistent myth that American students (and in turn their schools and teachers) perform poorly in comparison to other countries. When you take into consideration the relative size of the United States, and the number of economically disadvantaged students that we educate, our scores are comparable, if not better. Mr. Trump's entire premise is simply not based in reality. According to the Economic Policy Institute...

"If U.S. adolescents had a social class distribution that was similar to the distribution in countries to which the United States is frequently compared, average reading scores in the United States would be higher than average reading scores in the similar post-industrial countries we examined (France, Germany, and the United Kingdom), and average math scores in the United States would be about the same as average math scores in similar post-industrial countries."

If this is true, then maybe I'm not like a clerk at a Leningrad Gold Circle circa 1982. Maybe Donald Trump Jr. has never set foot in a public school, and has had everything handed to him his entire life including his current title of "businessman", so has absolutely no idea what he's talking about. Maybe the public schools really are successful. Maybe the standardized testing system is completely and utterly unnecessary.

Maybe I shouldn't care so much about these scores. Except that I do.

The problem is in the paradox. I have to concern myself with scores on assessments in a testing system that favors rich over poor, that assures failure, and that I unequivocally despise. 

I have to concern myself because my students' graduation depends on it. I am their teacher and I've chosen that position to teach history and look out for their interests. Even in a system designed to make us look like failures, while our detractors use rhetoric, misinformation and fear to turn public opinion against us, it is what teachers do.

A Comment from the New Superintendent.

Just before my family and I left to watch fireworks yesterday, I received the following email...

Paolo DeMaria has left a new comment on your post "The Superintendent Has Asked for Our Input. Contac...": 

Matthew,
Your post was brought to my attention by Dawn Neely-Randall. I enjoyed reading it. Thanks for the input. I look forward to reading future postings. -- Paolo 

Now, I'm sure more accomplished writers and activists would've taken this in stride. I, however, being a public school teacher and novice activist (as well as terribly neurotic and full of myself), became immediately paranoid. I proceeded to close all of the curtains and breathe into a paper bag to stave off hyperventilation. Once I was able to kick the cold sweats, we left for fireworks, where I became convinced I was being followed on numerous occasions. Needless to say, the incessant explosions did nothing to calm my nerves.

This morning, having slept on it, I decided to view Mr. DeMaria's response as a opportunity. Perhaps he's interested in opening up a dialogue with public school teachers, I thought to myself. Is there any reason to be so pessimistic and paranoid (outside of the past decade plus of attacks on public schools and public school teachers)? So, having nudged myself into a reluctant optimism, I decided to reply to the Superintendent. What follows is my response to his comment. Once again, I encourage you to contact him as well. It seems he's open to input. I'll let you know if I hear anything back.

My Optimistic Reply...

Superintendent DeMaria,

I wanted to thank you for your kind words regarding my blogpost at Testing Window regarding providing input to you on education issues in Ohio. I appreciate that you took the time, especially since the piece was terribly critical of the state of education at the state level. I must admit, I was surprised to receive the notification. I'm sure it's been a terribly busy first week on the job, and I'd assume you have far more important things to do. Again, I appreciate the response, and hope this is an indication of an actual openness to input on these issues.

As I indicated in the piece, I am reluctantly optimistic regarding your coming tenure as Superintendent. While we likely differ politically on many issues, we seem to have some things in common. I, too, enjoy riding my bike, and am concerned about a remedy to the many issues plaguing education in Ohio. I have read that your friends say that you have a good sense of humor, and I like to think that I do as well (though my wife might disagree). I believe that a critical eye for information and my sense of humor are what drive my writing on education, and have helped me to thrive as a public school teacher for close to 20 years.

As you know, the political climate over the last decade plus has not made it an easy time to be a public school teacher, nor optimistic regarding education. Let me be clear, this has nothing to do with the students that I have encountered as an American History teacher at Elyria High School. This socially, economically, and culturally diverse group of kids have been brilliant, often despite their circumstances. They have achieved based on their own standards for excellence, as well as under the state's system, and moved on to bigger successes in college and careers.

We continue to accomplish great things despite an unresponsive political hierarchy that believes in the myth of the failing public school. Those in power also believe the long since disproven ideas that assessments promote achievement, that charter schools offer a superior product, that teachers are the cause of the bulk of society's ills. Despite the many issues that I listed in my blog, my public school is successful. Despite cuts in funding which have necessitated the closure of schools, the elimination of programs and teaching positions, we are successful. 

On behalf of my students, I am currently most concerned about our current system of evolving assessments and their high-stakes connection to graduation. The assessments are inappropriate in content and language, and unfair in their inequitable administration. Scores have been alarmingly low, and not just in urban districts like mine. This is hardly an indication of student, teacher or district failure, but rather the failure to appropriately develop and implement an assessment system. Students are worried. For them, this is not a political issue. It is their lives. This is a major reason why I believe that high-stakes decisions should never be tied to assessments. So, if your response to my blogpost is, in fact, an indication of your legitimate openness to ideas (and once again you'll forgive my skepticism), then please keep a close eye on this situation as it pertains to graduation. 

For what it's worth, I plan to copy your comment and my above response in a post today on Testing Window, as I believe it illustrates your openness to ideas. I hope that this is the beginning of a legitimate dialogue between you and public school teachers statewide.

Sincerely,
Matt Jablonski

A 4th Path to Graduation? Not for Public School Kids.

Another big thanks to State School Board Member Pat Bruns. She recently pointed out to us that alternate assessments can be used as a 4th path to graduation for students on vouchers at non-public schools. This was established through an amendment to HB 299, a bill whose original intent was to provide assistance for students with autism.

This seems to clearly violate the idea of providing equal educational opportunities to Ohio's schoolchildren.

This week my wife searched the ODE website in an attempt to locate the acceptable alternative assessments. This, of course, proved fruitless because the ODE website has been created to be purposefully confusing, and as it turned out, the information wasn't even there.

Fortunately, Board Member Bruns was able to put in a request, and the ODE posted the relevant information Thursday. Below I have copied my thanks to Pat Bruns which also rattles off a few of the issues that I see with this situation, as well as the ODE's explanation of the alternative assessments.

The Thank you...

Brilliant! Thanks for your legwork on this matter.

It makes me ill that my kids at Elyria High will suffer under the expectation for failure common to urban students, while others (because of wealth, or religious affiliation, or decision to use a voucher) have more opportunities for success through graduation.

For what it's worth, I've heard Senator Lehner discuss the success of the 3rd grade guarantee. ALL of those students are welcome to take alternate assessments that often have more "friendly" cut scores. Though her argument, and those who agree, is that these 3rd graders have simply worked harder and pulled themselves up by their bootstraps in order to achieve at a higher level. No, same level, different assessment.

As for all of these alternate assessments, they're also paper and pencil tests, if I'm not mistaken, which provides an advantage as we're finding through the research. Though the ODE doesn't care to investigate the paper pencil vs. computer conundrum. And we call this equal educational opportunity.

Also, your information from Ms. Wadsworth was just posted Thursday. It wasn't there when we searched the site earlier. So, "good on you," as they say, for getting some relevant info to the public.

Thanks again for your help, Pat. Hey, I'm having a garage sale today. Can I interest you in a kitchen table, or a set of children's golf clubs?

Cheers.

Matt

The ODE's Recently Posted Material on the Issue...

Your requested information can be found mid-way on this page:http://education.ohio.gov/Topics/Quality-School-Choice/Private-Schools/Chartered-Nonpublic-School-Information

 

Alternative High School Assessment for Graduation (For Chartered Non-Public Schools)

The alternative high school assessments for graduation may be used by Chartered Non-public high schools in place of Ohio’s State End of Course Test and has been determined to meet the requirements in Ohio Revised Code 3313.619.

The following assessments have been conditionally approved dependent on establishment of comparable standards for performance to the state End of Course Tests. ODE will work with the vendors to provide these standards and will post when they are available.

ASSESSMENT	SERVICE SUMMARY	PERFORMANCE LEVEL SCORES
Iowa Assessments (Houghton Mifflin Harcourt Publishing Company	Iowa Assessments Forms E and F, Levels 15-17/18	TBD
Terra Nova (Data Recognition Corporation)	Terra Nova, Third Edition (Terra Nova 3TM )

 

The Superintendent Has Asked for Our Input. Contact him here...superintendent@education.ohio.gov

Welcome to the hot seat new Ohio Superintendent of Public Instruction Paolo DeMaria. He rode his bike to work yesterday for his first day on the job.

Here's a quote from the avid cyclist and new Superintendent as provided in a press release by his new charges, one of the "worst-run" state agencies (according to Ohio Auditor Dave Yost), the dysfunctional Ohio Department of Education...

“Education defines our future as individuals, as a community, as a state and as a nation,” said Paolo DeMaria, superintendent of public instruction. “It’s an exciting time for education in Ohio, and I look forward to engaging with our families, teachers, administrators, policy makers and advocates to help guide our work at the department.”

While this sounds a lot like rhetoric, I have a wild inclination to be blindly optimistic, just like when the Chair of the House Education Committee Andy Brenner, upon taking that position, told us,  "I am passionate about making sure that every child in this state has equal access to an excellent public education, and am excited to have this opportunity.” Of course Brenner is currently attempting to expand Ohio's voucher system by promoting an amendment to HB 481 that would expand the number of eligible schools through the use of scores on the current assessments. What was that about public education Mr. Brenner?

So, let's say I'm skeptical about this openness to guidance. However, in a bold move on his first day on the job, Superintendent DeMaria has doubled down. According to an article in the Cleveland Plain Dealer, he went on to say...

"I want to listen- to get a clear sense of what's happening out here. Share with us. Communicate with us, Tell us what we're doing well, what we're not doing well." He added, "Don't just sit back and stew if you see something you don't like."

And so once again, an educational leader with the state has asked for public input. To be honest, I was planning on offering unsolicited advice anyway, but it's nice to be asked. The issue here is not the lack of an invitation, but a willingness of those in power to act on the recommendations of other stakeholders. I'll concede that we've seen a bit of movement by those in power as evidenced by the slight changes in the assessment system, and charter regulation (however laughable in scope).

My other issue, I guess, is where to begin. There are so many systemic problems in Ohio's education system at the state level, that I'm not sure how to address them all. It might be easiest to tear it down and begin again, repeal all education law outside of the Ohio Constitution and start anew. That solution amounts to "throwing out the baby with the bathwater." No one wants to do this because it sounds terrible for the baby. I believe that depends on who, or what, the baby is in our scenario. If the baby is Ohio's charter schools, then I'm cool with that, regardless of how every well meaning diplomat who has taken campaign donations from William Lager wants to defend millions of dollars in fiscal waste by referencing "effective charters." 

Of course, if the baby is an actual baby, then we can't throw it out. What we do, then, is to teach that kid from pre-K through 12 in a neighborhood public school well funded enough to provide a wealth of programs and small class sizes that can remediate any issues (academic, economic, social) that the baby may have in order to assure an equal educational opportunity.

As it stands, the bathwater of education in Ohio has gotten so filthy with ridiculously partisan anti-public school, pro-privatization, pro-accountability (read pro-high stakes testing) policy that it has become increasingly difficult to provide children with that opportunity. 

Which brings us back to the new Super, who wants to hear what they can do better. Here's my list, which is by no means comprehensive and not in an order that I would consider "of importance." I'm just spitballing. Later this week I'll pare it down into a letter to Mr. DeMaria. I will choose those things that I find most important, that I also believe the Superintendent would be willing to discuss. I encourage you to do the same.

Problems with the Bathwater.

1) A State Superintendant should be chosen for their experience in education, as well as a commitment to quality public schools, not because of their bureaucratic or policy experience, or as an advocate of school choice.

2) The State School Board should be a 100% elected entity in order to, insomuch as possible, eliminate the partisan political agenda of the governor's office.

3) The previous Superintendent (not Lonny), along with members of the ODE, are likely guilty of fraud and should be the subject of a public investigation and criminal proceedings. The state school board and the ODE will have no credibility unless this is undertaken.

4) Ohio's school funding system is unconstitutional and creates widespread educational inequity. Urge that it be fixed immediately.

5) Charter schools, if they must exist, should be funded separately. What the Ohio Republican Party touts as increases to education funding is actually an increase in funding to charter schools because of the existing convoluted formula which takes state and local funding from public schools and redirects those funds to charters which are often ineffective.

6) Charter schools should be subject to the exact same regulations as public schools. Until this happens there should be no more bullshit rhetoric that references a "level playing field" or "apples to apples."

7) Eliminating PARCC as a vendor of assessments did NOT resolve testing issues in the state of Ohio regardless of what you may have heard from your local legislator. AIR is creating PARCC-like assessments which are too long despite being administered in a single window, use a language completely contrary to the vernacular of our students, and are not promoting student achievement, but rather a culture of failure in our schools.

8) All high stakes decisions tied to standardized tests like the 3rd grade guarantee, high school graduation, ratings of teachers, schools and districts should be eliminated as they are an inappropriate use of assessment data.

9) The Ohio Teacher Evaluation System should be eliminated in favor of local instruments for the evaluation of teachers, decided on with the input of local stakeholders. OTES is far too cumbersome and time consuming for both teachers and administrators. It takes valuable resources away from the important work of educating children.

10) Fix the damn ODE website. It is awful, impossible to navigate, and thus completely useless as a meaningful source of information for administrators, teachers, parents, students, and other members of the community. It is Alice's rabbit hole. (I know this last one may seem petty by comparison, but where are we without accurate information on the current system? Lost.)

Thanks Pat Bruns.

I am very grateful to Pat Bruns, state school board member and former teacher, for twice responding to my concerns regarding high school graduation. This is a fine example of democracy in action, an elected official in thoughtful discussion with a citizen. She is an advocate for teachers, students, and public schools in general. In the first passage below, she explains the board's resolution regarding test scores. The second piece is my response to this latest correspondence. Finally, I have included the resolution as provided by Board Member Bruns (unfortunately it didn't copy and paste well). I've also added her initial correspondence with me at the bottom, which might help to clarify her opinions on the matter.

Bruns' email:

Mr. Jablonski,

I wanted to follow-up with the resolution that the State Board passed at the June 14 meeting regarding testing. Please contact me with further questions/concerns.

Some Background: The State Board of Education approved the performance levels for Ohio’s State Tests in mathematics and English language arts during the January 2016 board meeting. This was done with the expectation that Ohio Department of Education staff members would work with our vendor, American Institutes for Research (AIR), to review the early results from the spring test administration in June 2016 to determine if any changes may be recommended to the performance levels.

As you may recall, the performance levels provided were based on recommendations made by panels of educators after reviewing several items, including: actual test items, field test data from other AIRCore states and past performance on assessments such as NAEP, PARCC, Smarter Balanced and Ohio Achievement Assessments.

AIR currently is working to score and analyze the results of Ohio’s spring tests. Based on early results from the spring test administration, AIR is able to predict the number of Ohio students who will reach each performance level.

Thanks so much for your advocacy for your students.

Respectfully,

Pat Bruns

My response:

Board Member Bruns,

Thank you for the follow up email. I really appreciated your first reply, and am grateful for your work on the Ohio School Board. Your background as a public school teacher is invaluable in weighing in on the board's decisions. Thank you for your work on a school board that seems hostile to public schools and public school students and teachers, though I'm sure they would argue to the contrary.

I was in attendance for a portion of the school board meeting on the 14th and appreciated your question regarding business partnerships to the school leaders who gave the presentation. I also appreciated Board Member Oakar's concerns about students being able to overcome environmental issues, and A.J. Wagner's realistic defense of my initial argument regarding graduation rates. Unfortunately, the majority of the board seems to be operating on an educational philosophy regarding assessment that is decades old, and has been repeatedly disproven. This philosophy, that increasingly difficult (to pass) assessments increase student achievement, does not justify the negative impact high stakes tests have on students.

I appreciate the degree of analysis that goes into setting the cut scores. I understand that ODE and AIR reps, along with a handful of teachers, take part in analysis of test items, NAEP, and data from other states, but what we're failing to recognize is the continuing direct correlation between demographics and test scores. Your colleagues have seemed willing to address the issue when it comes to charter school ratings, but not when it comes to poor public school kids at risk for not graduating. 

Incidentally, if the analysis of Washington's NAEP and other scores (the state we used as a model) weighed in on these decisions, we should have looked at their process for setting scores. They purposefully chose proficient percentages comparable to their previous testing system, instead of 30% lower like we have done. If 80% were proficient on the previous assessment, then 80% were proficient on the new one. They were also careful regarding tying high stakes decisions, like graduation, to brand new assessments. We may have been better served to take this measured approach, rather than leaping blindly into an unproven system, twice.

After all, in the first year of the OGT, the tests didn't count for graduation. In the first year of the 3rd grade guarantee, the assessment used was the OAA, not PARCC or AIR's PARCC-like assessments. Also, the way I understand it, cut scores were lowered for an alternative assessment for 3rd graders. All I've been arguing for is a more humane system for high school students.

Don't get me wrong, I am working to figure out the best methods to educate in order to assure success on the new assessments. We are all working to figure out interventions to increase scores upon retakes of tests. We are public school teachers, as you were. We adapt and overcome for the sake of our students. I'm just not sure that this process is increasing achievement or making students "career and college ready" as much as it is increasing their capabilities as test takers.

All in all, I'm happy that my message is out there regarding the terribly low proficient rates and the danger they present regarding graduation. If I am wrong, as so many in attendance at the meeting seem to believe, then I will be happy because my students will be graduating without issue. If I am right, then at least we have begun the discussion.

Thanks again for your time and work on behalf of Ohio's students.

Sincerely,

Matthew T. Jablonski

The resolution:

Section 3301.0712 of the Revised Code requires a system of college and work ready tests, and Section 3301.0710 requires statewide achievement assessments at the end of grades three through eight. On each of those tests, the State Board is responsible for determining and designating five ranges of scores that demonstrate levels of achievement.  In 2015/2016 Ohio will administer new assessments in the subject areas of mathematics and English/Language Arts.  The Board previously adopted performance levels on the assessments in January 2016.  The Ohio Department of Education and its technical advisory panel on testing have now reviewed preliminary results from spring testing.  Based upon those preliminary results, the Department recommends adjusting the performance level on two of the tests, Geometry and Integrated Mathematics II.  The other performance levels will remain as set in January 2016.  

 

RESOLUTION TO ADJUST PERFORMANCE LEVELS FOR GEOMETRY AND INTEGRATED MATHEMATICS II

 

The Achievement Committee RECOMMENDS that the State Board of Education ADOPT the following Resolution:

 

Section 3301.0712 requires a system of college and work ready tests, which includes end-of-course tests in specified subjects and requires the state board to determine and designate at least five ranges of scores that demonstrate levels of achievements on these tests;

 

The State Board of Education in January 2016 previously set performance levels for the 2015-2016 school year on all tests:  

 

The Department has now had the opportunity to review the 2016 spring Ohio testing data, and

recommends adjusting the performance levels for two of the tests, Geometry and Integrated Math II; 

 

The Achievement Committee approved the adjustment of the performance levels on these two tests at its meeting in June 2016; and 

 

Emergency consideration of this resolution has been approved by Board leadership because setting these performance levels immediately is necessary to prevent delaying the 2015/2016 report card:  Therefore, Be It

 

RESOLVED, That the State Board of Education hereby adopts adjusted performance levels for 2015/2016 for the tests in Geometry and Integrated Mathematics II, as set forth below:  

 

Exam	Limited	Basic	Proficient	Accelerated	Advanced	Proficient or Above Total
	%  Act.	% Raw Pts.	%  Act.	% Raw Pts.	%  Act.	% Raw Pts.	%  Act.	%  Raw Pts.	%  Act.	%  Act.
Geometry	22	22	28	35	28	50	17	70	5	50
Math 2	39	26	26	39	18	54	13	72	4	35

%Act. is the percent of students actually scoring in each performance level from the spring 2016 test administration based on early return data

%Raw Pts. is the percent of raw score points needed to achieve each performance level

If you're interested, this was the first piece of correspondence that I received from Pat Bruns on the issue of test scores and graduation rates prior to the state board meeting...

Mr. Jablonski,

I would agree that 2015-16 testing and the resulting Report Card is a disaster. We will actually be discussing the very issues you have raised about the 2015 test results, timeliness of the reporting, and discrepancies in several of the math tests as you have pointed out at our June 13-14 Board meeting.

 

As a retired educator, I believe that tests are merely a snapshot of a student's progress.  I am supportive of using the ACT/SAT, a nationally normed assessment. As much as possible, we should rely on local districts to determine appropriate assessments and benchmarks for their unique population.  Those closest to the work with students should be crafting instruction and assessments that honor the individual and shape strategies to help them progress.  Several key questions we should be asking might include:

Does the assessment measure the learning standards objectives and expectations for students at each level and academic area?

Are the assessments designed for ongoing classroom strategies or for the district strategic planning?

Are the assessments transparent, timely and easily understood by the intended audience?

Is the measurement clearly tied to a specific learning objective?

I will be sure to remind my colleagues of your concerns as we continue to debate the purpose of and most appropriate assessments that will help students thrive and succeed.

Thanks for advocating so passionately for your students!  Contact or call me anytime before Monday to further discuss other ways I can forward your ideas.

In the meantime, enjoy a well-deserved "break in the action"!

Respectfully,

Pat

Pat Bruns

State Board of Education member 

District 4