Smorgasbord: August looms

A chart from one of my recent sessions

Teacher evaluation is about relationships and learning, not about scores

Long ago, I co-wrote a policy paper advocating for a teacher evaluation system that acknowledges that evaluation is a conversation that requires the context of a professional learning community, with input not only from the administration, but furthermore one’s peers.

While a pre and post-conference is included in most current eval systems, the reality is that the focus is on 1) compliance (paperwork), 2) the stakes/consequences attached to that paperwork, and 3) the demands of a very subjective rubric, rather than on the practices and content that will move learning forward for students.

So it should come as no surprise that few teachers are rated poorly by their principals. These systems have become all about summative evaluation, rather than formative feedback, and thus have lost sight of the real purpose of the system in the first place — to improve teacher practice and student learning. Effective principals will use the system to have those conversations — but they won’t rate their teachers poorly on paper unless they are intent on pushing them out the building.

Principals Are Loath to Give Teachers Bad Ratings, Ed Week

Research shows: Elect Democrats to fight segregated schools

Partisan tensions between individualism/choice and systems/regulation in action.

Want to reduce racial segregation? Elect a Democrat to school board, study says, Chalkbeat NY

Andy Rotherham argues against safe spaces

“. . . challenging people to become bigger than themselves is at its core an act of respect and love. Shielding them from challenge, especially in their most formative years, is fundamentally deeply disrespectful to them and their education.”

He’s talking about higher ed. But this also applies–arguably, even more importantly–in K-12.

Challenge Students, Don’t Shield Them,” US News

John King and Arne Duncan plead for sanity in regulations to protect students

“Protecting students and taxpayers shouldn’t be a partisan political issue.”

It shouldn’t. Unfortunately, however–in our country, in these times–it is.

Trump administration is putting profits over students, The Hill

The Problem with Robot Teachers

“I . . . worry that we’re slowly evolving toward a system where the affluent get that kind of education and the poor get automated schooling.”

Are The Robots Coming? Is The K-12 Sector Allergic To Accountability? Cheating In DC, College Access, David Harris Goes TEDx, Claudio Sanchez On ESSA, Jeff Walker On Systems Entrepreneurs, Curbing Eliteness, Cow Horse, More!, Eduwonk

A middle school in the South Bronx harnesses the power of testing & practice

This Bronx school is applying what we know from decades of research: repeated quizzing and practice of key skills and concepts, spaced out over time, transfers learning into long-term memory.

Kudos to MS 343. When you think about just how much of an outlier this approach is, it’s pretty disturbing. Most schools do not have a coherent and systematic approach to what they teach, nor consider how they are reinforcing what is most essential to learn across grades and classrooms.

Why this Bronx middle school believes in second — and third — chances, Chalkbeat NY

Speaking of practice, here’s 10 teaching techniques worth practicing

This is a useful list of a few pedagogical methods worth spending time mastering from UK educator Tom Sherrington, which are based on Deans for Impact’s advice for deliberate practice.

Ten teaching techniques to practise – deliberately.,

NYCDOE is pressing ATRs into schools

Dan Weisberg writes an op-ed in The 74 against the move, claiming that “Principals would go back to hiding vacancies and would justifiably argue that they can’t be held accountable for student learning if they don’t get to pick their teams.”

His claim appears to be justified, as a recent Chalkbeat article reports:

“I’m going to make sure my school doesn’t have a vacancy,” said one Bronx principal who wished to remain anonymous due to the sensitive nature of the topic. “I’m not going to post a vacancy if someone will place an ATR there. I’ll be as strategic as I can and figure out another way.”

I think Weisberg’s suggestion makes much more sense: set a time limit on how long someone can be in the ATR pool.

Weisberg: Paying Teachers Not to Teach Is Absurd — but Reviving NYC’s ‘Dance of the Lemons’ Hurts Kids, The 74

New York City principals balk at plan to place teachers in their schools; some vow to get around it, Chalkbeat NY

Randi Weingarten calls Devos’s brand of choice what it is — but what is her union doing to fight segregation?

I think Weingarten is pointing out an inconvenient truth by calling vouchers a “polite form of segregation,” given their history and the folks that most typically foam at the mouth over them.

But I do wonder what exactly she and her union are doing to fight segregated schools. Public schools are doing plenty on their own to contribute to segregation without any consideration of charters nor vouchers.


My current views on testing, in answer to my past views on testing

While up in Albany a few weeks ago, I was interviewed by someone from NYSED about what I might say to parents who are considering “opting out” their child from state testing. You can view the video here*.

Someone on Twitter, “WiffleCardenal,” voiced a critique to me regarding the video, in contrast to things I’ve said in the past on testing. In fact, they even tweeted quotes of my own words! I deeply appreciate that someone out there is actually listening, and willing to take the time and effort to hold me accountable to them. I have elected to respond here, since Twitter isn’t the greatest venue for nuanced discussion, especially at the end of a long day, and I also hate typing things on my phone.

This is in reference to a live chat I did back in 2012 on The Nation‘s website with journalist Dana Goldstein and educator Tara Brancato. Have my views shifted since then? I would say they have in some ways.

You know, honestly, they’re not as terrible as I thought back then. I proctor these tests each year and go through the experience of answering the questions along with my students. The questions are often cognitively demanding and require multiple reappraisals of the text in question. A few of them are duds, certainly, but having tried to write many of my own text-dependent questions since then, I’ve come to appreciate a well-written multiple choice question. Check out this post from Joe Kirby (UK educator) on the rationale for using multiple choice questions for assessment.

Unfortunately, this continues to hold true. In reaction to this, the Center for American Progress recently created a “testing bill of rights” to advocate for better aligning tests with a more meaningful purpose.

This doesn’t mean, however, that I’m opposed to having test scores factor into my own evaluation or my school’s evaluation. When scores are considered over multiple years, I think they can be an important and useful measure of teacher effectiveness. But they are extremely variable, so I would only want them to be considered alongside other data that can provide adequate context.

One of the things I’ve become more aware of over time is that while our testing and evaluation schemes are extremely problematic, if we look at the big picture, accountability and testing do bring transparency to serving populations of students that were traditionally ignored. No Child Left Behind was certainly faulty and overzealous policy — but it also brought attention to holding school districts accountable to serving students with disabilities and other underserved populations based on data. This was entirely new, and it has raised awareness.

This is why the NAACP, the National Disability Rights Network, and other national civil rights groups oppose anti-testing movements.

Yes, I continue to believe this. Test measures are only one source of data that need to be coupled with qualitative observational data and other forms of understanding. Fortunately, I do feel like our focus, at least in NYC, has shifted to better match this understanding.

To give further context on my statements on the NYSED video, I was speaking about how I use testing data, which I do every week when developing IEPs for my students with disabilities. I compile all information I have on a student, including multiple years of state test data, in-house assessment data, such as reading, writing, and math scores, GPA, attendance, psychoeducational evaluations, social histories, etc. When viewed all together, in tandem with teacher observations and student and parent interviews, I find aggregate state testing data useful!

So it’s important to understand I’m not advocating now and never have advocated for a state test score as a singular reference point to judge myself or a student. But when viewed with appropriate context, I do find state testing data to be useful. (More on how I use that to develop IEPs here.)

No, unfortunately. While I do think that test scores should factor into an account of an individual teacher’s effectiveness (only in aggregate and when considered in terms of growth, not proficiency), we’re creating incentives for competition, rather than collaboration.

If I could set the rules for how we use test scores for accountability, I would do something kind of radical: I would hold all grade-level teachers accountable for student scores on literacy tests. And I’d stop labeling them “ELA” tests and call them “literacy” tests. Why? Because if we are honest about what we’re really testing, we’d acknowledge that the knowledge required to understand complex texts comes not solely from ELA, but furthermore from science, social studies, music, art, and so forth. (More on my argument on this here).

Furthermore, I’d try to better level the playing field for all students by requiring test makers to broadcast one year in advance which texts would be tested (not specific passages, just the general title/author). I would allow parents and educators an opportunity to vote on which texts they wanted tested that year as well to make it more reflective of current interests. The reason I would do this is that this would provide an opportunity for all students to build up the requisite vocabulary and background knowledge to access a text. Right now we just give them random texts, as if every child will be bringing equivalent knowledge and vocabulary to them, which is false.

Yes, unfortunately this continues to hold true in too many schools. But this is also why I have been a consistent supporter of Common Core standards, which have become synonymous with testing in some people’s minds. Yet the Common Core standards provided us an opportunity to move away from test prep, because they are fundamentally about building student knowledge and academic vocabulary through engagement with rich and complex texts — this is the exact opposite of test prep!

This speaks to the problem of making state tests so high stakes, and why we need multiple measures, such as direct observation, to hold schools accountable. It also is the reason for why I would advocate for the seemingly radical measure, as per above, of communicating which texts would be assessed that year so that “test prep” instead would simply be about reading and studying and discussing the rich texts that were selected for that year’s assessment.

Yes, it can be inhumane when a student is several years behind in reading ability or struggles in coping with anxiety and stress.

While computerized testing brings a whole new set of problems, I do believe we should move in this direction, because with computerized testing, we can use adaptive testing that can better scale to meet a student where they are. Otherwise we end up punishing students who are struggling, for whatever reason. Unfortunately, the needs of students with disabilities never seem to be factored into test design except as a final consideration, rather than from the ground up.

But there’s another side to this, too. I think we have to ask ourselves, as a teacher, a school, and a system, how do we prepare all of our students to be able to engage with a challenging text independently? And in what ways are we sequentially building their knowledge and skills and vocabulary in order to prepare them for doing so? It is the failure to do so systematically and adequately that we are failing students who most need those skills and knowledge.

Pearson is out of the picture, in case you didn’t know. I have no idea what Questar tests will be like, though I imagine they will be comparable.

From what I’ve heard, PARCC assessments are far superior to the cheaper assessments NY decided to get from Pearson. I think we get what we pay for, and if we want better test design, we have to be willing to fund them.

Personally, I think if we’re going to just use tests for accountability purposes, then we could make them every 2 or 3 years instead of every year to save money, and they could still continue to be used for that purpose.

What would be awesome is if we could move more towards performance based assessment. There’s a great article on them in the most recent American Educator. This seems like the right direction to go in if we truly interested in assessing the “whole child.”

Well, don’t know if all of this fully says everything I would like to say about testing, but I’m seriously tired after a long week, so this will have to do.

WiffleCardenal, whoever you are, thank you holding me accountable and I welcome continued critical dialogue on these issues.

* This was after a long day of a train ride from NYC and meetings with legislators, so I apologize for my shiny face. Won’t apologize for the winter beard, however. And no, I was not paid for that interview nor given a script. As ever, I speak my own mind (or so I like to think. Certainly let me know if it ever seems like I don’t).

Cuomo Doubles Down on Linear Thinking

“The dunes here are linear, thought to be due to shifting wind directions.”

New York’s Governor, Andrew Cuomo, has decided to double down on a misguided effort to increase the weight of state assessments in a teacher’s evaluation from 20% to 50%.

I’m going to spare you the “corporate reform” and “hedge fund buddies” angle on this; instead, I contend that this single-minded focus on test scores is simply bad strategy.

The focus of this blog has been on teasing out the metaphor of a school as an ecosystem, and elaborating on the theme that managing complex systems requires moving beyond linear thinking.

Here’s a relevant quote from Steve Denning (which we’ve examined before) on the principle of obliquity:

Efforts to impose linear thinking on complex situations have often led have the opposite of what was intended. As a result, the principle of obliquity becomes relevant. Where explicit articulation of a goal will result in the complex environment pushing back in the opposite direction, oblique goals will often be more effective, e.g. the goal of delighting customers may make more money than an explicit goal of making money.

What would be the opposite of what was intended in this situation (if Cuomo gets his way)? Well, if every teacher in the state is conscious that their evaluation is heavily determined by their student’s performance on that state test — then the problems of focusing mostly on ELA and math and shallow skills-driven test-prep will most likely be exacerbated. And kids that most need access to rich literature and knowledge across the domains of history, music, arts, science, and technology will instead continue to be given drivel. And teachers and schools may be more likely to engage in cheating.

I generally assume best intent when assessing the decisions of others. So to be fair to Cuomo, he is pushing for a simplified accountability system because the current system of 20% state, 20% local, and 60% principal observation may lead to the problems of over-testing and inflated scores.

But moving to increase the weight of the state test scores as a leverage over teachers is not the right move to resolve these issues. Instead, this maneuver is much more likely to compound deeper issues, rather than achieve the goal of increasing student and teacher performance.

It would be great if our elected representatives could move beyond linear models when making critical decisions on how to improve our system of education.

On Slavery and School Management

Mark and I began blogging about schools and ecosystems because we were frustrated with the business model of school reform. As we wrote in our original schools and ecosystems manifesto, “applying an industrial-growth model” to school design doesn’t work– at least not for students and teachers. We proposed that viewing schools as ecosystems might help us design more humane and effective educational reforms than those currently on offer.

Sadly, it doesn’t seem like that’s the direction education reform will take in New York State anytime soon. In case you hadn’t heard, New York Governor Andrew Cuomo wants to subject public school teachers to be a new evaluation scale wherein student standardized test scores will be the core measure of a teacher’s quality. Cuomo also wants a merit pay system wherein teacher pay would be linked to student test scores.

Merit pay and value-added assessment: these are common proposals from advocates of the business model. Their merits have been roundly debated elsewhere, so our readers likely already have a position on each of these management tools. What you might not know, however, is that both of these common management techniques have their roots in American chattel slavery.

Caitlin C. Rosenthal, a fellow at that hotbed of radicalism known as Harvard Business School, has been researching the connections between modern management and the techniques that slaveowners used to track and improve their slaves’ productivity. Rosenthal has found that having a captive workforce allowed slaveowners to experiment with a wide variety of management techniques. Among these, merit pay:

“This led owners to experiment with ways of increasing the pace of labor, Rosenthal explains, such as holding contests with small cash prizes for those who picked the most cotton, and then requiring the winners to pick that much cotton from there on out. Slave narratives describe how others used the data to calculate punishment, meting out whippings according to how many pounds each picker fell short.

Similar incentive plans reappeared in early twentieth-century factories, with managers dangling the promise of cash rewards if their workers reached certain production levels.”

Slaveowners also pioneered the art of measuring employee value as a function of productivity:

“Starting in the late 1840s, [slave-managing innovator] Thomas Affleck’s account books instructed planters to record depreciation or appreciation of slaves on their annual balance sheet. In 1861, for example, another Mississippi planter priced his 48-year-old foreman, Hercules, at $500; recorded the worth of Middleton, a 26-year-old top-producing field hand, at $1,500; and gave 9-month-old George Washington a value of $150. At the end of the year, he repeated this process, adjusting for changes in health and market prices, and the difference in price was recorded on the final balance sheet.

These account books played a role in reducing slaves to ‘human capital,’ Rosenthal says, allowing owners who were removed from day-to-day operations to see their slaves as assets, as interchangeable units of production in a ledger, instead of as people.”

Much of this is hardly surprising. After all:

“The evolution of modern management is usually associated with good old-fashioned intelligence and ingenuity—’a glorious parade of inventions that goes from textile looms to the computer,’ Rosenthal says. But in reality, it’s much messier than that. Capitalism is not just about the free market; it was also built on the backs of slaves who were literally the opposite of free.

Perhaps I’m being generous, but I’d like to assume that when Cuomo and other business-minded reformers propose using merit pay and value-added assessment of employees, they’re unaware that they’re proposing slaveowner management techniques. Now that this troubling history is out there, let’s hope they’ll reconsider before advocating tools used to build and maintain one of America’s most brutal and repugnant institutions.

Live Chat on Standardized Testing and Ed Reform

Today, May 17th at 5 PM, I invite you to join me on a live chat on standardized testing hosted by The Nation. Reporter Dana Goldstein, an Educators 4 Excellence member, Tara Brancato, and an International Baccalaureate teacher from a high school in the Bronx will be on the panel. This should be an interesting conversation.

As our readers know, Will and I are skeptical of the value of the value-added approach to education reform, and we are critical of the effect of standardized testing on schools.

I look forward to learning from other perspectives on these issues and advocating for a renewed focus on positive, supportive contexts and rich, sequential content in schools.

See you online!