Ignored Problems with Standardized Tests

Marion Brady is one of the most insightful and intelligent commentators I know on the educational landscape, and one reason he is long-time columnist for the Knight-Ridder Tribune. One of my favorite quotes (and I have a lot of them from Marion!) is this one from last October in the Washington Post:

“Common sense says that getting schooling right begins with getting the curriculum right, but that fact doesn’t seem to have occurred to the business leaders and politicians—educational amateurs all—now pulling the education policy strings. Instead of funding a rethinking of the blueprint, the map, the pattern, the model, they’ve spent billions locking a deeply flawed curriculum in rigid, permanent place with the Common Core State Standards.”

[Washington Post October 17, 2014. Valerie Strauss.]

One reason I wanted to feature this newest piece by Marion is because it is the first time I have seen such a list (33 items) detailing the unaddressed issues with standardized testing. The runaway train of awarding more and more weight and prestige to such a flawed system can spell nothing but eventual catastrophe. There are already casualties: Many teachers – good teachers – are leaving the field because they no longer can teach creatively. That has been replaced with teaching to, and prepping students for, fairly meaningless AND unreliable tests. Further, test results have achieved the rank of “The Hatchet” in decision-making about students, teachers, administrators, schools, and, yes, even states.

Yes, boiling all of anything down to a single test score IS convenient…no debate. Just because something is convenient does not make it worthwhile. Read Marion’s monograph and see more explicitly for yourselves. If you are an advocate for opting out this article will add a lot to your knowledge base of supporting information.

Anthony Dallmann-Jones, PhD, Editor


Constricting High Stakes Testing

Constricting High Stakes Testing


Standardized Tests: Ignored Problems

by Marion Brady

As my students were taking their seats, Myrna, sitting near my desk, said she’d just read a magazine article about secret societies in high school. What, she asked, did I know about them?

I knew nothing—had never even heard of them—but the matter was interesting enough to quickly engage my 11th Grade English class, so I let the conversation continue. Someone suggested making it a research project and I told them to have at it.

The school library wasn’t much help, but somebody figured out how to contact the student editor of the school newspaper in a town mentioned in the article and wrote her a letter. She answered, other contacts were made, and kid-to-kid communication began. How did the societies get started? Who joined them? Why? How? Did they create problems? If so, what kind? Were the societies more than just temporary cliques? How were teachers and administrators reacting?

Answers generated more questions. My students thought, wrote, took sides, argued, learned. I mostly watched.

That happened in a class in a semi-rural high school in northeastern Ohio. The participants—those still alive—are now almost eighty years old. I’d be willing to bet that if any of them remember anything at all about the class, that research project would be it.

I wasn’t smart enough to realize it at the time, but I was seeing a demonstration of something extremely important, that real learning is natural and inherently satisfying. Myrna’s question kicked off genuine learning—self-propelled and successful not because the work was rigorous and the kids had grit, but because it was driven by curiosity, because satisfaction was immediate, because it was real-world rather than theoretical, because it was concrete rather than abstract, because it required initiative and action, and because it was genuinely important, dealing as it did with complex social and psychological issues shaping human behavior.

Even if it leads to dead ends, research—at least for the learner pursuing it—is intellectually productive. It’s also, obviously, non-standard. The skills it develops and the insights it yields aren’t predictable, even to those engaged in it. That’s one of the reasons standardized tests assembled in the office cubicles of Pearson, McGraw-Hill and other test manufacturers can’t do the job that most needs doing. They can’t measure and attach a meaningful number to the quality of original thought.

Arthur Costa, Emeritus Professor, California State University, summed up the thrust of current test-based “reform’ madness: “What was educationally significant and hard to measure has been replaced by what is educationally insignificant and easy to measure. So now we measure how well we taught what isn’t worth learning.”

The truth of that isn’t acknowledged by Jeb Bush, Bill Gates, Lou Gerstner, Arne Duncan and the other business leaders and politicians responsible for initiating and perpetuating the standardized, high-stakes testing craziness. They either can’t see or won’t admit the shallowness of their claim that “if you can’t measure it, you can’t manage it.” Challenged, they dismiss those who disagree with them as defenders of the status quo.

Using the scores on standardized tests to shape the life chances of kids, determine the pay and reputations of teachers, gauge the quality of school administrators, establish the worth of neighborhood schools, or as an excuse to hand public schools over to private, profit-taking corporations is, at the very least, irresponsible. If, as it appears, it’s a sneaky scheme to privatize America’s public schools without broad public dialogue, it’s unethical.

Figuring out how to measure original thought isn’t the only challenge test manufacturers need to address. Their tests:

– Provide minimal to no useful feedback to classroom teachers
– Are keyed to a deeply flawed curriculum adopted in 1893
– Lead to neglect of physical conditioning, music, art, and other, non-verbal ways of learning
– Unfairly advantage those who can afford test prep
– Hide problems created by margin-of-error computations in scoring
– Penalize test-takers who think in non-standard ways (which the young frequently do)
– Radically limit teacher ability to adapt to learner differences
– Give control of the curriculum to test manufacturers
– Encourage use of threats, bribes, and other extrinsic motivators
– Use arbitrary, subjectively-set pass-fail cut scores
– Produce scores which can be (and sometimes are) manipulated for political purposes
– Assume that what the young will need to know in the future is already known
– Emphasize minimum achievement to the neglect of maximum performance
– Create unreasonable pressures to cheat
– Reduce teacher creativity and the appeal of teaching as a profession
– Are unavoidably biased by social-class, ethnic, regional, and other cultural differences
– Lessen concern for and use of continuous evaluation
– Have no “success in life” predictive power
– Unfairly channel instructional resources to learners at or near the pass-fail “cut score”
– Are open to massive scoring errors with life-changing consequences
– Are at odds with deep-seated American values about individuality and worth
– Create unnecessary stress and negative attitudes toward learning
– Perpetuate the artificial compartmentalization of knowledge by field
– Channel increasing amounts of tax money into corporate coffers instead of classrooms
– Waste the vast, creative potential of human variability
– Block instructional innovations that can’t be evaluated by machine
– Unduly reward mere ability to retrieve secondhand information from memory
– Subtract from available instructional time
– Lend themselves to “gaming”—use of strategies to improve the success-rate of guessing
– Make time—a parameter largely unrelated to ability—a factor in scoring
– Create test fatigue, aversion, and an eventual refusal to take tests seriously
– Undermine the fact that those closest to the work are best-positioned to evaluate it
– Doesn’t work. The National Academy of Sciences, 2011 report to Congress: The use of standardized tests “has not increased student achievement.”

Most people—including many educators—don’t object to standardized tests, just think there are too many, or the stakes shouldn’t be so high, or that some items aren’t grade-level appropriate, etc.

I disagree. I think standardized tests are not just a monumental waste of money and time, but are destroying the institution and the profession in a myriad of unsuspected ways. Responsibility for evaluating learner performance—all of it—should be returned to those best positioned to do it: Classroom teachers. Period.


Marion Brady is a retired teacher and school administrator. He is a college professor, textbook and professional book author, and consultant to publishers and foundations, and a long-time newspaper columnist for Knight-Ridder/Tribune.

[Purchase your copy of the new book everyone is talking about, Fixing Public Education, on our Products page. Reduced price will not last much longer!]

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>