The Examined Life of the Exam: What High-Stakes Testing Really Measures
Few institutions are as entrenched in modern life as the high-stakes examination, and yet few attract such sustained, impassioned critique. From the gaokao to the SAT, from professional bar exams to civil-service entrance tests, billions of lives pivot on performances delivered under fluorescent lighting within tightly monitored rooms. The question that continues to unsettle educators, psychologists, and policymakers alike is deceptively simple: what, precisely, are we measuring when we measure someone by an exam?
The orthodox defence of standardised testing rests on its apparent objectivity. A numerical score, the argument goes, cuts through the noise of teacher subjectivity, socioeconomic signalling, and institutional reputation, reducing candidates to a common, legible metric. There is something seductive about this view. Meritocracy, after all, depends on the fantasy of a level playing field, and the exam functions as its most visible ritual. Yet the seduction frays almost immediately under scrutiny. Decades of research in cognitive psychology have demonstrated that test performance correlates strongly with prior exposure to test-taking strategies, access to preparatory resources, and the kinds of cultural knowledge that are distributed anything but evenly across society. The exam does not so much strip away privilege as launder it.
Equally troubling is the question of construct validity — whether an examination actually measures the thing it claims to measure. A timed, written test of legal reasoning will capture certain analytical capacities with reasonable fidelity; it will capture rather little about a candidate's ability to counsel a distressed client, navigate a courtroom's social dynamics, or sustain ethical judgement under sustained professional pressure. The gap between what examinations measure and what vocations demand is not a minor technical imprecision. In many fields, it is the central problem. When curricula are reverse-engineered to maximise test scores, the very competencies that exams were meant to proxy tend to atrophy — a phenomenon so well-documented that it has its own name: Goodhart's Law, adapted from economics, which holds that when a measure becomes a target, it ceases to be a good measure.
