A paper by Brian Jacob and Jesse Rothstein (U-C Berkeley), "The Measurement of Student Ability in Modern Assessment Systems," was published in the Summer 2016 edition of the American Economic Association's Journal of Economic Perspectives. The piece originally appeared as an NBER working paper.
Abstract:
Economists often use test scores to measure a student’s performance or an adult’s human capital. These scores reflect nontrivial decisions about how to measure and scale student achievement, with important implications for secondary analyses. For example, the scores computed in several major testing regimes, including the National Assessment of Educational Progress (NAEP), depend not only on the examinees’ responses to test items, but also on their background characteristics, including race and gender. As a consequence, if a black and white student respond identically to questions on the NAEP assessment, the reported ability for the black student will be lower than for the white student—reflecting the lower average performance of black students. This can bias many secondary analyses. Other assessments use different measurement models. This paper aims to familiarize applied economists with the construction and properties of common cognitive score measures and the implications for research using these measures.