Do Test Scores Misrepresent Test Results? An Item-by-Item Analysis / Jesse Bruhn, Michael Gilraine, Jens Ludwig, Sendhil Mullainathan.

Format:

Book

Author/Creator:

Bruhn, Jesse.

Contributor:

Gilraine, Michael.

Ludwig, Jens.

Mullainathan, Sendhil.

National Bureau of Economic Research.

Series:

Working Paper Series (National Bureau of Economic Research) no. w34484.

NBER working paper series no. w34484

Language:

English

Physical Description:

1 online resource: illustrations (black and white);

Place of Publication:

Cambridge, Mass. National Bureau of Economic Research 2025.

Summary:

Much of the data collected in education is effectively thrown away. Students answer individual test questions, but administrators and researchers only see aggregate performance. All the item-level data are lost. Ex ante it is not clear this destroys much useful information, since the aggregate might be a sufficient statistic. Using data from Texas for 5 million students and 1.31 billion student-item responses, we show that in fact aggregation does destroy a great deal of valuable information in education: (1) Even conditional on a summary test measure, there is additional information in the item-level data; (2) This additional information is relevant for the student outcomes that education decisions seek to optimize; and (3) This information can be made practically useful for schools. Given how inexpensive storing, transmitting and analyzing such data would be, large gains could be had in education by simply using all the data we currently collect.

Notes:

November 2025.

Print version record