Shrinkage of Value-Added Estimates and Characteristics of Students with Hard-to-Predict Achievement Levels (Journal Article)

Shrinkage of Value-Added Estimates and Characteristics of Students with Hard-to-Predict Achievement Levels (Journal Article)

Published: May 04, 2016
Publisher: Statistics and Public Policy, vol. 3, issue 1 (subscription required)

Download

Associated Project

Value-Added Assessment System for DC Schools and Teachers

Time frame: 2009-2015

Prepared for:

District of Columbia Public Schools

Authors

It is common in the implementation of teacher accountability systems to use empirical Bayes shrinkage to adjust teacher value-added estimates by their level of precision. Because value-added estimates based on fewer students and students with “hard-to-predict” achievement will be less precise, the procedure could have differential impacts on the probability that the teachers of fewer students or students with hard-to-predict achievement will be assigned consequences. This article investigates how shrinkage affects the value-added estimates of teachers of hard-to-predict students. We found that teachers of students with low prior achievement and who receive free lunch tend to have less precise value-added estimates. However, in our sample, shrinkage had no statistically significant effect on the relative probability that teachers of hard-to-predict students received consequences.

Efficiency Meets Impact.
That's Progress Together.

To solve their most pressing challenges, organizations turn to Mathematica for deeply integrated expertise. We bring together subject matter and policy experts, data scientists, methodologists, and technologists who work across topics and sectors to help our partners design, improve, and scale evidence-based solutions.

Work With Us