When Do Regression-Adjusted Performance Measures Track Longer-Term Program Impacts? A Case Study for Job Corps

When Do Regression-Adjusted Performance Measures Track Longer-Term Program Impacts? A Case Study for Job Corps

Published: Mar 30, 2014
Publisher: Journal of Policy Analysis and Management, vol. 33, issue 2
Download
Authors

Peter Z. Schochet

Key Findings
Although regression adjustment changes Job Corps center performance measures, the adjusted performance measures are not correlated with impact estimates.
Performance management systems may improve service delivery and participant outcomes, but they do not necessarily provide information on a program's causal effects. This article develops a statistical model that describes the conditions under which regression adjustment improves the performance–impact correlation. Using extensive data from a rigorous evaluation of Job Corps, the study team found that, while regression adjustment changes Job Corps center performance measures, the adjusted performance measures are not correlated with impact estimates.

How do you apply evidence?

Take our quick four-question survey to help us curate evidence and insights that serve you.

Take our survey