Technical Methods Report: Statistical Power for Regression Discontinuity Designs in Education Evaluations

Technical Methods Report: Statistical Power for Regression Discontinuity Designs in Education Evaluations

Published: Aug 30, 2008
Publisher: Washington, DC: U.S. Department of Education, Institute of Education Sciences

Authors

Peter Z. Schochet

This paper examines theoretical and empirical issues related to the statistical power of impact estimates under clustered regression discontinuity (RD) designs. The theory is grounded in the causal inference and HLM modeling literature, and the empirical work focuses on commonly used designs in education research to test intervention effects on student test scores. The main conclusion is that three to four times larger samples are typically required under RD than experimental clustered designs to produce impacts with the same level of statistical precision. The viability of using RD designs for new impact evaluations of educational interventions may be limited and will depend on the point of treatment assignment, the availability of pretests, and key research questions.

Efficiency Meets Impact.
That's Progress Together.

To solve their most pressing challenges, organizations turn to Mathematica for deeply integrated expertise. We bring together subject matter and policy experts, data scientists, methodologists, and technologists who work across topics and sectors to help our partners design, improve, and scale evidence-based solutions.

Work With Us