Estimating Program Impacts for a Subgroup Defined by Post-Intervention Behavior: Why is it a Problem? What is the Solution?
Download
Associated Project
Teen Pregnancy Prevention: Ensuring Rigorous Program Evaluations
Prepared for:
U.S. Department of Health and Human Services, Administration for Children and Families, Family & Youth Services Bureau
This brief demonstrates why estimating program effectiveness for an endogenous subgroup leads to compositional differences between the treatment and control groups that may result in biased impact estimates. Specifically, it shows the source of bias in the estimated impact of a teenage pregnancy prevention program on the likelihood that youth use contraception, among a subgroup of youth who are sexually active post–random assignment. It also provides guidance for meeting similar research objectives by constructing outcomes so that they yield unbiased estimates of program impacts.
Efficiency Meets Impact.
That's Progress Together.
To solve their most pressing challenges, organizations turn to Mathematica for deeply integrated expertise. We bring together subject matter and policy experts, data scientists, methodologists, and technologists who work across topics and sectors to help our partners design, improve, and scale evidence-based solutions.
Work With Us