Estimating Program Impacts for a Subgroup Defined by Post-Intervention Behavior: Why is it a Problem? What is the Solution?

Estimating Program Impacts for a Subgroup Defined by Post-Intervention Behavior: Why is it a Problem? What is the Solution?

Evaluation Technical Assistance Brief #2
Published: Dec 30, 2012
Publisher: Washington, DC: U.S. Health and Human Services, Office of Adolescent Health

Download

Associated Project

Teen Pregnancy Prevention: Ensuring Rigorous Program Evaluations

Time frame: 2013-2018

Prepared for:

U.S. Department of Health and Human Services, Administration for Children and Families, Family & Youth Services Bureau

Authors

Silvie Colman

This brief demonstrates why estimating program effectiveness for an endogenous subgroup leads to compositional differences between the treatment and control groups that may result in biased impact estimates. Specifically, it shows the source of bias in the estimated impact of a teenage pregnancy prevention program on the likelihood that youth use contraception, among a subgroup of youth who are sexually active post–random assignment. It also provides guidance for meeting similar research objectives by constructing outcomes so that they yield unbiased estimates of program impacts.

Efficiency Meets Impact.
That's Progress Together.

To solve their most pressing challenges, organizations turn to Mathematica for deeply integrated expertise. We bring together subject matter and policy experts, data scientists, methodologists, and technologists who work across topics and sectors to help our partners design, improve, and scale evidence-based solutions.

Work With Us