No Impacts?: How to Enhance What You Learn from Your Evaluation

No Impacts?: How to Enhance What You Learn from Your Evaluation

OPRE Report #2022-149
Published: Nov 30, 2022
Publisher: Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services

Download

Clients

OPRE Logo

Authors

Emily Forrester

This brief provides suggestions for grantees and evaluators who have completed an impact evaluation but did not find favorable, statistically significant impacts of their program. It provides suggestions for exploratory analyses that could help you understand why you didn’t find impacts and how to acknowledge the results of those exploratory analyses in any reporting. The brief also provides suggestions for disseminating your findings and additional supplemental analyses that help you learn as much as you can from the data you’ve collected. The brief is directed primarily toward evaluators of adolescent pregnancy prevention programs, but the concepts presented should be applicable to a variety of social programs.

Efficiency Meets Impact.
That's Progress Together.

To solve their most pressing challenges, organizations turn to Mathematica for deeply integrated expertise. We bring together subject matter and policy experts, data scientists, methodologists, and technologists who work across topics and sectors to help our partners design, improve, and scale evidence-based solutions.

Work With Us