Selection of Out-of-State Comparison Groups and the Synthetic Control Method
Download
Associated Project
Supporting CMS Oversight of Medicaid 1115 Demonstrations
Prepared for:
U.S. Department of Health and Human Services, Centers for Medicare & Medicaid Services, Center for Medicaid and CHIP Services
Evaluators can use out-of-state comparison groups when no in-state comparison group is available or to corroborate findings from other evaluation strategies. This white paper provides practical suggestions for selecting or constructing out-of-state comparison groups to support the use of this strategy. When choosing out-of-state comparison groups, states and their evaluators should select other states with observed characteristics and pre-intervention trends in the outcomes of interest that are similar to those of the demonstration state. This paper describes several types of characteristics to consider. If an out-of-state comparison group is difficult to find because no other states are similar to the demonstration state, the synthetic control method can help with constructing a comparison group. This method has been used in published research on several Medicaid-related outcomes.
Efficiency Meets Impact.
That's Progress Together.
To solve their most pressing challenges, organizations turn to Mathematica for deeply integrated expertise. We bring together subject matter and policy experts, data scientists, methodologists, and technologists who work across topics and sectors to help our partners design, improve, and scale evidence-based solutions.
Work With Us