Best Practices in Causal Inference for Evaluations of Section 1115 Eligibility and Coverage Demonstrations

Best Practices in Causal Inference for Evaluations of Section 1115 Eligibility and Coverage Demonstrations

White Paper
Published: Jun 30, 2018
Publisher: Washington, DC: Mathematica Policy Research

Associated Project

New Approaches for Medicaid: The 1115 Demonstration Evaluation

Time frame: 2014-2020

Prepared for:

U.S. Department of Health and Human Services, Centers for Medicare & Medicaid Services, Center for Medicaid and CHIP Services

Authors

Kara Contreary

Katharine Bradley

This guide, which uses examples from recent reforms for adult Medicaid beneficiaries, is intended to support demonstration states by describing best practices in causal inference. In this context, “causal inference” is the process of determining whether a demonstration policy (also called the treatment) is responsible for an observed outcome. Establishing an association between treatment and outcome variables is relatively straightforward, requiring only that they move reliably in the same or opposite directions. Establishing causation—that is, confidence that a change in treatment caused observed changes in outcomes—is much more difficult. Yet a primary goal of demonstration evaluations is to determine whether particular state Medicaid policies cause changes in outcomes such as health care access, utilization, and costs, and—in the case of some eligibility and coverage policies—the uptake of commercial coverage.

Efficiency Meets Impact.
That's Progress Together.

To solve their most pressing challenges, organizations turn to Mathematica for deeply integrated expertise. We bring together subject matter and policy experts, data scientists, methodologists, and technologists who work across topics and sectors to help our partners design, improve, and scale evidence-based solutions.

Work With Us