Conducting Rapid Cycle Learning with Healthy Marriage and Relationship Education Programs for Youth

Conducting Rapid Cycle Learning with Healthy Marriage and Relationship Education Programs for Youth

Findings from the Strengthening the Implementation of Marriage and Relationship Programs (SIMR) Project, OPRE Report #2023-034
Published: Feb 28, 2023
Publisher: Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services
Download
Associated Project

Strengthening the Implementation of Marriage and Relationship Programs

Time frame: 2019-2022

Prepared for:

U.S. Department of Health and Human Services, Administration for Children and Families, Office of Planning, Research, and Evaluation

Clients
OPRE Logo
Authors

Caroline O’Callahan

Hannah McInerney

Katie Hunter

Annie Buonaspina

Key Findings

In SIMR, each grant recipient developed and tested improvement strategies tailored to their specific needs, service populations, and individual contexts, using an approach to program improvement and rapid cycle learning known as Learn, Innovate, Improve (LI2). Through their work with the SIMR team, grant recipients:

  • Addressed pressing implementation challenges: One grant recipient focused on improving recruitment and four focused on topics related to improving content engagement
  • Increased their capacity to collect and use data to inform decision-making: Through rapid cycle learning, grant recipient staff administered feedback surveys to participants, tracked recruitment data, and analyzed social media analytics. They reviewed these data with the SIMR team and developed insights to refine their improvement strategies.
  • Developed skills for identifying and responding to emerging implementation challenges: At the end of each learning cycle, the SIMR team met with grant recipients to review and interpret data and determine next steps. When new challenges emerged, grant recipients were able to pivot to address them in later learning cycles.
  • Strengthened capacity and developed tools and strategies to support strong implementation through the rest of the grant period: Grant recipients developed promising tools and strategies to support facilitators, enhance case management, recruit youth from rural areas, and encourage participant relationships. At the end of SIMR, the grant recipients planned to continue using these tools and strategies.

In the SIMR project, Mathematica and its partner, Public Strategies, collaborated with 10 HMRE grant recipients—five youth-serving grant recipients and five adult-serving grant recipients—to conduct iterative rapid cycle testing aimed at strengthening their services. SIMR focused on common implementation challenges related to recruitment, retention, and content engagement. SIMR had two main goals:

  1. to improve the service delivery of these grant recipients
  2. to develop lessons for the broader HMRE field about promising practices for addressing common implementation challenges.

This report describes the rapid cycle learning process and findings for the five youth-serving HMRE grant recipients that participated in SIMR. It shares how each grant recipient addressed implementation challenges and improved services through participation in SIMR and insights that can help other HMRE grant recipients strengthen their own service delivery.

How do you apply evidence?

Take our quick four-question survey to help us curate evidence and insights that serve you.

Take our survey