Although an impact evaluation can assess the extent to which an intervention resulted in changes in key outcomes, an implementation study provides us with the understanding of what was actually implemented and how; why the intervention changed outcomes or did not; and, if it did, how it might have done so. Implementation studies can provide important documentation of how a program was implemented for subsequent refinement and program scale-up, if successful.
Mathematica conducted a retrospective implementation study of the Total Sanitation and Sanitation Marketing (TSSM) intervention in Indonesia. TSSM was designed to strengthen the supply of and demand for sanitation and improve the enabling environment for sanitation interventions. Although an impact evaluation had been commissioned, our study sought to understand how the TSSM program was implemented in East Java, Indonesia, and reconciled some apparent discrepancies between program monitoring data and impact evaluation data involving program progress. The study used a mixed-methods approach that drew on both qualitative and quantitative data, including data gathered from a large cross-section of stakeholders at the national, provincial, district, subdistrict, village, and hamlet (subvillage) levels. The findings from the study provided important insights on reasons for program success in some places and not in others and will help to inform the impact analysis.
EVIDENCE & INSIGHTS
Emerging Findings from the 2012-2017 National Cross-Site Evaluation of the Regional Partnership Grant (RPG) Program (Summary)
This summary presents emerging findings from the national cross-site evaluation for the Regional Partnership Grant program. The program supports partnerships between providers of child welfare and social services to improve the well-being of children impacted by substance abuse.Learn more
Progress is best made together.
We believe in close partnership - whether you're a small non-profit or a federal government agency, we stick with you to help you see clearly and act quickly.