Although an impact evaluation can assess the extent to which an intervention resulted in changes in key outcomes, an implementation study provides us with the understanding of what was actually implemented and how; why the intervention changed outcomes or did not; and, if it did, how it might have done so. Implementation studies can provide important documentation of how a program was implemented for subsequent refinement and program scale-up, if successful.
Mathematica conducted a retrospective implementation study of the Total Sanitation and Sanitation Marketing (TSSM) intervention in Indonesia. TSSM was designed to strengthen the supply of and demand for sanitation and improve the enabling environment for sanitation interventions. Although an impact evaluation had been commissioned, our study sought to understand how the TSSM program was implemented in East Java, Indonesia, and reconciled some apparent discrepancies between program monitoring data and impact evaluation data involving program progress. The study used a mixed-methods approach that drew on both qualitative and quantitative data, including data gathered from a large cross-section of stakeholders at the national, provincial, district, subdistrict, village, and hamlet (subvillage) levels. The findings from the study provided important insights on reasons for program success in some places and not in others and will help to inform the impact analysis.
EVIDENCE & INSIGHTS
Keeping Youth Out of the Deep End of the Juvenile Justice System
This report provides an overview of the Annie E. Casey Foundation’s deep-end reform and the findings from the evaluation. It offers a high-level view of the Foundation’s activities related to the reform, the activities sites developed and implemented, and the successes and challenges that the Foundation and sites encountered.Learn more
Progress is best made together.
We believe in close partnership - whether you're a small non-profit or a federal government agency, we stick with you to help you see clearly and act quickly.