Research and Evaluation Services

Process and Implementation Evaluations

Process evaluations or implementation studies are often an important complement to our impact evaluations.

Although an impact evaluation can assess the extent to which an intervention resulted in changes in key outcomes, an implementation study provides us with the understanding of what was actually implemented and how; why the intervention changed outcomes or did not; and, if it did, how it might have done so. Implementation studies can provide important documentation of how a program was implemented for subsequent refinement and program scale-up, if successful.

Mathematica conducted a retrospective implementation study of the Total Sanitation and Sanitation Marketing (TSSM) intervention in Indonesia. TSSM was designed to strengthen the supply of and demand for sanitation and improve the enabling environment for sanitation interventions. Although an impact evaluation had been commissioned, our study sought to understand how the TSSM program was implemented in East Java, Indonesia, and reconciled some apparent discrepancies between program monitoring data and impact evaluation data involving program progress. The study used a mixed-methods approach that drew on both qualitative and quantitative data, including data gathered from a large cross-section of stakeholders at the national, provincial, district, subdistrict, village, and hamlet (subvillage) levels. The findings from the study provided important insights on reasons for program success in some places and not in others and will help to inform the impact analysis.

Services & Products

Progress is best made together.

We believe in close partnership - whether you're a small non-profit or a federal government agency, we stick with you to help you see clearly and act quickly.

Research and Evaluation

Research and Evaluation

Learn more
Learn more about Research and Evaluation
Program Design and Improvement

Program Design and Improvement

Learn more
Learn more about Program Design and Improvement
Data Analytics

Data Analytics

Learn more
Learn more about Data Analytics
COVID-19 Scalable Services

COVID-19 Scalable Services

Learn more
Learn more about COVID-19 Scalable Services