Projects

Evaluating the Development of Middle Years Math Teaching and Learning Solutions

2018 - 2022

Project Overview

Objective

Mathematica partners with Middle Years Math grantees on the development and execution of customized measurement and evaluation (M&E) plans. Through the technical assistance that Mathematica provides, grantees learn more about the impact of their programs and build capacity to conduct M&E activities on their own. Continuous improvement and equity and community voice frameworks inform all stages of this work.

Project Motivation

As part of the Bill & Melinda Gates Foundation’s K-12 Education portfolio, this project seeks to dramatically improve middle years math instruction, so that all students who are Black, Latino, and/or experiencing poverty deeply know, are able to use, and enjoy math by the time they reach high school. 

Partners in Progress

Grantees of the Bill & Melinda Gates Foundation: Air Tutors, ASSISTments, Blueprint Schools Network, Breakthrough Collaborative, Bridge to Enter Advanced Mathematics (BEAM), Cignition, Common Denominator, Crossroads, Imagine Learning, Latino Student Fund, Math Corps, New Classrooms, Saga Education, Silicon Valley Education Foundation, Teaching Systems Lab (Massachusetts Institute of Technology), Teachley, The Calculus Project, Upchieve, Texas Mindset Initiative (TxMI; University of Texas at Austin), youcubed (Stanford University)

Prepared For

Bill & Melinda Gates Foundation

Mathematica is working in close partnership with the Bill & Melinda Gates Foundation and its grantees to systematically collect and synthesize evidence on solutions for math teaching and learning in grades 3 through 9. The evidence is being used to (1) inform grantees’ program development and improvement, and (2) generate evidence about the effectiveness of middle years math solutions in the portfolio.

New Measurement and Evaluation Toolkit

As the evaluation technical assistance partner for two portfolios of investments in Middle Years Math and Secondary Writing—funded by the Bill & Melinda Gates Foundation—Mathematica developed a set of tools to support grantees through a measurement and evaluation (M&E) process. The goal of these portfolios is to develop, refine, and scale evidence-based solutions (programs, products, or practices) that demonstrate success in improving educational outcomes for students who are Black, Latino, and/or experiencing poverty (the priority communities for the grants).

To expand the reach of this work and promote the adoption of evidence-based solutions more broadly, Mathematica has adapted the suite of M&E tools for a broader set of users—organizations implementing solutions, funders, research partners, and other stakeholders. The tools are designed to help users implement the M&E process in their own work. Organizations or individuals may choose to use one tool or the full set and can adapt the tools to their needs.

The full toolkit will be released in Fall 2021. The first few tools are available here:

Measurement & Evaluation Checklist Phase 1 Measurement & Evaluation Checklist Phase 2 Measurement & Evaluation Checklist Phase 3 Measurement & Evaluation Checklist Phase 4 Measurement & Evaluation Plan Template Reporting Template Virtual Trainings (88.2mb)

For best experience view PDF tools in Adobe Acrobat

Acknowledgements: Many individuals contributed to the development of this Measurement and Evaluation (M&E) Toolkit. In particular, we appreciate our grantee partners and the communities they serve for their rich engagement with and collaborative approach to the M&E process. At the Gates Foundation, we thank the Middle Years Math investment team—especially Karen Johnson, Lewis Leiboh, Andrew Corcoran, Andrew Sokatch, Taina Knox, and Sara Allan—for their support, guidance, and encouragement. At Mathematica, we recognize Middle Years Math technical assistance liaisons for piloting the tools, providing feedback, and contributing to revisions; Alexandra Resch, Ruth Curran Neild, John Deke, and Elias Walsh for their guidance and quality assurance review; Sheena Flowers, for her creative design ideas and superior production assistance; Brittany Tabora, for coordination with external expert reviewers; Liah Caravalho and Kara Conroy, for leading our dissemination strategy; Jennifer Brown, for editorial support; and Theodora Vorias, for assisting with the development of the glossary. Ryan Ruggiero, Mikia Manley, Virginia Knechtel, Kate Place, Megan Shoji, Gregory Chojnacki, Mayra Sandoval, Brigitte Tran, Camila Fernandez, Claire Smither Wulsin, Lisbeth Goble, Menbere Shiferaw, Erin Dillon, Whitney Ajibola, Tiberio Garza, Lauren Amos, Steven Malick, and Cleo Jacobs Johnson authored the tools and videos. Finally, we thank the following 12 external experts who offered invaluable feedback on the structure and content of the M&E Checklist and supplemental tools: Dr. Kristine Andrews, Ideas to Impact, Inc.; Dr. Emily Barton, University of Virginia & the EdTech Evidence Exchange; Dr. Beth Boulay, Abt Associates; Cathryn Cook, Saga Education; Dr. Fiona Hollands, Teachers College, Columbia University; Dr. Stafford Hood, Center for Culturally Responsive Evaluation and Assessment/University of Illinois at Urbana-Champaign; Karina Jaquet, WestEd; Dr. Heather King, Impact Genome Project; Chris Liang-Vergara, AERD; Dr. Janelle Scott, University of California, Berkeley; Bi Vuong, Project Evident; and Dr. Tanisha Tate Woodson, Education Northwest.

Related Staff

Kate Place

Kate Place

Senior Researcher

View Bio Page
Kara Conroy

Kara Conroy

Researcher

View Bio Page
Gregory Chojnacki

Gregory Chojnacki

Senior Researcher

View Bio Page
Andrew Gothro

Andrew Gothro

Researcher

View Bio Page
Virginia Knechtel

Virginia Knechtel

Principal Researcher

View Bio Page