How the COVID-19 Pandemic Affected Academic Proficiency Rates in Pennsylvania in 2021

How the COVID-19 Pandemic Affected Academic Proficiency Rates in Pennsylvania in 2021

Findings from a Predictive Model
Published: Jan 09, 2023
Publisher: Mathematica
Download
Authors

Alma Vigil

Hena Matthias

Key Findings
  • Students in vulnerable groups and in fully remote learning had lower assessment participation rates than other students in 2021.
  • The pandemic led to a substantial reduction in academic proficiency statewide in 2021, reducing academic achievement even more than the results for tested students indicated.
  • The pandemic had consistently large negative academic effects across student groups, including for vulnerable groups that had low rates of proficiency before the pandemic.
  • Local Education Agencies (LEAs) that were fully remote after winter break saw lower proficiency rates in 2021, compared with LEAs that offered fully in-person learning to similar students.

The disruptions to schooling created by the COVID-19 pandemic prompted nationwide concern about negative impacts on academic proficiency, particularly for vulnerable student populations. Pennsylvania’s 2021 statewide assessments offered the first opportunity since the pandemic began to assess how students across the Commonwealth were faring, whether achievement gaps had widened, and how remote learning affected student performance. As in other states, the raw assessment data did not tell the full story of the pandemic’s impacts on academic proficiency. Fewer Pennsylvania students participated in the 2021 assessments than in prior years, and test takers were not a representative sample of all students. In addition, test administration dates varied widely across the state in 2021, with some LEAs postponing the usual spring assessments to the fall. Using a predictive model that accounts for the unique assessment issues in 2021 and the instructional modes that Pennsylvania LEAs offered, this research brief provides a fuller picture of the pandemic’s impacts on academic proficiency in grades 5 through 8.

How do you apply evidence?

Take our quick four-question survey to help us curate evidence and insights that serve you.

Take our survey