Evaluation of Developmental Math Pathways and Student Outcomes
July 2014–March 2024
The Dana Center Mathematics Pathways (DCMP), developed by the Charles A. Dana Center at the University of Texas at Austin, is an alternative model of developmental math that shortens students’ time in remediation, tailors content to students’ career goals and academic paths, and uses student-centered instruction. CAPR is collaborating with the Dana Center and four community colleges in Texas to address the following questions:
- Do DCMP students have better academic outcomes than students in traditional developmental math programs? Are these outcomes mediated through changes in student engagement?
- How does the opportunity to participate in DCMP affect long-term academic success for students in the study sample?
- How does the opportunity to participate in DCMP affect a variety of student subgroups?
- To what degree is there fidelity to the DCMP model across colleges? What aspects of DCMP are consistent across sites? What adaptations were made and why?
- How do the curriculum and pedagogy in DCMP courses differ from the colleges’ traditional developmental math courses?
- Is DCMP cost-effective relative to business-as-usual practices?
The Study Design
Study intake began in fall 2015 and continued over four semesters through spring 2017. The research sample is composed of more than 1,400 students at four community colleges (El Paso Community College; Trinity Valley Community College; and Brookhaven College and Eastfield College, which are both part of the Dallas County Community College District). The students were assessed as needing one or two levels of developmental math.
Participants were randomly assigned to a treatment group that entered the yearlong DCMP program or to a control group that entered a traditional developmental and college-level math sequence.
In the first phase of the project, researchers followed students for three or four semesters after their developmental math assignment. The outcomes of primary interest were completion of developmental and college-level math courses, average number of math credits earned, transfer to a four-year institution, and overall academic progress and course completion.
The project was extended to allow for a follow-up period of five years post-random assignment to examine the long-term goals of the program: students’ accumulation of college credits, completion, and transfer to a four-year institution. The project also estimated the cost-effectiveness of DCMP in comparison to standard math sequences.
What We’ve Learned
A May 2017 policy brief described modestly encouraging first-semester outcomes for the first two cohorts of DCMP students (fall 2015 and spring 2016). After one semester, DCMP students were more likely than control group students to have enrolled in and passed developmental math courses and to have earned developmental math credits. The curriculum and pedagogy of the DCMP courses were implemented with fidelity, and students in these classes were generally having a qualitatively different experience with math instruction than their peers in the control group. However, some colleges experienced challenges related to the additional time required to advise DCMP students into multiple math pathways and the need to ensure that the math courses align with four-year colleges’ transfer requirements.
In July 2018, CAPR released an interim brief that indicated that DCMP courses help students reach a critical college milestone: making it to and through college-level math courses. After three semesters, program group students passed college-level math and earned college-level credits at rates higher than their control group counterparts. Despite these promising findings, researchers noted that DCMP courses did not appear to affect student persistence rates.
The final report on the first phase of the study, which included the full sample, was published in November 2019. Researchers found that DCMP was effective at helping students complete developmental requirements and pass college math. After three semesters, study students assigned to DCMP were 8 percentage points more likely to pass a developmental math course and almost 24 percentage points more likely to complete their developmental math sequence than students assigned to standard developmental math. DCMP students were also more likely to pass college-level math by the end of the study period.
A brief released in March 2022 on the outcomes three years after random assignment found that the impacts on math completion were sustained but that these impacts did not lead to broader academic progress or success for students.
In the long-term follow-up, released in October 2023, the researchers found that DCMP helped students successfully complete their first college-level math course but had no effect on credits earned during the five years after random assignment and had no discernible impact on credential attainment. The publications reporting on the long-term follow-up also included a brief on impact findings and a cost analysis.
MDRC’s Intervention Return on Investment (ROI) Tool for Community Colleges can be used to estimate the costs and revenues associated with DCMP at a specific college or the average college in a state.
This research is supported by the Institute of Education Sciences, U.S. Department of Education, through Grant R305C140007 to Teachers College, Columbia University. The opinions expressed are those of the authors and do not represent views of the Institute or the U.S. Department of Education.