Supplemental Study: Evaluation of Early Start Developmental Education Policy
Completing developmental coursework in the summer before starting college—rather than during the first term of college—could be an important way to keep underprepared students from falling behind their college-ready peers, who begin to accumulate college-level credits in their first semester of college enrollment. Yet taking such courses in the summer before college may be insufficient to adequately boost college-level skills. Moreover, students may find it difficult to commit time, effort, and resources to developmental courses over the summer.
To evaluate whether such a reform measure improves student outcomes, CAPR conducted a study of the Early Start policy at the California State University (CSU) system. In 2011, the California State University (CSU), the nation’s largest public four-year university system, enacted Early Start, requiring students needing remediation to enroll in such courses in the summer before their first year. The primary goal of Early Start is to have students enter their first year of college at CSU already having met their developmental education needs. (It is important to note that this study evaluates Early Start before recent changes in the program took effect that, among other things, provide Early Start students with the opportunity to earn college credit during the summer through Early Start coursework.)
The Study Design
CAPR researchers use two empirical strategies to identify the impact of the Early Start reform on student success at CSU. First, researchers investigate the impact of Early Start by comparing outcomes of those identified for remediation before and after the adoption of the policy against those not identified for remediation using a difference-in-differences approach (comparing summer enrollment to fall enrollment in remediation). Second, researchers evaluate students identified for remediation under Early Start to otherwise similar students not identified for remediation using a fuzzy regression discontinuity approach (comparing remediation in the summer to no remediation at all).
The study uses data on CSU first-year students enrolled in 2009 through 2015—three cohorts before the Early Start reform (2009–2011) and four cohorts after (2012–2015). Given changes in the English remediation cutoff and placement policies for English, the analyses focus on remediation in mathematics.
Results of the study suggest that Early Start has by and large not met its intended outcomes. On the one hand, students are meeting remediation requirements prior to the fall term as a result of the policy. On the other hand, students requiring remediation in the Early Start era have not had better performance or persistence outcomes than similar students who required remediation in the years prior to Early Start. Moreover, using the fuzzy regression discontinuity design, the researchers find that students assigned to remediation under Early Start were less likely to persist and earned fewer credits than otherwise similar students who did not require remediation. Thus, although Early Start is successfully remediating students before the fall term, this earlier remediation does not appear to improve later student outcomes.