Review of The System-Level Effects of Denver's Portfolio District Strategy: Technical Report

An NEPC Review funded by the Great Lakes Center

Key Takeaway: Report draws deserved attention to impressive academic gains over the past decade, but is less useful in ascribing causation or as a guide for other districts to replicate that success.

EAST LANSING, MI (February 7, 2023) - A recent report from the Center for Education Policy Analysis at the University of Colorado Denver claimed that portfolio reforms in the Denver Public Schools led to substantial academic gains for students. As the report's lead author told the Denver Post , "This study makes clear that the reforms helped students and strengthened the district." A review of the report concludes, however, that claims attributing those gains specifically to the portfolio reforms are not valid.

Robert Shand, a professor at American University, reviewed The System-Level Effects of Denver's Portfolio District Strategy: Technical Report and determined that any specific policy prescriptions from the report are premature.

The report analyzes changes in academic performance as measured by test scores and graduation rates versus comparable schools in Colorado over 11 years of the district's experimenting with the "portfolio" approach to school district management. The portfolio approach includes central-office oversight of different school types (such as charter schools, innovation schools, and district-run schools), with widespread parental choice under a single enrollment system. The model looks to choice, competition, and accountability to drive gains in student performance.

The report's lead author, who " worked as director of charter schools for DPS during part of the period studied," has been joined by other reform backers in insisting in newspaper articles that the study provides firm support for the district to recommit itself to the full slate of portfolio policies.

While the reported gains in math and ELA scores, as well as graduation rates, are indeed dramatic, Professor Shand points out that they were not experienced equally and may have widened achievement gaps.

Further, claims attributing the gains specifically to the portfolio reforms are premature for at least three reasons. First, many other changes, beyond the portfolio reforms, were occurring in the district at the same time. These included changes to funding, curriculum, leadership, teacher policies, and student demographics. Second, some gains, particularly among marginalized groups of students, predated the reforms. Third, the "portfolio" reforms themselves are diffuse and difficult to parse.

For these reasons, Professor Shand explains, though the report succeeds in documenting and drawing attention to real academic gains in Denver over the past decade, it is less useful in ascribing causation or as a guide to how other districts could replicate that success.

Find the review, by Robert Shand, at:

https://www.greatlakescenter.org

Find The System-Level Effects of Denver's Portfolio District Strategy: Technical Report , written by Parker Baxter, Anna Nicotera, Erik Fuller, Jakob Panzer, Todd Ely, and Paul Teske and published by the Center for Education Policy Analysis at the University of Colorado Denver, at:

https://publicaffairs.ucdenver.edu/docs/librariesprovider36/research-projects-documents/center-for-education-policy-analysis/denver-report---technical-emarboed.pdf?sfvrsn=6a9745bb_2

NEPC Reviews ( http://thinktankreview.org ) provide the public, policymakers, and the press with timely, academically sound reviews of selected publications. NEPC Reviews are made possible in part by support provided by the Great Lakes Center for Education Research and Practice: https://www.greatlakescenter.org

The National Education Policy Center (NEPC), a university research center housed at the University of Colorado Boulder School of Education, produces high-quality information in support of democratic deliberation about education policy. We publish original research, policy briefs, and expert third-party reviews of think tank reports. NEPC publications are written in accessible language and are intended for a broad audience that includes academic experts, policymakers, the media, and the general public. Visit us at: http://nepc.colorado.edu

About The Great Lakes Center

The mission of the Great Lakes Center for Education Research and Practice is to support and disseminate high quality research and reviews of research for the purpose of informing education policy and to develop research-based resources for use by those who advocate for education reform. Visit the Great Lakes Center Web Site at: https://www.greatlakescenter.org . Follow us on Twitter at: http://twitter.com/greatlakescent . Find us on Facebook at: https://www.facebook.com/GreatLakesCenter.

Friend on Facebook

Follow on Twitter

The mission of the Great Lakes Center for Education Research & Practice is to support and disseminate high quality research and reviews of

research for the purpose of informing education policy and to develop research-based resources for use by those who advocate for education reform.

Visit the Great Lakes Center website at https://www.greatlakescenter.org/

Contact:
Alex Molnar: (480) 797-7261, nepc.molnar@gmail.com
Faith Boninger: (480) 390-6736, fboninger@gmail.com
Robert Shand : ( 202) 885-6917 , rshand@american.edu