Category Listing

The Charter Blog


Tuesday, 08 November, 2011

Charters Lagging on NAEP? NOPE!

There has been a fair amount written about the recently released NAEP results for 4th and 8th graders in math and reading, and most of the discussion has focused on the minimal overall gains from 2009 to 2011. But a closer look at charter schools compared with traditional public schools demonstrates that students in charter schools made some very large gains (see table below).

In nearly every category that we examined, students in charter schools made larger gains than students in traditional public schools. And these gains are substantial. At the overall level, charter school gains decreased the gap between students in charters and traditional public schools. In many of the breakouts by student and school categories, charter schools exceeded traditional public schools and the gains charters made are quite large.

Take a look at the gains ELL students attending charter schools made—a 15 point gain in 4th grade reading, a 10 point gain in 8th grade reading, and a 7 point gain in 4th grade math. In every assessment, ELL students who attended charter schools scored higher than ELL students in traditional public schools. Charter schools still have work to do to close achievement gaps between subgroups, but with these kind of gains charter schools are making good progress.

NAEP certainly has its limitations—the assessment is administered every two years to different students, and only to a sample of schools nationwide. However, NAEP has value as a national indicator of achievement trends. And the trend for charter schools appears to be on the rise. These NAEP results are consistent with the findings from the UCSD meta-analysis that showed positive results for elementary and middle school students who attend charter schools.

NAEP Gains between 2009 & 2011, Charter and Traditional Public Schools

 

 

Overall

Black

White

Hispanic

FRL

ELL

City

Suburb

Town

Rural

4th Grade Math

CPS

+6

(237)

+4

(224)

+3

(251)

+9

(234)

+6

(229)

+7

(222)

+7

(233)

+6

(241)

+9

(247)

+5

(248)

TPS

+1

(240)

+2

(224)

+1

(249)

+2

(229)

+1

(229)

+1

(219)

0

(235)

+1

(244)

0

(237)

+2

(242)

4th Grade Reading

CPS

+6

(218)

+3

(206)

+5

(232)

+9

(212)

+6

(208)

+15

(195)

+9

(213)

+1

(223)

+12

(232)

+10

(232)

TPS

0

(220)

+1

(205)

+1

(229)

+1

(205)

+1

(207)

0

(188)

0

(214)

+1

(225)

0

(217)

+1

(223)

8th Grade Math

CPS

+6

(281)

+7

(266)

+5

(296)

+6

(277)

+6

(271)

0

(254)

+7

(275)

+8

(287)

-6

(289)

+3

(290)

TPS

+1

(283)

+2

(262)

+1

(293)

+3

(269)

+3

(269)

+1

(243)

+1

(277)

0

(286)

+2

(281)

+1

(285)

8th Grade Reading

CPS

+4

(261)

+8

(251)

-1

(274)

+6

(255)

+6

(253)

+10

(231)

+4

(256)

+4

(264)

-3

(270)

+4

(271)

TPS

+2

(264)

+1

(247)

+1

(272)

+3

(251)

+2

(251)

+4

(223)

+1

(257)

0

(267)

+3

(263)

+2

(266)

Data compiled by NAPCS from: http://nces.ed.gov/nationsreportcard/naepdata/dataset.aspx
Note: 2011 NAEP Average Scores in parenthesis; CPS - Charter Public School; TPS -Traditional Public School; FRL - Students Eligible for Free or Reduced Price Lunch; ELL - English Language Learners


Posted by: Anna Nicotera, Director of Research and Evaluation at Tuesday, 08 November, 2011 12:00 AM


comment

Comments (4)

 
Rating:

comment
1.  N/A (08 Nov 2011 12:44 PM)
I’m sorry to be a pretentious stickler, especially since you used cautious language and made an effort to point out prior research, but these data are not particularly meaningful. The changes are not "gains" or “progress,” which require longitudinal data that follow students over time. These are cohort increases. Charter students are a relatively small, rapidly changing population, and you simply cannot account for this with a cross-sectional national sample, even broken down by subgroup. It’s also worth noting that the estimates in the table (especially those for charters) have fairly large margins of error, and it’s important to account for this when presenting NAEP data.

Charter students may have made progress, and they may not have. But these data don’t prove it either way.

comment
2.  N/A (08 Nov 2011 05:08 PM)
well, you got the pretentious part right- but need more work if you want to get any stickler credibility. the post never said "charter students" made progress- they said that charter schools showed more improvement. this means your longitudinal data requirement is kinda unnecessary- unless you have some secret explanation of how & why the national population of charter students evolved to contain higher achieving kids.

comment
3.  N/A (09 Nov 2011 04:26 PM)
The distinction between students and schools is not relevant. What is relevant is the difference between “change” and “progress.” It’s true that the average score among charter students (or schools, if you’d prefer) was higher in 2011 compared with 2009 – it was a positive and statistically significant change. What remains an open question is the degree to which this change reflects actual progress (is due to the schools), or to shifts in the charter student population.

There are dozens of reasons why more high-performing students might have entered charter schools since 2009, none of which are “secret” or even surprising. And it is difficult to tease that out with cross-sectional data, especially when samples are smaller.

comment
4.  N/A (11 Nov 2011 08:37 AM)
the distinction is entirely relevant if you are going to criticize someone for an explanation of the change they never reached in the first place. so you think the explanation is simply a change in population? fine. nothing in the post said otherwise. i would be more inclined to believe you if you pointed to some research proving that hypothesis- but either way your initial reply is only arguing against a strawman.