← Back to context

Comment by kalkin

7 hours ago

The article says that scores began drifting down around 2012. Gemini is telling me that NAEP peaked in 2013. Elsewhere in this thread there's a claim of an inflection point around 2018 in PISA, which eyeballing Gemini's numbers lines up with NAEP.

Does this correlate with the racial proportion data?

If you graph actual NAEP since 1998 versus a 1998 group-fixed score, you'll see increases (1998-2002, 2005-2013, 2015-2017) and multiple declines twice taking the line back down to the 1998 linear trend prediction (2002-2005, 2017-2024).

It is wrong to get overly exact here though. We are talking about a overall score variance of just 10pts in the face of an achievement gap of nearly 30pts, with an absolutely massive 20% decline in white population share over the 26 year period.

  • If you're seeing trends in your residuals that's a violation of the independence assumption of linear models (assuming you're using about a linear model since you're talking about "linear predictions").

    I'm in a different field but an arbitrary 27 years (1998-2024) of data and the autocorrelation both would get flagged in a review for me. Not to give statistics homework but you should test and correct the autocorrelation issue you're describing in the model and if the data goes farther back I would go farther back, too (with how you're describing the errors going off pattern then back on it sounds like the inference here would be at least somewhat unstable depending on year chosen).

    Edit: these are the assumptions and basics of how to correct for violations, in particular you're describing a violation of assumption 2 but you should test for all of them - https://www.statology.org/linear-regression-assumptions/