← Back to scans

Will US test scores in Reading decline? — Significant decrease

KXUSTESTSREADING-26-SD · Politics · 2026-08-23
41%
Agent
48%
Market Price
-7.0%
Edge
42%
Confidence
Volume: 26,442
Spread: 5.0c
Days to resolution: 494
Markets in event: 3
Final Rationale
The decisive uncertainty is definitional, not directional: reading scores are very likely to fall again (recent-era drift ≈ -1.8 pts/2yr, stalled post-pandemic recovery, no counteracting policy), but whether the drop clears the undefined 'Significant decrease' bar is roughly a coin flip conditional on a decline. Under a ~3pt point threshold the probability is only ~15-21%; under NAEP's own 'statistically significant' convention (where a 2-pt national move typically qualifies) it rises to ~50-60% — a scenario mix that lands close to the 43% market anchor, and the critique is right that both forecasters described this bullish branch without weighting it. However, the 5-bucket partition (a separate plain 'decrease' bucket) argues that 'significant' is the larger-magnitude tail, which caps the upside, and thin liquidity (70 contracts/day, 31-66% range) means the anchor itself carries little information. Small residual risks — data-quality degradation from the NCES staffing collapse and ambiguous/delayed resolution — mostly widen the distribution rather than shift it. I settle marginally below the anchor at 41%, closer to the market than either input forecast.
Price vs. prediction
How the market moved after the agent's call. Solid blue line is the actual market price; dashed line is the agent's static forecast at $t{=}0$.
$n = 10$ follow-ups
Re-scan Context
This market has been scanned before. Previous predictions:
DatePredictedMarket PriceConfidence
2026-04-21 49% 67% 35%
1. Planner Opus · Fermi decomposition + tool plan
Tools chosen: kalshi_direct kalshi_related claude_news gdelt_news wikipedia code_execution polymarket_related
Sub-questions (Fermi decomposition)
  1. What exact numeric threshold (points on the NAEP scale) does Kalshi use to define 'Significant decrease' versus 'Decrease'/'No change' for 8th-grade reading in 2026, and what is the current YES price?
  2. What is the historical NAEP grade-8 reading average scale score by year (1992-2024), and what is the distribution of biennial changes — how often has a drop exceeded the market's 'significant' threshold?
  3. Will the 2026 NAEP main reading assessment for grade 8 actually be administered (Jan-Mar 2026) and its results released before the market's Dec 31, 2027 close, given NCES/IES staffing and budget cuts?
  4. What do the most recent leading indicators (2024 NAEP results, state assessments, chronic absenteeism, NWEA/Curriculum Associates interim data) suggest about the direction and magnitude of 8th-grade reading achievement change through 2026?
  5. What are the prices on the sibling Kalshi markets in the same event (significant increase / increase / no change / decrease), and do they imply a coherent probability distribution?
Planner reasoning
This is a Kalshi tiered market on the 2026 NAEP (Nation's Report Card) 8th-grade reading score change, so the exact numeric threshold for 'Significant decrease' in the market rules plus the current price are the primary anchors. Beyond that, the key empirical inputs are the historical NAEP grade-8 reading score series (2019: 263, 2022: 260, 2024: 258) and the size distribution of biennial changes, plus whether NCES budget cuts affect the 2026 administration/release timing before the Dec-2027 close.
2. Research Parallel tool calls
ToolStatusTimeItemsSummary
kalshi_direct OK 0.2s 1 ## This Market's Kalshi Data **Significant decrease** (KXUSTESTSREADING-26-SD) - Current price (probability): 43.00% - 7-day price change: +0.00% - 30-day price change: -2.00% - Average daily volume: 70 contracts - Price range: 31.00% - 66.00% - Data points: 83 days
kalshi_related OK 3.5s 1 1 related markets / summaries. series KXUSTESTSREADING: 0 markets (skipped 3 no-signal) | series KXUSTESTSMATH: 0 markets (skipped 3 no-signal) | keyword 'test scores': ok | keyword 'NAEP': no matches | keyword 'reading': no matches
claude_news OK 23.2s 14 ## Findings **2026 NAEP Administration Schedule** - NAEP will be administered to a sample of fourth- and eighth-grade students in mathematics and reading between January 26 and March 20, 2026. (nces.ed.gov) - Math and reading results for the nation, states, and districts participating in the Tri
gdelt_news OK 133.0s 20 GDELT: 20 articles across 3 queries (lookback=180d). 'NAEP 2026 reading assessment': 10 hits | "Nation's Report Card eighth grade reading decline": 10 hits | 'NCES National Assessment of Educational Progress cuts': error GDELT rate-limited after retries (429)
wikipedia OK 3.5s 2 Fetched 2 Wikipedia entries (0 missing pages).
code_execution OK 41.2s 0 **NAEP Grade-8 Reading — Biennial Change Analysis (1992–2024)** - **Historical change distribution (all 14 transitions, normalized to 2-yr basis):** mean = **-0.32 pts/2yr**, SD = **2.11 pts**. Restricting to only clean 2-year-gap transitions (n=10): mean = **-0.30**, SD = **2.26** — very similar,
polymarket_related OK 3.5s 0 Scanned 100 active Polymarket markets, kept 0 matches. keyword 'NAEP': 0 markets | keyword 'test scores': 0 markets | keyword 'reading scores': 0 markets
3. Evidence Brief Sonnet · 6702 chars
# Current state The market resolves based on the actual change in the NAEP grade-8 reading average scale score for the 2026 administration (vs. 2024), once results are released. NAEP's 2026 grade-4/8 reading assessment is scheduled to be administered Jan 26–Mar 20, 2026, with national results expected in early 2027 (before the Dec 31, 2027 close). As of now, Kalshi prices "Significant decrease" at 43%, down slightly from a 66% high over the past ~83 days; no 2026 NAEP reading results exist yet — all evidence is indirect (2024 baseline, staffing/administration risk, and ambiguous post-2024 news chatter). # Timeline of key events - 2025-01: 2024 NAEP results released — grade-8 reading fell 2 pts vs. 2022, 5 pts vs. 2019; ~1/3 of 8th graders below "Basic," largest share ever. (confirmed — nagb.gov, edweek.org, k12dive.com) - 2025 (through mid-year): NCES/IES staffing gutted — NCES down from ~100 to 3 employees, none working directly on NAEP; IES from 175 to <20. (confirmed — the74million.org) - 2025-04-21: NAGB votes to cut some future assessments (2032 state 12th-grade, 2029 long-term trend) but leaves 2026 grade-8 reading/math intact. (confirmed — k12dive.com) - 2025 (mid-year): Education Secretary McMahon confirms 2026 NAEP (math/reading/history/civics) will proceed as planned Jan 26–Mar 20, 2026, despite layoffs. (confirmed — k12dive.com) - 2026-01-26 to 2026-03-20: Scheduled window for 2026 NAEP grade-4/8 reading & math administration. (scheduled/confirmed — nces.ed.gov) - 2026-06 to 2026-08: Multiple outlets report "teen reading and math scores have stagnated" / mixed state-level results (Maine, Iowa, Utah) — unclear whether tied to NAEP or separate state/interim assessments; likely commentary on 2024 NAEP or state tests, not new NAEP 2026 data. (reported, ambiguous — GDELT/local outlets) - Early 2027 (expected): National/state/TUDA 2026 NAEP reading results to be released — this is the resolution trigger. (reported/expected — k12dive.com) # Event Will 8th-grade NAEP average reading scores show a "Significant decrease" in the 2026 assessment (vs. 2024)? # Outcomes to forecast Yes / No (this ticker = "Significant decrease" bucket within a larger sibling set: significant increase / increase / no change / decrease / significant decrease) # Kalshi market anchor **Current YES price: 43%** (Significant decrease). 7-day change: 0%; 30-day change: -2%. Price range over 83 days: 31%–66%. Average daily volume: only 70 contracts — thin liquidity, wide historical swings suggest low conviction/consensus. # Sub-question answers 1. **Numeric threshold for "Significant decrease"?** — No explicit NAEP-point threshold was found; the rules field for this market is blank. Current YES price is 43%. [kalshi_direct] 2. **Historical distribution of biennial changes?** — 1992–2024 mean change ≈ -0.32 pts/2yr (SD 2.11); ≥2pt declines occurred 28.6% of transitions, ≥3pt 21.4%, ≥4pt 7.1%, ≥5pt never (0%). Recent era (2013–2024) is much steeper: mean -1.80 pts/2yr. [code_execution] 3. **Will 2026 NAEP be administered/released before close?** — Yes, very likely: administration scheduled Jan 26–Mar 20, 2026, confirmed by Education Secretary McMahon despite NCES near-total staff loss (100→3); results expected early 2027, well before the Dec 31, 2027 close. Data-quality (not scheduling) is the main residual risk. [k12dive.com, the74million.org] 4. **Leading indicators for direction/magnitude?** — 2024 NAEP already showed accelerating decline (-2 pts vs 2022, -5 vs 2019, record share below Basic). Mid-2026 news reports "stagnated" scores in several states/reports, but these appear to reference state or non-NAEP assessments, not the pending 2026 NAEP release — genuinely new signal is thin/ambiguous. [claude_news; GDELT] 5. **Sibling market coherence?** — No sibling market prices were retrievable (kalshi_related found no matching same-series markets); cannot assess whether Yes/No/Increase/Decrease/No-change buckets sum coherently. # Key facts (high-confidence, factual) 1. [nagb.gov/edweek] 2024 NAEP grade-8 reading: -2 pts vs 2022, -5 pts vs 2019; record-high share below Basic. 2. [k12dive.com] 2026 NAEP administration window Jan 26–Mar 20, 2026; national results expected early 2027. 3. [the74million.org] NCES staff cut from ~100 to 3; IES from 175 to <20 — administration proceeding but data-quality risk flagged. 4. [code_execution] Historical ≥3pt decline base rate ≈21%; trend-adjusted (using recent steeper drift) ≈15-21% for "significant" (≥3pt) threshold; ≈2.5% for a ≥5pt decline. # Cross-market signals - Kalshi related: No same-series sibling markets returned; no arbitrage signal available. - Polymarket: No matching markets found (0/100 scanned). - Sportsbook implied: N/A (not a sports event). # Analyst opinions and speculation - NCES Commissioner Peggy Carr: post-pandemic recovery has stalled, mostly progress seen in math not reading. [edweek.org] - Former NCES commissioner Schneider and others: staffing collapse threatens NAEP's data quality/future, though not the 2026 test's occurrence. [the74million.org] - Hechinger Report frames trend as continued/worsening decline below 2022 "nadir." # Directional lean per outcome - **Yes (Significant decrease)**: Supported by accelerating 2019→2022→2024 decline trend, no evident policy reversal, and elevated near-term drift (-1.8pts/2yr recent average) versus historical (-0.32). Opposed by: no historical NAEP transition has ever hit ≥5pts, and even ≥3pt declines are historically a minority (21%) outcome; base-rate modeling puts "significant" (~3pt+) probability near 15-21%, below the market's 43%. - **No**: Supported by base-rate analysis showing most transitions are smaller than "significant" magnitude, plus possible mean-reversion/stabilization signals (mixed 2026 state-level reports of "stagnation" rather than further steep drops). Opposed by persistent multi-cycle downward trend and lack of any counteracting policy/intervention evidence. # Gaps / unknowns - Exact Kalshi definition/point-threshold for "Significant decrease" is not published in available materials. - No 2026 NAEP reading data exists yet; all forward signals are inferential. - Ambiguity in mid-2026 news reports — unclear if referencing NAEP or other assessments. - No sibling-market pricing to check for distributional consistency. # Calibration anchors - Kalshi current YES price: 43% (anchor). - Historical base rate of ≥3pt NAEP grade-8 reading decline: ~21% (14 transitions, 1992-2024). - Trend-adjusted (recency-weighted) probability of ≥3pt decline: ~15%; of ≥2pt: ~28%. - Blended model 2026 point estimate: ~257.3 (implied ~-0.7 pt change from 2024), below most "significant" thresholds.
4. Forecasters Opus + GPT · in parallel
claude-opus-5
0.35
Yes 40%
No 60%
The 2026 NAEP grade-8 reading test is confirmed to be administered Jan-Mar 2026 with results in early 2027, so the market should resolve on real data before close. Direction is likely downward given the 2019→2022→2024 accelerating decline (-5 then -2 pts) and NCES's own assessment that reading recovery has stalled, but magnitude matters: historically ≥3pt biennial declines occur only ~21% of the time and ≥5pt never, and the recency-weighted model implies only ~-0.7 to -1.8 pts. The key unresolved ambiguity is whether 'significant' means a point threshold (~3pts, pushing probability to ~15-21%) or NAEP's statistical-significance language (where even a 2-pt national drop typically qualifies, pushing it toward ~50-60%). Kalshi's 43% anchor with thin volume (70 contracts/day) and a wide 31-66% range reflects exactly this definitional uncertainty; I stay near the anchor, shading marginally down for base-rate weight and small release/data-quality risk from the NCES staffing collapse.
gpt-5.5
0.49
Yes 34%
No 66%
Kalshi’s direct YES anchor is 43%, but liquidity is thin and the brief’s base-rate evidence points lower. The undefined “Significant decrease” threshold is a key uncertainty: if it means roughly a ≥3-point NAEP drop, historical frequency is only about 21% and trend-adjusted estimates are around 15–21%; if closer to ≥2 points, the chance is higher but still not clearly above the market price. The 2024 baseline was already very weak, with grade-8 reading down 2 points vs. 2022 and 5 vs. 2019, which supports some continued-decline risk, but ambiguous 2026 state/interim reports suggest stagnation rather than a fresh collapse. NAEP administration and release appear very likely before close despite NCES staffing risks, so the main uncertainty is the score change magnitude, not resolution timing.
5. Devil's Advocate Sonnet · red-team critique
1. Both forecasters flag that NAEP's own "statistically significant" convention (often just ~1-2 pts, well within typical SE bounds) could push true probability to 50-60%, yet both still land below the 43% anchor (0.40 and 0.34) — they acknowledge this bullish scenario in prose but don't actually weight it into their point estimates, creating an internal inconsistency. 2. Neither forecaster addresses the sibling-market structure explicitly: since outcomes partition into 5 buckets (sig. increase/increase/no change/decrease/sig. decrease), the ~21% base rate for "≥3pt decline" doesn't map cleanly onto "significant decrease" alone if "decrease" is a separate bucket — the brief admits "cannot assess whether... buckets sum coherently," but neither analyst tries to bound this via the 5-way split. 3. Both treat the NCES staffing collapse (100→3 staff) purely as a scheduling/data-quality footnote, but neither considers that degraded psychometric infrastructure could itself produce more volatile or biased estimates (wider error bars, potential over- or under-reporting of "significant" change) — a genuine tail risk that could push probability either direction, not just add minor noise. 4. Neither model incorporates the possibility of non-resolution or delayed/ambiguous data by the Dec 2027 close as a scenario requiring a probability adjustment; both assume clean binary resolution despite the brief's explicit "data-quality (not scheduling) is the main residual risk" caveat. 5. The two forecasts are extremely close (0.40 vs 0.34) and both under-cite the accelerating trend evidence: the 2019→2022→2024 sequence (-5, -2 pts) combined with "recent era (2013–2024) mean -1.80 pts/2yr" already exceeds the long-run mean of -0.32, suggesting the historical 21% ≥3pt base rate may understate risk for the *next* cycle specifically — neither forecaster explicitly re-weights using only the recent-era subsample's implied ≥3pt frequency, which is likely higher than the full 1992-2024 sample. 6. Given the brief states "no explicit NAEP-point threshold was found" and "rules field... is blank," both forecasts express unusually tight confidence (0.35, 0.49) for a genuinely undefined resolution criterion — this ambiguity plus thin liquidity (70 contracts/day) arguably warrants wider uncertainty intervals or explicit scenario-weighted ranges rather than single point estimates near the anchor.
6. Aggregator Opus · final calibrated forecast
41% (42% confidence)
Yes: 41% No: 59%
The decisive uncertainty is definitional, not directional: reading scores are very likely to fall again (recent-era drift ≈ -1.8 pts/2yr, stalled post-pandemic recovery, no counteracting policy), but whether the drop clears the undefined 'Significant decrease' bar is roughly a coin flip conditional on a decline. Under a ~3pt point threshold the probability is only ~15-21%; under NAEP's own 'statistically significant' convention (where a 2-pt national move typically qualifies) it rises to ~50-60% — a scenario mix that lands close to the 43% market anchor, and the critique is right that both forecasters described this bullish branch without weighting it. However, the 5-bucket partition (a separate plain 'decrease' bucket) argues that 'significant' is the larger-magnitude tail, which caps the upside, and thin liquidity (70 contracts/day, 31-66% range) means the anchor itself carries little information. Small residual risks — data-quality degradation from the NCES staffing collapse and ambiguous/delayed resolution — mostly widen the distribution rather than shift it. I settle marginally below the anchor at 41%, closer to the market than either input forecast.
Pipeline Timing
Total pipeline time: 246.2s
Per-tool research timings shown in the Research section above.