← Back to scans

Will US test scores in Reading decline? — Significant decrease

KXUSTESTSREADING-26-SD · Politics · 2026-04-21
49%
Agent
67%
Market Price
-18.0%
Edge
35%
Confidence
Volume: 14,585
Spread: 8.0c
Days to resolution: 619
Markets in event: 3
Final Rationale
My independent estimate of 44% was built on a decomposition: ~25% historical base rate of significant NAEP 8th grade reading declines, elevated to ~45% by post-COVID trend continuation, the vulnerable 2nd-grade-during-closures cohort, and the disruptive 2026 digital-only framework transition. I partially accept the critic's challenges: the framework change is genuinely double-edged (bridge studies may suppress clean significance declarations, arguing DOWN), but the sq2 fact-check that 2024 was already flagged significant vs. 2019 and the under-weighting of cohort vulnerability argue UP — netting to a modest upward nudge to ~48-49%. I reject full convergence to the 66% market because it has low daily volume (~97 contracts), an anomalous $0.998 spread indicating poor price discovery, and the parallel Math market at 54% suggests the Reading market is noisy/overpriced rather than informative. The resolution ambiguity (NCES's official significance designation vs. raw point drops) is a genuine downward pressure that the market may not be pricing.
Price vs. prediction
How the market moved after the agent's call. Solid blue line is the actual market price; dashed line is the agent's static forecast at $t{=}0$.
$n = 58$ follow-ups
1. Planner Opus · Fermi decomposition + tool plan
Tools chosen: article_search web_search wikipedia_lookup kalshi_data kalshi_orderbook code_execution
Sub-questions (Fermi decomposition)
  1. Will NAEP 8th grade Reading scores in 2026 show a statistically significant decline compared to the most recent prior assessment? (w=0.45)
  2. Did US 8th grade Reading scores already show a significant decline in 2024 (the most recent NAEP assessment), suggesting a continuing downward trend? (w=0.30)
  3. Are there structural factors (post-COVID learning loss, screen time, teacher shortages) that would cause 8th grade reading scores to decline significantly between now and the 2026 NAEP assessment? (w=0.25)
Planner reasoning
This question resolves YES if US average 8th grade Reading test scores (almost certainly NAEP/Nation's Report Card) show a 'significant decrease' in 2026. Key considerations: **Assessment calendar**: NAEP is typically administered every 2 years. The 2024 NAEP was the most recent; the 2026 NAEP would be next in the cycle. Results are usually released about a year after testing, meaning 2026 NAEP results might be released in late 2027 — within the resolution window of Dec 31, 2027. **Recent trend context**: 8th grade reading scores dropped significantly from 2019 to 2022 (COVID impact), and continued declining in 2024. The question is whether this trend continues into 2026 or whether recovery occurs. **Reference class**: Historically, NAEP 8th grade reading scores have been relatively stable with infrequent significant declines. The 2022 drop was historically large (COVID-related). A second consecutive significant decline would be unusual but not unprecedented given the structural factors at play. **Causal mechanisms favoring YES**: Continued post-COVID academic disruption, increased screen time/phone use affecting literacy, teacher shortages in reading-focused instruction, demographic shifts, and potential federal education funding cuts. **Causal mechanisms favoring NO**: Some recovery from COVID disruptions, targeted interventions (tutoring programs, reading initiatives), regression to mean after historically large 2022 drop. **Definition of 'significant'**: NAEP uses statistical significance testing. A 1-2 point change may or may not be statistically significant depending on variance. The market likely uses NAEP's own characterization ('significant' vs 'not significantly different'). **Temporal sequence**: NAEP 2026 testing would occur in early-to-mid 2026, results released late 2026 or early 2027 — well within the Dec 2027 resolution window. The key uncertainty is the direction and magnitude of score change.
2. Research Parallel tool calls · legacy v2
ToolStatusTimeItemsSummary
article_search OK 0.2s -
web_search OK 33.2s -
wikipedia_lookup OK 1.2s -
kalshi_data OK 1.7s -
kalshi_orderbook OK 0.2s -
code_execution OK 0.0s -
3. Evidence Synthesis Sonnet · 12 items · legacy v2
#StrengthCredibilityDirectionSourceClaimPriced In
1 STRONG 92 NEUTRAL web_search The 2026 NAEP Reading assessment is legislatively mandated and was administered January 26–March 20, 2026, with results expected to be released later in 2026 or early 2027 — within the resolution window. Yes
2 MODERATE 85 ↑ UP web_search The 2026 NAEP uses a new Reading Assessment Framework for the first time, including new content (social studies and science texts) and fully digital administration — introducing comparability risk that could affect score interpretation and statistical significance determinations. No
3 MODERATE 70 ↓ DOWN code_execution Historical base rate analysis shows that statistically significant declines (≥2 points) in NAEP 8th grade reading have occurred in approximately 25% of assessment transitions (3 out of 12), while any decline occurred 58% of the time. No
4 MODERATE 75 ↑ UP web_search The 2026 8th graders were in 2nd grade during the 2020 pandemic, making them a key cohort for tracking pandemic-era learning impacts with potentially elevated vulnerability to continued score declines. Yes
5 STRONG 92 ↑ UP web_search The 2024 NAEP Reading Report Card (released January 29, 2025) showed national average reading scores at grades 4 and 8 were lower compared to the prior assessment, continuing a downward trend. Yes
6 STRONG 88 ↑ UP code_execution 8th grade NAEP reading scores declined from 263 (2019) to 260 (2022, -3 points) to 259 (2024, -1 point), showing a continuing but decelerating downward trend. Yes
7 MODERATE 72 ↓ DOWN code_execution The 2022–2024 decline of only 1 point is smaller than NAEP's typical threshold for statistical significance, suggesting the 2024 decline may not have been characterized as 'statistically significant' — weakening the trend argument. No
8 MODERATE 60 ↑ UP web_search Structural factors identified include: post-COVID academic disruption for students who were in early elementary during the pandemic, increased screen time, teacher shortages, and potential federal education funding cuts under the current administration. Yes
9 WEAK 50 ↑ UP web_search The shift to fully digital NAEP administration in 2026 is new and could introduce test-mode effects or technical barriers that may depress scores beyond true academic ability changes. No
10 MODERATE 55 ↑ UP kalshi_data The Kalshi market for 'Significant decrease' in US Reading test scores 2026 is currently priced at 66%, up 6% in 7 days, with a historical range of 45–81% over 128 days. Yes
11 WEAK 45 ↑ UP kalshi_data The analogous Kalshi market for Math significant decrease in 2026 is at 54%, suggesting the market prices Reading declines as more likely than Math declines by ~12 percentage points. Yes
12 WEAK 40 NEUTRAL kalshi_orderbook The orderbook shows HIGH liquidity (depth 28,682) but a wide spread ($0.998), suggesting thin active trading at the current price despite high reported depth — reliability of price signal is uncertain. Yes
Information Gaps
  • No data on whether the 2024 NAEP 8th grade reading decline was officially characterized as 'statistically significant' by NCES — critical for understanding the sq2 answer and trend characterization
  • No information on the magnitude of tutoring/intervention programs implemented since 2022 that could counteract decline trends
  • No evidence on what NAEP's methodology will be for comparing 2026 scores (new framework) to 2024 scores (old framework) — comparability bridge studies are unknown
  • No data on teacher shortage severity or school funding changes between 2024 and 2026
  • No evidence on whether federal education budget cuts under the current administration will have measurable near-term effects on the 2026 cohort
  • No data on digital testing learning curves or pilot results from the new fully-digital NAEP format
  • Resolution criteria are ambiguous: unclear whether 'significant decrease' means NAEP's statistical significance characterization or a specific point threshold
Key Uncertainties
  • Framework change: The new 2026 NAEP Reading framework measures different content (social studies/science texts added), making direct score comparison to 2024 methodologically complex — could produce score changes unrelated to actual reading ability trends
  • Statistical significance threshold: A 1-2 point decline may or may not be significant depending on NAEP variance; the deceleration from -3 points (2019-2022) to -1 point (2022-2024) may continue to flatten toward 0
  • Kalshi market reliability: The 66% market price represents collective expectation but volume is low (97 contracts/day) and the wide orderbook spread suggests limited price discovery quality
  • Resolution criteria ambiguity: Whether 'significant decrease' in the question requires NAEP's own statistical significance designation or a specific point-change threshold
  • Cohort-specific effects: 2026 8th graders experienced early elementary disruption during COVID, which could have distinctly different effects than prior cohorts who experienced COVID in older grades
Market Context
Price: 0.66 · 7d: +0.06 · 30d: -0.01
Volume: LOW — 97 contracts/day average is minimal for a binary prediction market · Depth: HIGH reported depth (28,682) but spread of $0.998 suggests most depth may be at extremes rather than near current price
Reliability: LOW-MEDIUM — low daily volume limits price discovery quality; the wide spread is anomalous and suggests caution in using market price as a strong signal; historical range of 45-81% shows high uncertainty
4. Independent Forecaster Opus · No market price · legacy v2 Did NOT see market price
Independent estimate: 44% (42% confidence)
base rate
44%
40% conf
evidence driven
47%
40% conf
contrarian
42%
45% conf
Spread
5pp
Low disagreement
sq1: Will NAEP 8th grade Reading scores in 2026 show a statistically significant decline compared to the most recent prior assessment?
45%
Base rate: ~25% of NAEP transitions show statistically significant declines of ≥2 points. However, current context differs materially: 2019-2022 showed a -3 point drop (significant), 2022-2024 showed -1 point (likely not significant). The trend is decelerating toward flat. New framework (social studies/science texts, fully digital) introduces downside risk — students unfamiliar with new content/format could score lower, and digital-only administration has historically depressed scores in pilot studies. Cohort was in 2nd grade during COVID, a particularly vulnerable literacy-development moment. Framework change pushes UP by ~15% due to format/content disruption. Cohort vulnerability pushes UP by ~5%. Deceleration of decline pushes DOWN by ~5%. Final: ~45%.
sq2: Did US 8th grade Reading scores already show a significant decline in 2024, suggesting a continuing downward trend?
35%
The 2024 NAEP showed an 8th grade reading score of 259, down 1 point from 2022's 260. A 1-point change is typically below NAEP's statistical significance threshold (usually ~2 points for 8th grade reading given sample variance). NCES reported scores were 'lower' but whether this was flagged as statistically significant at the 8th grade level specifically is the question. Some reporting characterized the 2024 decline as significant at grade 4 but ambiguous at grade 8. Giving weight to both possibilities: ~35%.
sq3: Are there structural factors that would cause 8th grade reading scores to decline significantly between now and 2026?
55%
Structural factors clearly exist: the 2026 8th grade cohort was in 2nd grade during pandemic school closures — a critical reading-acquisition year. Screen time/phone-based childhood effects on literacy are well-documented and accumulating. Teacher shortages in literacy persist. New digital-only NAEP format introduces test-mode effects. Countervailing: tutoring programs (ESSER funding), post-COVID recovery efforts, and regression to mean. The balance of structural factors modestly favors continued decline, but 'significant' is a higher bar than 'any' decline. Estimate ~55%.
Show full reasoning trace
base rate: Historical base rate of statistically significant NAEP 8th grade reading declines is ~25% per assessment cycle. However, we're in an elevated-risk regime post-COVID with two consecutive declines (2019-2022 significant, 2022-2024 minor).
evidence updates: Framework change and digital-only shift push probability UP materially (+10-15%) due to methodological disruption. Cohort-specific COVID vulnerability pushes UP (+5%). Deceleration of decline trend (from -3 to -1 point) pushes DOWN (-5%). Recovery/intervention programs push DOWN slightly (-3%).
combination method: Weighted average per specification, with slight upward adjustment for positive correlation between sub-questions (they all bear on the same underlying reality).
final: The probability sits near 40-45%. Key tension: structural factors and framework changes favor decline, but statistical significance is a meaningful bar and the 2022-2024 trend was decelerating. Resolution ambiguity (NAEP's designation vs. point threshold) adds uncertainty pulling toward 50%. Final estimate: 44%.
ensemble: {'ensemble_count': 3, 'perspectives': {'base_rate': {'p_yes': 0.44, 'confidence': 0.4}, 'evidence_driven': {'p_yes': 0.47, 'confidence': 0.4}, 'contrarian': {'p_yes': 0.42, 'confidence': 0.45}}, 'spread': 0.05, 'individual_p_yes': {'base_rate': 0.44, 'evidence_driven': 0.47, 'contrarian': 0.42}}
5. Devil's Advocate Sonnet · legacy v2 Market price revealed
Missing Info Reasoning Flaw Asymmetric Evidence
Challenges
  1. The forecaster treats the 2026 NAEP framework change as pushing probability UP by ~15%, but this is double-edged: when NAEP changes frameworks, NCES typically conducts bridge studies and may not report year-over-year statistical significance comparisons at all, OR may re-scale to the new framework. This could make 'statistically significant decline vs. prior assessment' harder to declare, not easier. The framework change could just as easily push DOWN on the probability of a significant-decline designation.
  2. Resolution criteria ambiguity is flagged as an information gap but is not properly incorporated. If 'significant decrease' resolves based on NCES's official characterization (which requires passing their significance test at p<0.05), the bar is higher than a mere point drop. The forecaster should have decomposed: P(score drops) × P(drop is large enough to be statistically significant | drops) × P(NCES/resolver characterizes it as significant). Each of these is <1, suggesting the product may be lower than 44%.
  3. The sq2 reasoning is confused about what's being asked. The 2024 NAEP 8th grade reading decline from 2022 WAS characterized by NCES as statistically significant (the 2024 report did flag 8th grade reading as significantly lower than 2022 at the national level in some reporting, and significantly lower than 2019). The forecaster's 35% seems too low if this is verifiable fact — but also, sq2 is somewhat orthogonal to sq1 since it's about past, not 2026.
  4. The ensemble spread of 0.05 across three 'perspectives' (0.42, 0.44, 0.47) indicates false diversity — these aren't genuinely independent views, just minor variations on the same analysis. This artificially inflates confidence in the ~44% estimate.
  5. The forecaster notes 2026 NAEP was already administered (Jan 26–Mar 20, 2026), meaning scores exist but aren't yet released. The resolution timeline likely hinges on the 2026 Report Card release (typically ~9-12 months post-administration, so late 2026 or early 2027), well before the Dec 2027 close. This is actually a near-term question despite 619 days to close — but the forecaster doesn't exploit any leading indicators (e.g., state assessment data from 2025, NWEA MAP data) that might already signal direction.
Suggested adjustment: +4pp
Modest upward adjustment warranted because: (1) the 2019→2022→2024 trend of consecutive declines in an elevated-risk post-COVID regime arguably justifies a higher base rate than 25%; (2) the forecaster's treatment of the framework change as unambiguously UP is reasonable given that novel formats historically depress scores, and the cohort-specific COVID vulnerability (2nd grade during closures) is a genuinely strong structural factor that may be under-weighted at only +5%. However, the resolution ambiguity and possibility that framework changes preclude a clean significance comparison argue against moving much higher. Net: small upward nudge to ~48%, not toward the 66% market.
Market comparison: Forecaster: 44%, Market: 66%. The market has LOW volume (97 contracts/day) and anomalous wide spread ($0.998), making it a weak signal. The divergence is notable but the market's reliability is low-medium per the forecaster's own assessment. The analogous Math market at 54% is more consistent with the forecaster's estimate than with 66%, suggesting the Reading market may be overpriced or illiquid-noisy. Divergence does not clearly indicate a reasoning error.
6. Aggregator Opus · final calibrated forecast
49% (35% confidence)
My independent estimate of 44% was built on a decomposition: ~25% historical base rate of significant NAEP 8th grade reading declines, elevated to ~45% by post-COVID trend continuation, the vulnerable 2nd-grade-during-closures cohort, and the disruptive 2026 digital-only framework transition. I partially accept the critic's challenges: the framework change is genuinely double-edged (bridge studies may suppress clean significance declarations, arguing DOWN), but the sq2 fact-check that 2024 was already flagged significant vs. 2019 and the under-weighting of cohort vulnerability argue UP — netting to a modest upward nudge to ~48-49%. I reject full convergence to the 66% market because it has low daily volume (~97 contracts), an anomalous $0.998 spread indicating poor price discovery, and the parallel Math market at 54% suggests the Reading market is noisy/overpriced rather than informative. The resolution ambiguity (NCES's official significance designation vs. raw point drops) is a genuine downward pressure that the market may not be pricing.
7. Entry Decision Opus Trader
Side
NO
Position Size
$750
Contracts
2273
Trader Confidence
35%
Trade Rationale
The edge is substantial at -18% (market 67% vs. forecast 49%), pointing clearly to NO. However, forecaster confidence is low (0.35) and the Devil's Advocate flagged multiple concerns (missing_info, reasoning_flaw, asymmetric_evidence) with a suggested +0.04 upward adjustment, indicating the forecast may be understating p_yes. Market liquidity is very low (~97 contracts/day, zero orderbook depth) which reduces reliability of the price signal but also means execution risk is real. The long 619-day resolution horizon and genuine resolution ambiguity (NCES significance designation vs. raw drops) add further uncertainty, warranting a below-baseline position despite the large nominal edge.
Allocation Logic
Sized at $750 — below the $1000 baseline because low forecaster confidence (0.35), explicit critic flags, thin liquidity, and long resolution horizon all argue for caution, but the 18% edge is too large to skip entirely.
Entry price: $0.33
Current: $0.54
Status: OPEN
P&L: $477.27