← Back to scans

Will US test scores in Reading decline? — Significant decrease

KXUSTESTSREADING-26-SD · Politics · 2026-09-01
45%
Agent
49%
Market Price
-4.0%
Edge
45%
Confidence
Volume: 26,852
Spread: 4.0c
Days to resolution: 486
Markets in event: 3
Final Rationale
The Kalshi anchor of 49% (thin liquidity, wide 31-62% historical range) is roughly consistent with the historical base rate for a ≥2pt decline (~42-46%), but the critique correctly highlights that the cycle-over-cycle deltas actually show deceleration (-3 then -2 pts), and the 2025 age-13 long-term-trend data showed stagnation rather than continued decline — a genuine leading indicator pointing toward 'No.' The threshold ambiguity cuts both ways: if 'significant' means NAEP's statistical significance labeling, even a small drop could qualify, but if it requires ≥3pts (per a bucketed market structure), the base rate falls to ~25-31%. Given these offsetting considerations, a modest shade below the market anchor is justified, and both forecasters' 46% is defensible; I lean marginally lower to 45% given the stabilization signal and decelerating trend. Resolution will occur when 2026 NAEP results release in early 2027, well within the market window.
Price vs. prediction
How the market moved after the agent's call. Solid blue line is the actual market price; dashed line is the agent's static forecast at $t{=}0$.
$n = 2$ follow-ups
Re-scan Context
This market has been scanned before. Previous predictions:
DatePredictedMarket PriceConfidence
2026-08-23 41% 48% 42%
2026-04-21 49% 67% 35%
1. Planner Opus · Fermi decomposition + tool plan
Tools chosen: kalshi_direct kalshi_related claude_news wikipedia code_execution polymarket_related gdelt_news
Sub-questions (Fermi decomposition)
  1. What point-change threshold does this Kalshi market define as a 'significant decrease' in 8th-grade NAEP reading, and how does it differ from adjacent buckets (moderate decrease, no change)?
  2. What were the 8th-grade NAEP reading average scores in 2019, 2022, and 2024, and what is the recent per-cycle rate of decline?
  3. What do leading indicators (state test results 2024-25, chronic absenteeism, post-pandemic recovery data) suggest about the direction of 2026 reading scores?
  4. Is the 2026 NAEP reading assessment on schedule to be administered and reported, and could budget cuts or Department of Education restructuring delay or alter it?
  5. What is the historical base rate of cycle-over-cycle declines of the relevant magnitude in 8th-grade NAEP reading since the 1990s?
  6. How are the other outcome buckets in the KXUSTESTSREADING-26 series priced, and do they sum coherently?
Planner reasoning
This Kalshi market resolves on whether the 2026 NAEP 8th-grade reading average shows a 'significant decrease.' Key drivers are the historical NAEP trend (scores have declined steadily since 2019, including a 5-point drop in 2024), the exact point threshold Kalshi uses for 'significant decrease' vs. adjacent buckets, and any leading indicators (state assessments, chronic absenteeism, NAEP administration news). The sibling bucket prices in the same Kalshi series are the most informative cross-check.
2. Research Parallel tool calls
ToolStatusTimeItemsSummary
kalshi_direct OK 0.2s 1 ## This Market's Kalshi Data **Significant decrease** (KXUSTESTSREADING-26-SD) - Current price (probability): 49.00% - 7-day price change: +6.00% - 30-day price change: +2.00% - Average daily volume: 63 contracts - Price range: 31.00% - 62.00% - Data points: 84 days
kalshi_related OK 2.9s 1 1 related markets / summaries. series KXUSTESTSREADING: 0 markets (skipped 3 no-signal) | keyword 'NAEP': no matches | keyword 'test scores': ok | keyword 'reading': no matches
claude_news OK 30.6s 17 ## Key Findings **NAEP 2026 Schedule Status:** - NCES is preparing for the 2025-26 cycle and will administer the assessments between Jan. 26 and March 20, 2026, with math and reading in 4th and 8th grades along with U.S. history and civics for 8th graders as planned prior to March layoffs . Result
wikipedia OK 2.9s 1 Fetched 1 Wikipedia entries (0 missing pages).
code_execution OK 43.3s 0 ## Key Findings **Historical cycle-over-cycle changes (1992–2024, n=12 intervals):** - Mean change: **−0.17 points**; sample std dev: **2.48 points** (population std: 2.37) - Raw changes sequence: +3, +1, −2, +1, +1, +1, +3, −3, +2, −4, −3, −2 (last 4 cycles: 2015→2024 all show net decline except o
polymarket_related OK 2.8s 0 Scanned 100 active Polymarket markets, kept 0 matches. keyword 'NAEP': 0 markets | keyword 'test scores': 0 markets | keyword 'reading scores': 0 markets
gdelt_news OK 83.8s 20 GDELT: 20 articles across 3 queries (lookback=60d). 'NAEP 2026 reading assessment': 10 hits | 'eighth grade reading scores decline': error HTTPSConnectionPool(host='api.gdeltproject.org', port=443): Max retries exceeded with url: /api/v2/doc/doc?query=%28eighth+OR+grade+OR+reading+OR+scores+OR+decli
3. Evidence Brief Sonnet · 6864 chars
# Current state NAEP's 2026 8th-grade reading assessment was administered Jan–Mar 2026 as planned despite Education Department staffing cuts; results are due "early 2027," after which this market can resolve based on whether the score decline vs. 2024 (258) is classified "significant." No 2026 NAEP reading score has been released yet as of current research (Aug 2026 news only covers state-level tests, not NAEP). # Timeline of key events - 2019: NAEP 8th-grade reading baseline established (confirmed, pre-pandemic). - 2022-08 to 2022-10 (approx): 2022 NAEP reading results released, showing 3-point decline vs. 2019 for both 4th/8th grade (confirmed, nagb.gov). - 2025-01: 2024 NAEP reading results released — 8th grade fell 2 more points vs. 2022 (steepening from 2022's 3-pt drop); 34% scored "below basic," highest in 32 years of testing; no state improved (confirmed, nagb.gov/k12dive). - 2025-01 (long-term trend, age 13): 2025 LTT data showed reading/math stagnation vs. 2023 — no statistically significant further decline (confirmed, EdWeek). - 2025 (spring–fall): Dept. of Education layoffs cut NAEP staff to two seniors; Sec. McMahon approved waiver for 8+ new hires to meet 2026/2028 mandates; NAGB confirmed 2026 assessment on track (confirmed, NPR/ed.gov/k12dive, Sept 2025). - Late 2025: Some NAEP scope trimmed (2032 writing, 2029 long-term trend cut) but core 2026 4th/8th reading & math preserved (confirmed, k12dive). - 2026-01-26 to 2026-03-20: 2026 NAEP administration window (confirmed as completed per nagb.gov schedule page). - Early 2027 (future): 2026 NAEP reading results expected to be released — this is the key resolution event, occurring AFTER this brief's data cutoff but BEFORE market close (2027-12-31). # Event Will 8th-grade NAEP reading scores show a "significant decrease" in 2026 vs. prior cycle (2024)? # Outcomes to forecast Yes (significant decrease) / No (not a significant decrease) # Kalshi market anchor **Current YES price: 49%** for "Significant decrease." 7-day change +6%, 30-day change +2%; range 31-62% over 84 days; thin liquidity (avg 63 contracts/day). Price has drifted up recently, suggesting slight market movement toward decline. [kalshi_direct] # Sub-question answers 1. **Threshold definition** — Rules text provided contains no explicit point-threshold; the market series likely has separate buckets (e.g., "increase," "no change," "moderate decrease," "significant decrease") but exact cutoffs weren't found in research. [gap] 2. **NAEP 8th-grade reading scores** — 2019 baseline → 2022: −3 pts; 2022→2024: −2 pts (score ~258 in 2024, per code_execution calc). Cumulative decline accelerating slightly cycle-to-cycle. [nagb.gov, k12dive] 3. **Leading indicators** — Mixed/stabilizing: chronic absenteeism improved slightly since 2022 but remains above pre-pandemic levels (36% of 2022 8th-grade reading drop attributed to absenteeism); 2025 age-13 long-term-trend data showed stagnation, not further decline, versus 2023. State-level 2024 data show broad-based declines (38 states down, 0 up vs 2019). No 2025-26 state assessment data specific to NAEP-comparable 8th grade reading was found. [NAGB, EdWeek, Utah SBE, k12dive] 4. **2026 administration status** — On schedule; administered Jan 26–Mar 20, 2026 despite staffing cuts; results expected early 2027, after this data cutoff. Some scope cuts (2032/2029 assessments) but 2026 4th/8th reading preserved. [k12dive, ed.gov, NPR] 5. **Historical base rate** — Since 1992 (n=12 cycles): decline ≥2pts occurred 41.7% of cycles; decline ≥3pts occurred 25%; decline ≥5pts never occurred (0%). Recent 2015-2024 trend is steeper (slope ≈ −0.93 pts/yr), raising conditional probability of ≥2pt decline to ~42-46%. [code_execution] 6. **Other bucket pricing** — No data found; kalshi_related search returned no other markets in the KXUSTESTSREADING series (0 markets found, keyword searches for NAEP/reading returned no matches). Cannot verify coherence of bucket sum. [kalshi_related — gap] # Key facts (high-confidence, factual) 1. [nagb.gov] 2024 8th-grade reading score fell 2 pts vs 2022, which itself fell 3 pts vs 2019 — accelerating decline trend. 2. [nagb.gov/k12dive] 34% of 8th graders scored "below basic" in 2024 reading — worst in NAEP's 32-year history; decline concentrated among low performers. 3. [EdWeek, Jan 2025] 2025 long-term-trend data (age 13) showed stagnation, not further decline, vs. 2023 — a partial stabilization signal. 4. [k12dive, ed.gov, NPR] 2026 NAEP administered on schedule (Jan-Mar 2026) despite ED staffing cuts; results due early 2027. 5. [code_execution] Historical base rate of ≥2pt decline: 41.7% (12 cycles, 1992-2024); recent-momentum-adjusted estimate: ~42-46%. # Cross-market signals - Kalshi related: No other markets in KXUSTESTSREADING series found; no arbitrage/comparison markets identified. - Polymarket: Zero matching markets (NAEP, test scores, reading scores all returned 0). - Sportsbook implied: N/A (not a sports event). # Analyst opinions and speculation - NAGB vice chair Marty West expressed confidence 2026 administration would proceed smoothly, noting prep work began ~5 years prior. [NPR/k12dive] - Hechinger/EdWeek analysts attribute decline drivers (absenteeism, low-performer deterioration) as only partially resolved — implying continued but decelerating decline risk for 2026. # Directional lean per outcome - **Yes (significant decrease)**: Supported by accelerating 2019→2022→2024 decline trend, persistent elevated absenteeism, zero states improving in 2024, steep recent-era OLS slope (−0.93/yr implying further ~1.5-2pt drop by 2026). - **No (not significant decrease)**: Supported by 2025 age-13 long-term-trend stagnation (no further decline vs 2023), historical base rate showing ≥3pt declines occur only 25% of cycles and ≥5pt never, and possible measurement/administration disruption from ED cuts adding noise rather than a clean "significant" drop. # Gaps / unknowns - Exact point-threshold defining "significant decrease" vs. "moderate decrease" not found in rules or research — critical unknown for calibration. - No 2026 actual score data (won't be released until "early 2027," within market window but after current data). - No visibility into other bucket prices in the same series to cross-check implied probabilities. - No 2025-26 school-year leading indicators specific to 8th-grade reading (only Maine/Iowa general items, not NAEP-comparable). # Calibration anchors - Kalshi current YES price: **49%** (primary anchor). - Historical base rate of ≥2pt decline: 41.7%; ≥3pt: 25%; ≥5pt: 0% (1992-2024, n=12). - Model-based 2026 estimate (recent momentum): ~42-46% for ≥2pt, ~27-31% for ≥3pt decline — roughly consistent with market's 49% pricing, suggesting market is reasonably calibrated, perhaps slightly high if "significant" requires ≥3pt threshold.
4. Forecasters Opus + GPT · in parallel
claude-fable-5
0.42
Yes 46%
No 54%
The Kalshi anchor sits at 49% with recent upward drift, closely matching the historical base rate of a ≥2pt NAEP 8th-grade reading decline (41.7%) and the momentum-adjusted estimate (~42-46%). Evidence is genuinely mixed: the 2019→2022→2024 decline trend and elevated absenteeism support 'Yes,' but the 2025 age-13 long-term-trend stagnation suggests the decline may be flattening, and if 'significant' requires a ≥3pt drop the base rate falls to ~25-31%. Given the ambiguity over the threshold and the stabilization signal, I shade slightly below the market anchor to 46%. The 2026 assessment was administered on schedule, so resolution is expected in early 2027 within the market window.
gpt-5.6-sol
0.48
Yes 46%
No 54%
The Kalshi YES price of 49% is the primary anchor, though thin liquidity limits its strength. The recent sequence of 3-point and 2-point declines, persistent absenteeism, and poor low-performer outcomes support another decrease. However, the 2025 age-13 reading data showed stabilization, while historical rates are only 41.7% for a decline of at least 2 points and 25% for at least 3 points. With the exact definition of “significant decrease” unknown, I move modestly below the market rather than making a large adjustment.
5. Devil's Advocate Sonnet · red-team critique
1. Both forecasters converge suspiciously close (46% each) without independently justifying why they diverge from the 49% anchor by the same margin—this suggests anchoring bias rather than genuine independent analysis, and neither explains why 3% (not 5% or 1%) is the right adjustment. 2. Neither forecast addresses the critical threshold ambiguity with any structural approach: the brief explicitly notes "no explicit point-threshold" was found, yet both simply average across possible thresholds rather than considering that Kalshi's bucket structure (implying discrete "moderate decrease" vs "significant decrease" categories) likely sets "significant" at a specific cut like ≥3pts, which would push probability toward the 25-31% range rather than 42-46%. 3. Both forecasters underweight the administrative/measurement risk noted in the brief—ED staffing cuts reduced NAEP staff to "two seniors," and even though the assessment was administered on schedule, this introduces potential for delayed results, methodology changes, or data quality issues that could affect how "significant" is adjudicated, a scenario neither model incorporates into their uncertainty. 4. Neither forecast discusses the specific tension between the accelerating trend (2019→2022: -3pts; 2022→2024: -2pts, suggesting deceleration not acceleration despite the brief's framing) and the OLS slope estimate of -0.93pts/yr—the actual cycle-over-cycle deltas show a decelerating decline, which arguably should push probability of another "significant" (likely ≥3pt) decrease lower than both forecasts suggest. 5. Both forecasts treat the 41.7% historical base rate (≥2pt decline) as directly comparable to current conditions, but the reference class of 12 cycles since 1992 includes very different eras (pre-pandemic, stable eras) that may not generalize to the current post-pandemic recovery/stagnation regime—neither model discusses whether recent cycles (2019-2024) alone as reference class would differ from the full 32-year base rate. 6. Neither forecaster flags the "No other markets in the KXUSTESTSREADING series" gap as a meaningful limitation—without visibility into adjacent buckets (e.g., "moderate decrease"), there's no way to sanity-check whether the 49% Yes price is internally consistent with an implied "No" bucket structure, yet both treat the single Kalshi price as a fully reliable anchor despite this stated gap and thin liquidity (63 contracts/day).
6. Aggregator Opus · final calibrated forecast
45% (45% confidence)
Yes: 45% No: 55%
The Kalshi anchor of 49% (thin liquidity, wide 31-62% historical range) is roughly consistent with the historical base rate for a ≥2pt decline (~42-46%), but the critique correctly highlights that the cycle-over-cycle deltas actually show deceleration (-3 then -2 pts), and the 2025 age-13 long-term-trend data showed stagnation rather than continued decline — a genuine leading indicator pointing toward 'No.' The threshold ambiguity cuts both ways: if 'significant' means NAEP's statistical significance labeling, even a small drop could qualify, but if it requires ≥3pts (per a bucketed market structure), the base rate falls to ~25-31%. Given these offsetting considerations, a modest shade below the market anchor is justified, and both forecasters' 46% is defensible; I lean marginally lower to 45% given the stabilization signal and decelerating trend. Resolution will occur when 2026 NAEP results release in early 2027, well within the market window.
Pipeline Timing
Total pipeline time: 169.0s
Per-tool research timings shown in the Research section above.