← back to scans
Will any AI model have a score of at least 1520 before Jan 1, 2027 — At least 1520 score
54%
Agent
74%
Market Price
-19.8%
Edge
52%
Confidence
102,849
Volume
25.0c
Spread
96
Days to resolution
8
Markets in event
final rationale
Mean of 5 draws (0.50, 0.56, 0.49, 0.58, 0.58) after one crux research pass. (0) Not met yet. The primary arena.ai Text leaderboard, fetched Sep 25, 2026, shows a maximum of 1509±12 (claude-opus-5.5-high), and the page's own filter reads 'Max 1509'. The 1525–1531 figures on aggregator sites trace to stale snapshots or other configurations and do not appear on the live board. (a) About three months remain until the Jan 1, 2027 close. (b) If nothing changes, the top score stays near 1509 and the market resolves No. The top score has drifted slowly: ~1481 in February, ~1504 in March, 1509 now. (c) NO: GPT-6 Sol/Luna/Astra, Grok 4.7 and Opus 5.5 settle below 1515. Gemini 4 and any 'Claude 6' slip into 2027, and the frontier keeps its single-digit increments. Note that three September OpenAI flagships failed to beat 1509. (d) YES: a Q4 flagship (a Claude 6 or Mythos-class model, Gemini 4, or a stronger GPT-6 variant) debuts about 11+ points higher. Alternatively, a fresh model's early rating spikes above 1520 before stabilizing, which counts on any snapshot. The anchor is Kalshi's last trade at 74%, but the book is wide (48 bid / 73 ask), putting the mid near 60%. The recent jump likely reflects the Opus 5.5 launch and a crowded release window rather than a crossing. Given the verified 11-point gap and the historically slow drift, balanced against dense release cadence and noisy early ratings, I shade below the market to about 50%.
price vs. prediction
market price
agent forecast at t+0
21 follow-ups
1. Planner Opus 5.5 · picks the research tools
Tools chosen:
kalshi_direct
resolution_source
kalshi_related
polymarket_related
article_search
Planner reasoning
The question resolves on the LMSYS/LMArena text leaderboard's top score, so the main things to check are the resolution page's current top Elo and the Kalshi price. Sibling strikes in the KXAISPIKE series give the implied distribution, and Polymarket's top-model and score markets act as an independent crowd. A targeted search on recent top-score jumps shows how fast the leader's rating has been climbing.
2. Research parallel tool calls + 4 web research loops (Sonnet 5) · read raw by the forecasters
at a glance
RESEARCH DIGEST (built in code: tool summaries and each report's bottom line; the forecasters read the full tool outputs and reports)
Tools
- kalshi_direct: ## This Market's Kalshi Data **At least 1520 score** (KXAISPIKE-27B-1520) - Current price (probability): 74.00% (live; bid 48% / ask 73%) - 7-day price change: +42.00% - 30-day price change: +40.00% - Average daily volume: 1773 contracts - Price range: 16.00% - 81.00% - Data points: 58 days
- resolution_source: already_resolved=unclear; matches_criteria=True; last_updated=Sep 25, 2026. The LMSYS (arena.ai) Text Arena leaderboard as of Sep 25, 2026 shows the top model as Anthropic claude-opus-5.5-high with a score of 1509 (±12), with all other listed models scoring lower (down to 1442 and below). The stated Score Range filter also shows Max 1509. NOTE: The source reading said already NO, but the market st
- kalshi_related: 0 related markets / summaries. series KXAISPIKE: 0 markets (skipped 8 no-signal) | series KXTOPMODEL: 0 markets (skipped 12 no-signal) | keyword 'LMArena': no matches | keyword 'AI model score': no matches | keyword 'top AI model': no matches
- polymarket_related: Polymarket search over 3 keyword(s), kept 10 matches. keyword 'LMArena': 0 markets | keyword 'best AI model': 5 markets | keyword 'Chatbot Arena': 5 markets
- article_search: Fetched 11 unique articles across 2 queries (lookback=60d). 'LMArena leaderboard top Elo score new record 2026': 8 articles | 'Gemini GPT Claude Grok LMArena score 1500': 8 articles
Research loops, bottom lines
- current state: As of the most recent verified primary-source snapshot (Sep 25, 2026), the highest score on Arena's official Overall/Text leaderboard is 1509, up only modestly from ~1481 in February 2026 and ~1504 in March 2026 — a slow multi-month trajectory that leaves a ~11-point gap to the 1520 threshold with just over three months remaining before the Jan 1, 2027 close.
- base rate: The primary, currently-live Arena Text leaderboard puts the highest-ever recorded score at 1509 (Sept 25, 2026) after roughly seven months of top scores hovering in the 1490-1510 band with only single-digit gains per model generation; reaching 1520 by Jan 1, 2027 would require an unusually fast additional ~11-point jump in just over three months, which is faster than the recent historical pace, though not impossible given a new frontier release (e.g., a next Opus/GPT-6/Gemini generation).
- yes case: The strongest YES path is the sheer density of imminent frontier-model launches (GPT-6 Sol/Luna and Astra, Claude Opus 5.5 and rumored Haiku 5.5/Sonnet 5/"Claude 6", Grok 4.7, Gemini 3.8 Flash and a possible Gemini 4-class model) crowding into the very same window the "1509" snapshot was taken, combined with several of those newest entrants having only days of votes and un-stabilized ratings, plus category-specific boards (coding 1552, math 1530) already proving the underlying model quality need
- no case: Even a cluster of brand-new frontier launches in September 2026 (GPT-6 Astra/Sol/Luna) failed to move the Arena top score past 1509, the next plausible step-change models (Gemini 4, and any GPT-6 successor) have no confirmed release date before January 2027, a nearly identical market already resolved NO in Dec 2025 at single-digit trader-implied odds, and Arena's own confidence-interval and vote-window-adjustment practices show current top scores are statistically noisy and occasionally retroact
Crux follow-up
- Directly fetching the primary arena.ai Text leaderboard (Sep 25, 2026) confirms the max score is 1509±12 (claude-opus-5.5-high), with the page's own "Max" filter corroborating this as the true ceiling across all 409 models — the 1525–1531/1550 figures circulating in aggregators trace to stale, pre-Opus-5.5 snapshots or a different (style-control) configuration not used for resolution. This strongly favors the No-leaning forecasters' read that the market is 11 points short and that Kalshi's 74% l
tools
| tool | status | time | items | summary |
|---|---|---|---|---|
| kalshi_direct | OK | 0.2s | 1 | ## This Market's Kalshi Data **At least 1520 score** (KXAISPIKE-27B-1520) - Current price (probability): 74.00% (live; bid 48% / ask 73%) - 7-day price change: +42.00% - 30-day price change: +40.00% - Average daily volume: 1773 contracts - Price range: 16.00% - 81.00% - Data points: 58 days |
| resolution_source | OK | 5.4s | 1 | already_resolved=unclear; matches_criteria=True; last_updated=Sep 25, 2026. The LMSYS (arena.ai) Text Arena leaderboard as of Sep 25, 2026 shows the top model as Anthropic claude-opus-5.5-high with a score of 1509 (±12), with all other listed models scoring lower (down to 1442 and below). The stated |
| kalshi_related | OK | 2.4s | 0 | 0 related markets / summaries. series KXAISPIKE: 0 markets (skipped 8 no-signal) | series KXTOPMODEL: 0 markets (skipped 12 no-signal) | keyword 'LMArena': no matches | keyword 'AI model score': no matches | keyword 'top AI model': no matches |
| polymarket_related | OK | 0.5s | 10 | Polymarket search over 3 keyword(s), kept 10 matches. keyword 'LMArena': 0 markets | keyword 'best AI model': 5 markets | keyword 'Chatbot Arena': 5 markets |
| article_search | OK | 0.6s | 11 | Fetched 11 unique articles across 2 queries (lookback=60d). 'LMArena leaderboard top Elo score new record 2026': 8 articles | 'Gemini GPT Claude Grok LMArena score 1500': 8 articles |
research loops
·
4/4 ok ·
18 searches ·
8 page reads
| dimension | status | time | searches | page reads | report |
|---|---|---|---|---|---|
| current state | OK | 45s | 5 | 2 | 4447 chars |
| base rate | OK | 42s | 3 | 3 | 4191 chars |
| yes case | OK | 58s | 6 | 1 | 6496 chars |
| no case | OK | 56s | 4 | 2 | 5332 chars |
report: current state
- [2026-09-25] The official Arena (formerly LMSYS/LMArena) Text Arena leaderboard, fetched directly, shows the score range as
Min953 · Max1509
, with the #1 model listed as
Sep 25, 2026 · 8,528,723 votes · 409 models
— the top-scoring model, claude-opus-5.5-high, sits at 1509±12, still 11 points short of 1520.
- [2026-09-27] Rank #2-4 on the same live board cluster tightly just under the top score: claude-opus-4-6-high (1505), claude-fable-5-high (1504), and claude-opus-4-7-high (1502), confirming no model on the primary overall Text Arena leaderboard has yet crossed 1510, let alone 1520, as directly observed on arena.ai/leaderboard/text.
- [2026-03-05] A third-party archive (Grokipedia) recorded the top score at just 1504 Elo in early March 2026, indicating the top score gained roughly only 5 points from March to September 2026 on the primary board.
- [2026-02-01] A related Manifold market description notes that
this market resolves YES if any model gets at least that option's arena score... Start of February 2026, highest score is 1481
, indicating growth of about 28 points (1481→1509) over roughly 8 months (Feb–Sep 2026), or under 4 points/month on average.
- [2025-12-31] A near-identical Manifold market asking whether any model would reach 1520 by Dec 31, 2025
Resolved NO. This market will resolve to Yes if any model on the Chatbot Arena LLM Leaderboard at https://lmarena.ai/ reaches an Arena Score of at least 1520.0 (≥1520) in the Overall / General category by December 31, 2025
— confirming the overall board had not reached 1520 even by end of 2025.
- [2026-09-01] Arena's own monthly leaderboard-snapshot index shows recent update dates of
September 16, 2026 · September 1, 2026 · September 1, 2026 · August 24, 2026 · August 14, 2026
, indicating the site refreshes scores roughly every 1-3 weeks, so there is ample time for more snapshots before the Jan 1, 2027 close.
- [2026-08-01] Some independent (non-primary) trackers claim higher figures — e.g., one site states
As of August 2026, Claude Fable 5 holds #1 on the overall text leaderboard at roughly 1525 ELO. Arena re-baselined its score on July 12 to count only votes cast since its July 1 restoration
— but this figure is not corroborated by the directly-fetched official arena.ai page (which shows claude-fable-5-high at only 1504 on Sep 25, 2026), suggesting these third-party SEO/aggregator claims of ~1525-1531 are unreliable or based on a stale/mistaken snapshot.
- [2026-09-26] A separate aggregator (swfte.com, updated Sep 26, 2026) similarly lists inflated figures (Claude Fable 5 "1525", Claude Mythos 5 "1531") that do not match any model names/scores present on the actual arena.ai live leaderboard fetched the same week, reinforcing that the official primary leaderboard remains the authoritative source and sits below 1520.
- [2026-09-01] Sub-category boards (not the "Overall" board referenced by prior similar markets) do show higher numbers — e.g.,
Arena coding Elo, claude-opus-4-7-high (anthropic) currently leads with an Elo of 1552
and
The current Arena math leader is claude-fable-5 (anthropic) at 1530 rating points
— but these are specialized (coding/math) leaderboards, distinct from the general "Overall" LMSYS/Arena leaderboard that comparable prior markets have used for resolution.
- [2026-03-31] Arena's official blog confirms ongoing active leaderboard expansion and new model additions each month, e.g.,
March 2026 brought major updates to the Arena leaderboard, including new rankings across document, video, text, and code models
, indicating frequent new flagship model releases could still push the overall score higher before Jan 2027.
BOTTOM LINE: As of the most recent verified primary-source snapshot (Sep 25, 2026), the highest score on Arena's official Overall/Text leaderboard is 1509, up only modestly from ~1481 in February 2026 and ~1504 in March 2026 — a slow multi-month trajectory that leaves a ~11-point gap to the 1520 threshold with just over three months remaining before the Jan 1, 2027 close.
NOT FOUND: An official Arena/LMSYS blog post or press statement explicitly confirming any model has reached ≥1520 on the Overall/Text leaderboard; a reliable historical time-series (day-by-day) directly from arena.ai showing the exact rate of top-score increase; confirmation of the specific model name/version behind the disputed "1525-1531" figures reported by some third-party aggregators.
report: base rate
- [2026-09-25] The official Arena (formerly LMSYS Chatbot Arena) Text leaderboard, fetched directly from arena.ai/leaderboard/text, shows the current top model is claude-opus-5.5-high at a score of 1509±1, with the platform's own displayed score range topping out at "Max 1509" across 409 ranked models and 8.5M+ votes. https://arena.ai/leaderboard/text
- [2026-09-22] Claude Opus 5.5 launched days before this snapshot and immediately became the new #1, i.e., the highest score the reference leaderboard has ever recorded is currently 1509 — 11 points short of the 1520 threshold. https://arena.ai/leaderboard/text
- [2026-02-26] Historical trend shows the top Elo climbing slowly and staying clustered: in late February 2026 the leaderboard leaders were reported around 1500-1503 Elo, with a tight pack of frontier labs (Anthropic, Google, OpenAI, xAI) all within a few points of each other. https://www.buildmvpfast.com/blog/claude-opus-4-6-lmsys-arena-benchmark-comparison-2026
- [2026-04-06] By April 2026 several secondary trackers described the top tier as having "crossed the 1500 Elo barrier," but even these more bullish secondary sources put the absolute top score only around 1504, not 1520. https://aidevdayindia.org/blogs/lmsys-chatbot-arena-current-rankings/lmsys-chatbot-arena-current-rankings.html
- [2026-05-02] One tracker noted the top-3 models (1500-1504) were "statistically tied" within overlapping confidence intervals, and that five-plus models rotate the #1 slot week to week — evidence that gains at the frontier are incremental (single-digit points) rather than large jumps. https://agileleadershipdayindia.org/blogs/lmsys-chatbot-arena-rankings/current-top-models-lmarena.html
- [2026-09-27 review] Several third-party aggregator/SEO sites (e.g., swfte.com, localaimaster.com) reported much higher numbers for August/September 2026 (~1522-1580 Elo for Claude Opus 5 / Mythos 5 / Fable 5), but these figures are inconsistent with the primary arena.ai leaderboard fetched the same week (max 1509) and appear to be unreliable/outdated or auto-generated estimates rather than verified Arena data — underscoring that secondary "leaderboard" content should not be trusted over the primary source. https://www.swfte.com/lmarena
- [2026-09-16] Arena's own blog cadence (leaderboard changelog, new model announcements roughly every 2-4 weeks: Sept 1, Sept 16, Aug 24, Aug 14 entries) shows the platform actively re-ranks as new frontier models (Claude family, GPT-5.x/6, Gemini 3.x, Grok 4.x, Kimi K3) launch, each typically adding only a handful of Elo points at the very top rather than double-digit jumps. https://arena.ai/leaderboard
- [2026-06-10] A June 2026 snapshot from a different tracker described "the top eight models... clustered within ~55 Elo points, the tightest spread on record," consistent with the pattern of small, incremental gains at the frontier rather than rapid ascents past round-number barriers like 1500 or 1520. https://presenc.ai/research/chatbot-arena-elo-leaderboard-june-2026
- [2026-09-27] Historically, the LMSYS/Arena #1 spot has changed hands roughly 19 times since May 2023, with new top models typically adding modest rating increments each cycle (per a leaderboard-history tracker), rather than crossing large score thresholds abruptly. https://benchlm.ai/llm-leaderboard-history
BOTTOM LINE: The primary, currently-live Arena Text leaderboard puts the highest-ever recorded score at 1509 (Sept 25, 2026) after roughly seven months of top scores hovering in the 1490-1510 band with only single-digit gains per model generation; reaching 1520 by Jan 1, 2027 would require an unusually fast additional ~11-point jump in just over three months, which is faster than the recent historical pace, though not impossible given a new frontier release (e.g., a next Opus/GPT-6/Gemini generation).
NOT FOUND: No official Arena/LMSYS statement addressing "1520" as a specific milestone; no confirmed instance in the primary leaderboard data of any model reaching or exceeding 1520 as of the last fetch (Sept 25, 2026); could not verify the higher (1522-1580) scores cited by third-party aggregator sites against any primary source.
report: yes case
- [2026-09-25] The Arena leaderboard changelog (arena.ai's own primary changelog, fetched directly) shows that on the very same day the colleague reports captured "top score 1509," five brand-new frontier models — **deepseek-v4.1-flash-max, grok-4.7-xhigh, gpt-6-sol-max, gpt-6-luna-max, and claude-opus-5.5-high** — were simultaneously added to the Text Arena leaderboard, meaning the current #1 score is based on only hours-to-days of votes for several of the newest contenders, not a stabilized rating. https://arena.ai/company/leaderboard-changelog
- [2026-09-25] The same changelog shows OpenAI's **GPT-6 Sol (Max)** was added to the Agent Arena leaderboard the same day it hit Text Arena, confirming a brand-new, previously-untested flagship (distinct from GPT-6 Astra) entered the arena pool with fresh, still-uncertain Elo just as the question window narrows — an under-scored newcomer is exactly the kind of event that has historically produced Arena's biggest single-model rating jumps. https://arena.ai/company/leaderboard-changelog
- [2026-09-03] OpenAI's GPT-6 Astra, a full pretrain-from-scratch flagship, launched only 24 days before the changelog snapshot; independent evaluators noted
GPT-6 Astra "has an ECI score of 167 and ranks 1st of 251 tracked models"
on Epoch AI's independent capability index, and Artificial Analysis found
"GPT-6 Astra scores ~90 Elo points above GPT-5.6 Sol in AA-Briefcase"
— evidence the newest OpenAI model is a genuine capability jump on agentic/long-horizon tasks even though its Arena Text score has not yet caught up. https://epoch.ai/models/gpt-6-astra , https://artificialanalysis.ai/articles/benchmarking-gpt-6-astra
- [2026-09-22] Anthropic released **Claude Opus 5.5** just five days ago (relative to the colleagues' Sept 25/27 snapshots) at a much lower price point
"Anthropic released Claude Opus 5.5 on September 22, 2026. The new flagship model costs 20 dollars per million output tokens, 20% less than Opus 5, and generates responses 30% faster"
— this is the very model currently sitting at the observed 1509 ceiling, meaning that score itself is only ~3 days deep into vote-accumulation, before confidence intervals typically tighten upward.
- [2026-09-27] A tracker of leaked/rumored next-generation signals notes that on the same day Opus 5.5 launched,
"developers spotted the string 'GPT-6 Sol medium' inside the public merge logs of an Nvidia repository, the first concrete technical clue about OpenAI's next model"
, and confirms
"OpenAI has since officially launched GPT-6 Sol and Luna, with prices cut in half"
— showing the OpenAI-Anthropic release cadence has compressed to single-digit-day intervals, leaving over three months (13+ more release cycles at this pace) before the Jan 1, 2027 deadline.
- [2026-09-27] Rumor trackers report unconfirmed leaks of further near-term Anthropic releases, including
"rumors are already circling around Claude Haiku 5.5, with a leak placing it above Opus while Anthropic only confirms it is coming"
and references to a "Claude Mythos" next iteration and "Sonnet 5 Coming Soon," indicating Anthropic's pipeline has multiple additional model drops queued that could each nudge the Arena ceiling upward before year-end.
- [2026-09-27] A dedicated Manifold tracker for the next full generation shows the market currently assigns high odds to an even bigger jump:
"94% chance by Feb 2027 interesting, we expect acceleration based on public info (e.g. compute purchases)"
for the release of a "Claude 6" family model, which — given Opus/Fable/Mythos generational jumps have historically each added meaningful single-digit-to-double-digit Elo — would be a plausible, if not certain, mechanism to cross 1520 if it lands before Jan 1, 2027.
- [2026-09-27] Category-specific Arena boards, run on the identical underlying vote infrastructure as the Overall/Text board, already show scores well past the 1520 threshold:
"According to Arena coding Elo, claude-opus-4-7-high (anthropic) currently leads with an Elo of 1552"
and
"The current Arena math leader is claude-fable-5 (anthropic) at 1530 rating points"
— demonstrating that Anthropic models already exceed 1520 in specific vote pools, so a shift in the Overall board's category-mix, prompt distribution, or a strong new release could realistically pull the aggregate Overall score above 1520 without requiring an unprecedented capability leap.
- [2026-09-16] Google added **Gemini 3.8 Flash (High)** to the Text Arena leaderboard on September 2, and Google's release cadence for the Gemini 3.x line has been rapid throughout 2026 (3.1, 3.5, 3.7 Flash, 3.8 Flash), with a full "Gemini 3.5 Pro" or next Deep Think-class flagship plausible before January 2027 given
"The Gemini 3 Pro model was released seven months after the previous Gemini 2.5 Pro/Flash model"
— implying a Gemini 4-class model could plausibly land by Q4 2026/Q1 2027, adding another independent shot at crossing 1520.
- [2026-09-27] Historical top-score momentum shows real acceleration at the point of new-flagship launches rather than pure gradual drift: Gemini 3 Pro's debut alone
"tops the LMArena Leaderboard with a breakthrough score of 1501 Elo"
was itself described internally by Google as a "breakthrough," illustrating that a single well-received flagship launch can move the ceiling several points in one step rather than the ~1 point/week average implied by smoothed trend lines.
BOTTOM LINE: The strongest YES path is the sheer density of imminent frontier-model launches (GPT-6 Sol/Luna and Astra, Claude Opus 5.5 and rumored Haiku 5.5/Sonnet 5/"Claude 6", Grok 4.7, Gemini 3.8 Flash and a possible Gemini 4-class model) crowding into the very same window the "1509" snapshot was taken, combined with several of those newest entrants having only days of votes and un-stabilized ratings, plus category-specific boards (coding 1552, math 1530) already proving the underlying model quality needed to clear 1520 exists — all pointing to real, if uncertain, upside before Jan 1, 2027.
NOT FOUND: No confirmed exact Arena Text score for GPT-6 Sol/Luna/Astra, Grok 4.7, or Claude Opus 5.5 subsequent to their addition dates (the changelog documents additions but not point-in-time scores); no official Anthropic/OpenAI confirmation of a release date for "Claude 6" or "GPT-6 Terra/Bel" before Jan 2027; could not verify whether Arena's Overall/Text score for newly-added models systematically trends up or down as vote counts mature.
report: no case
- **[2026-09-25]** The official Arena leaderboard changelog shows GPT-6 Astra (Max) was added to the Text Arena on Sept 11, 2026, and GPT-6 Sol (Max) and GPT-6 Luna (Max) were added to the Text Arena on Sept 25, 2026 — three brand-new frontier-class OpenAI releases within a two-week span — yet the same-week snapshot still shows the top score stuck at 1509 (claude-opus-5.5-high), not a new OpenAI model, showing that even multiple simultaneous flagship launches failed to break the 1510 mark, let alone 1520. (https://news.lmarena.ai/leaderboard-changelog/)
- **[2025-12-31]** An essentially identical Manifold market asking whether any model would reach ≥1520 by Dec 31, 2025 closed at only a 3% final trader-implied probability before resolving NO, indicating that informed forecasters saw this threshold as a long-shot even a year ago, and it still failed. (https://manifold.markets/Waterfalls/any-model-on-the-chatbot-arena-llm)
- **[2026-07-12]** Arena's own changelog documents that claude-fable-5's scores were altered on July 12, 2026 to reflect "only votes collected on or after July 1" for several sub-leaderboards — a precedent showing Arena can and does retroactively adjust/deflate a leading model's score through vote-window changes, adding downside risk to any model that briefly nears 1520. (https://news.lmarena.ai/leaderboard-changelog/)
- **[2026-07-21]** Google DeepMind's own statement said it had merely "started our most ambitious pre-training run yet, for Gemini 4," with no release date, model ID, or API entry published as of Sept 16, 2026 — meaning the next Google model plausibly capable of a large Elo jump is not coming before Jan 2027 on current public information. (https://cellcog.ai/blog/gemini-4-release-date/)
- **[2026-09-17]** Independent trackers explicitly debunked viral claims that a "gemini-3.8-flash" checkpoint in Arena battle mode was a hidden Gemini 4 Pro, confirming "Arena's leaderboard carries no Gemini 4 entry, Arena has said nothing, Google has said nothing" — undercutting the bull case that an unannounced super-model is already quietly lifting scores. (https://cellcog.ai/blog/gemini-4-release-date/)
- **[2026-05-27]** A methodology review notes that "top-3 models routinely sit within overlapping 95% confidence intervals" with intervals spanning "±15–20 points," meaning the current #1 (1509) statistically overlaps with #2-4 models in the high-1490s/1500s rather than showing a clean, accelerating climb toward 1520. (https://www.digitalapplied.com/blog/llm-benchmark-methodology-2026-contamination-leaderboard-guide)
- **[2026-06-12]** An independent June 2026 snapshot described the top eight models as clustered within roughly 55 Elo points, "the tightest spread on record" (per the base-rate report), consistent with a June 2026 tracker's finding of frontier labs converging rather than any lab breaking away with a step-change score.
- **[2026-06-12]** A benchmark-methodology site adds that Arena "reports 95 percent confidence intervals alongside point estimates" and that intervals "can be 30 Elo or more" for lower-volume models, meaning a nominal crossing of 1520 by a freshly-added model could itself be statistically indistinguishable from 1509 and slow to "confirm." (https://benchmarkingagents.com/chatbot-arena/)
- **[2026-04-02]** Arena's own dataset blog post states that "the mean score of the leading models has risen from a little over 1,000 to nearly 1,500" since May 2023 — nearly three years to gain ~500 points (~14/year average) — while the market needs an additional 11+ points in just over three months, a pace far above the multi-year historical average even though recent-model cycles have been faster. (https://arena.ai/blog/arena-leaderboard-dataset)
- **[2026-09-24]** Arena itself changed its public leaderboard presentation on Sept 24, 2026, launching "a fully redesigned leaderboard overview page," which introduces near-term display/methodology churn risk that could complicate or delay any clean "≥1520" reading being visible in the way earlier markets defined it. (https://news.lmarena.ai/leaderboard-changelog/)
- **[2026-09-16]** Wikipedia's Gemini article lists the latest "stable release" as only "3.8 Flash" (a lightweight variant, Sept 2, 2026), not a new flagship Pro/Ultra model, reinforcing that Google's most recent shipped update was not the kind of frontier jump needed to threaten 1520. (https://en.wikipedia.org/wiki/Google_Gemini)
BOTTOM LINE: Even a cluster of brand-new frontier launches in September 2026 (GPT-6 Astra/Sol/Luna) failed to move the Arena top score past 1509, the next plausible step-change models (Gemini 4, and any GPT-6 successor) have no confirmed release date before January 2027, a nearly identical market already resolved NO in Dec 2025 at single-digit trader-implied odds, and Arena's own confidence-interval and vote-window-adjustment practices show current top scores are statistically noisy and occasionally retroactively lowered — all of which argue for continued NO through the Jan 1, 2027 deadline.
NOT FOUND: Any confirmed release date for Gemini 4 or a "GPT-7"-class model before Jan 2027; any primary Arena statement treating 1520 as a meaningful/targeted milestone; a verified explanation reconciling the third-party ~1522-1531 aggregator figures with the primary site's 1509 max.
3. Forecasters 5 draws · Opus 5.5 + GPT-5.6 Sol · plain mean · re-drawn after crux research
crux research
The first round disagreed: the draws' mean 0.57 sits 0.17 from the same-question market "this kalshi market" at 0.74.
One more research loop went after the crux and every draw below was redone with its report.
first-round draws:
55%, 55%, 45%, 68%, 63%
· crux loop: 4 searches, 1 page reads
report: crux
CRUX: The single decisive fact is what the *current, primary* Arena (formerly LMSYS) Text leaderboard actually shows as its maximum score right now — because if it is genuinely ~1509 (11 points short), the market is priced well above fundamentals (74% vs. a No-leaning gap), whereas if a 1525–1531 "aggregator" figure is real and countable, the market is already close to resolving Yes.
- **Sep 25, 2026 (primary source, arena.ai/leaderboard/text, fetched directly):**
"The model debuted at the number one position on the competitive leaderboard with a score of 1509 plus or minus 12 points, making it the highest-ranked text-to-text model"
— this is claude-opus-5.5-high, and the live page's own filter panel independently displays a hard "Max 1509" cap across all 409 ranked models, confirming no model exceeds 1509 on the official Text Arena board as of that date.
- **Sep 22, 2026 launch:**
"The model launched on September 22, 2026, and within three days had already established itself as the benchmark other frontier models need to beat."
- **Confidence interval / stability:**
"The plus-or-minus 12 confidence interval suggests the ranking is statistically robust even at this early stage."
- **Third-party "1525" claim traced to stale data:** an independent guide states
"As of August 2026, Claude Fable 5 holds #1 on the overall text leaderboard at roughly 1525 ELO. Arena re-baselined its score on July 12 to count only votes cast since its July 1 restoration, and it settled back on top."
This figure is from an August snapshot predating the September 22 Opus 5.5 launch, and Claude Fable 5 does not appear at 1525 on the September 25 primary board (it shows claude-fable-5-high at 1504) — the "1525" number appears superseded/stale, not a live current reading.
- **Another mirror site shows even older/stale numbers:** a third-party mirror lists
"Highest value: Claude Opus 5 at 1504"
and a style-control variant lists
"Highest value: Claude Opus 4.6 at 1550"
— both reference older model generations (Opus 4.6/Opus 5) that have since been superseded by Opus 5.5, confirming these are cached/outdated snapshots rather than the live board.
- **Resolution-methodology nuance:** related Kalshi Arena-based markets instruct traders to
"Outcome verified from LM Arena Leaderboard (Remove Style Control)... Important information: When checking the source for this market, check the 'Remove Style Control' toggle."
The "1550" Style-Control figure is therefore not the relevant configuration even if it were current; the no-style-control ("overall") reading — currently 1509 — is the operative one.
- **Trend context confirms slow climb, not a jump to 1525+:** independent trackers describe the board move from
"Opus 4.6 and Opus 4.6 Thinking share the top with scores of 1503. Gemini 3.1 Pro Preview sits at #3 with 1500"
in February to 1509 by late September — a slow multi-month drift, not evidence of a board already past 1520.
BOTTOM LINE: Directly fetching the primary arena.ai Text leaderboard (Sep 25, 2026) confirms the max score is 1509±12 (claude-opus-5.5-high), with the page's own "Max" filter corroborating this as the true ceiling across all 409 models — the 1525–1531/1550 figures circulating in aggregators trace to stale, pre-Opus-5.5 snapshots or a different (style-control) configuration not used for resolution. This strongly favors the No-leaning forecasters' read that the market is 11 points short and that Kalshi's 74% last price is stale/overpriced relative to the verified primary-source gap, though a genuine ~11-point jump remains plausible given the dense Q4 release cadence.
NOT FOUND: The exact wording of this specific Kalshi contract's rules regarding whether "Style Control" should be toggled on/off (only analogous Kalshi Arena markets' rules were found, not this exact 1520-threshold market's own rulebook), and no direct primary-source confirmation of any model scoring 1525+ on the current no-style-control Text board.
claude-opus-5-5
45% conf
| Yes | 50% |
| No | 50% |
(0) Not met yet. The primary arena.ai Text leaderboard, fetched Sep 25, 2026, shows a maximum of 1509±12 (claude-opus-5.5-high), and the page's own filter reads 'Max 1509'. The 1525–1531 figures on aggregator sites trace to stale snapshots or other configurations and do not appear on the live board. (a) About three months remain until the Jan 1, 2027 close. (b) If nothing changes, the top score stays near 1509 and the market resolves No. The top score has drifted slowly: ~1481 in February, ~1504 in March, 1509 now. (c) NO: GPT-6 Sol/Luna/Astra, Grok 4.7 and Opus 5.5 settle below 1515. Gemini 4 and any 'Claude 6' slip into 2027, and the frontier keeps its single-digit increments. Note that three September OpenAI flagships failed to beat 1509. (d) YES: a Q4 flagship (a Claude 6 or Mythos-class model, Gemini 4, or a stronger GPT-6 variant) debuts about 11+ points higher. Alternatively, a fresh model's early rating spikes above 1520 before stabilizing, which counts on any snapshot. The anchor is Kalshi's last trade at 74%, but the book is wide (48 bid / 73 ask), putting the mid near 60%. The recent jump likely reflects the Opus 5.5 launch and a crowded release window rather than a crossing. Given the verified 11-point gap and the historically slow drift, balanced against dense release cadence and noisy early ratings, I shade below the market to about 50%.
claude-opus-5-5
42% conf
| Yes | 56% |
| No | 44% |
(0) Not resolved. The primary arena.ai Text leaderboard, fetched Sep 25, 2026, shows a maximum of 1509±12 (claude-opus-5.5-high), 11 points short of 1520. The 1525–1531 figures on aggregator sites look stale or wrong. One real unknown remains: related Kalshi Arena markets resolve on the 'Remove Style Control' view, and this contract's rules do not specify a view. The no-style-control number could differ from the default 1509, possibly upward, which may be part of why the market jumped. (a) About three months remain until Jan 1, 2027. (b) Status quo is No: if the board freezes at 1509, the market resolves No. (c) No scenario: GPT-6 Sol/Luna/Astra settle below Opus 5.5, Gemini 4 does not ship before 2027, and incremental releases add only a few points, so the top stays in the 1505–1515 band; a nearly identical market already failed in 2025. (d) Yes scenario: fresh ratings for models added Sep 25 drift upward, or another Anthropic/OpenAI release in Q4 adds a few points. Given the pace (~1481 in Feb to 1509 in Sep, roughly 4 points/month, with launches every few weeks), 11 points in three months is roughly a coin flip. The Kalshi last price of 74% sits on a wide 48/73 spread, so the midpoint is nearer 60%. The +42% weekly move likely reflects the Opus 5.5 and GPT-6 launches rather than a verified crossing. I shade slightly below the midpoint because the verified primary-source gap is 11 points, with modest upside for the style-control ambiguity.
claude-opus-5-5
42% conf
| Yes | 49% |
| No | 51% |
(0) Resolution check: the condition has not been met. The primary arena.ai Text leaderboard, fetched Sep 25, 2026, shows a maximum of 1509±12 (claude-opus-5.5-high), and the page's own Max filter confirms it. The 1525–1531 figures from aggregators trace to stale pre-Opus-5.5 snapshots or to the style-control view, so a Yes still needs some model to gain about 11 more points. (a) About three months remain until the Jan 1, 2027 deadline. (b) Status quo is No: the top score has drifted only from ~1504 in March to 1509 now. September's cluster of OpenAI releases (GPT-6 Astra, Sol, Luna) did not break 1510, and an identical 1520 market resolved No at end-2025. (c) No: Opus 5.5's early score settles or slips, as debut scores often do. Gemini 4 and Claude 6 then miss 2026, and incremental releases add only a few points each. (d) Yes: a late-Q4 flagship (a Claude 6-class model, a stronger GPT-6 variant, or a surprise Gemini) debuts 10+ points higher. Alternatively, a style-control or board-configuration reading counts for resolution. Category boards (coding 1552, math 1530) show the capability exists, and release cadence is dense. The market anchor is a 74% last trade but a wide 48/73 book (mid ~60), and the price jumped 42 points in a week, possibly on information I can't see. Against that, the verified 1509 ceiling and the slow trend pull me below the mid, to roughly a coin flip.
gpt-5.6-sol
64% conf
| Yes | 58% |
| No | 42% |
(0) The condition has not already been met: the official Arena Text leaderboard dated Sep 25 shows a maximum of 1509 for claude-opus-5.5-high, 11 points below 1520, while higher third-party figures appear stale or tied to a different configuration. (a) Roughly three months remain before Jan 1, 2027, during which Arena should publish several more leaderboard updates. (b) If nothing changes, the maximum remains 1509 and the market resolves No. (c) No results if the recently added GPT-6 and Claude models stabilize below 1520 and no stronger Q4 flagship arrives, consistent with the leaderboard gaining only about five points since March. (d) Yes results if one of the numerous new or forthcoming frontier models produces an 11-point step-up, or if the newly launched Opus 5.5 rises as additional votes accumulate. Kalshi's 74% Yes price is the anchor, but I discount it because the directly fetched resolution source firmly contradicts claims that the board is already near 1525-1531, while the unusually wide 48%-73% bid-ask spread suggests the displayed price is not a strong consensus. I still favor Yes modestly because 11 points is attainable in one strong release and several independent labs have opportunities before year-end, although uncertainty about the contract's exact style-control configuration remains.
gpt-5.6-sol
67% conf
| Yes | 58% |
| No | 42% |
(0) The condition has not already been met: the official Arena Text leaderboard showed a maximum of 1509 on Sep. 25, 2026, 11 points below 1520, while higher third-party figures appear stale or use different leaderboard settings. (a) Roughly 95 days remain before Jan. 1, 2027, allowing several leaderboard updates and model launches. (b) If nothing changes, the current 1509 maximum remains below the threshold and the market resolves No. (c) No results if recently added frontier models stabilize below 1520 and no stronger Q4 release produces an 11-point jump, consistent with the modest rise from about 1504 in March to 1509 in September. (d) Yes results if Claude Opus 5.5 rises as its early rating stabilizes or one of the densely scheduled OpenAI, Anthropic, Google, xAI, or DeepSeek releases debuts at 1520 or above. I price Yes below Kalshi's 74% anchor because the authoritative source disproves the apparent 1525-1531 readings and the venue's unusually wide 48%-73% bid-ask spread weakens the last-price signal, although the remaining release cadence and the roughly 11-point gap keep Yes slightly favored.
4. Final plain mean of 5 draws · second round
54%
(52% confidence)
Yes: 54%
No: 46%
Mean of 5 draws (0.50, 0.56, 0.49, 0.58, 0.58) after one crux research pass. (0) Not met yet. The primary arena.ai Text leaderboard, fetched Sep 25, 2026, shows a maximum of 1509±12 (claude-opus-5.5-high), and the page's own filter reads 'Max 1509'. The 1525–1531 figures on aggregator sites trace to stale snapshots or other configurations and do not appear on the live board. (a) About three months remain until the Jan 1, 2027 close. (b) If nothing changes, the top score stays near 1509 and the market resolves No. The top score has drifted slowly: ~1481 in February, ~1504 in March, 1509 now. (c) NO: GPT-6 Sol/Luna/Astra, Grok 4.7 and Opus 5.5 settle below 1515. Gemini 4 and any 'Claude 6' slip into 2027, and the frontier keeps its single-digit increments. Note that three September OpenAI flagships failed to beat 1509. (d) YES: a Q4 flagship (a Claude 6 or Mythos-class model, Gemini 4, or a stronger GPT-6 variant) debuts about 11+ points higher. Alternatively, a fresh model's early rating spikes above 1520 before stabilizing, which counts on any snapshot. The anchor is Kalshi's last trade at 74%, but the book is wide (48 bid / 73 ask), putting the mid near 60%. The recent jump likely reflects the Opus 5.5 launch and a crowded release window rather than a crossing. Given the verified 11-point gap and the historically slow drift, balanced against dense release cadence and noisy early ratings, I shade below the market to about 50%.
Pipeline Timing
Total pipeline time: 182.3s
Per-tool research timings shown in the Research section above.