StandardsAboutContact
The Weights
GDPx: no AI agent tops 12% on real-work tasks

GDPx: no AI agent tops 12% on real-work tasks

SemiAnalysis' GDPx scores Claude Opus 5.5 at 12.0 percent across 206 tasks. The cost and grading caveats matter as much as the rank.

No model clears 12 percent on SemiAnalysis' GDPx, and the benchmark is better read as a map of agent weaknesses than a ranking. Claude Opus 5.5 leads at 12.0 percent, with Gemini 4 Carbon at 10.9 percent and a third of the cost per task, but small per-domain samples limit precision.

The Weights Desk · 4 min read

Signal. SemiAnalysis' GDPx, released in early November 2026, finds that no frontier AI agent completes more than 12 percent of its simulated professional work, with Claude Opus 5.5 on top at 12.0 percent. The benchmark spans 206 tasks in 11 domains, from chip design to quant trading. The absolute level is the story: the ordering among the top three is within what small samples can blur, but the distance from reliable autonomous work is not.

What the leaderboard actually shows

The GDPx v1.0 leaderboard ranks 13 models, led by Claude Opus 5.5 at 12.0 percent and $51.41 per task. Gemini 4 Carbon follows at 10.9 percent and $16.29, and GPT-6 Astra at 9.6 percent and $53.99. At the low end, GPT-6 Luna and DeepSeek 4.1 Flash 1017 score 5.1 and 5.4 percent at under $1 per task. SemiAnalysis lists output tokens too, so cost and verbosity can be compared directly.

How the score is built

The headline number is an equal-weighted average over 11 domains, and over partners within each domain, using each task's intended grading method and three attempts. SemiAnalysis says its default limit is eight hours, and that models run in their native harness where one exists, such as Claude Code for Opus 5.5. Finance and legal use partial credit because, The Decoder reports, strict pass/fail would leave no model with a completed task.

Where the ranking is weakest

The top-three ordering is fragile. Developer Josh Purtell, quoted by The Decoder, calls GDPx more noise than signal, citing sub-domains with about ten tasks and per-provider harnesses that favor stronger tooling. The Decoder also reports that law and hardware design are graded against rubrics by language models, and that one example task per partner is usually public, so outsiders cannot fully audit difficulty. Keeping tasks secret does limit training on the test.

Safety filters change the picture

According to The Decoder, removing the cyber, biology and alignment domains lets GPT-6 Astra edge past Claude Opus 5.5 at 11.8 percent. It also reports GPT-6 Astra and GPT 6.1 Sol scoring 0 percent in cyber while Muse Wonder Full reaches 35.2 percent. We could not verify these figures against the leaderboard page, so treat them as reported. The practical point: refusal policy is part of the score.

Verdict for teams shipping agents

Use GDPx as evidence that long-horizon professional tasks remain largely unsolved, not as a model-selection tool. The 1.1-point gap between first and second is small next to the roughly threefold cost difference, so a production team should rerun its own tasks, with its own harness, before paying for the leader. SemiAnalysis plans updates every three to six months, and the next version should show whether the sample-size objections get addressed.

What is the highest score on GDPx?
Claude Opus 5.5 scores 12.0 percent on the GDPx v1.0 leaderboard, ahead of Gemini 4 Carbon at 10.9 percent and GPT-6 Astra at 9.6 percent.
How is the GDPx score computed?
SemiAnalysis states that the score averages each model across all 11 domains with equal weight, and that each partner within a domain is also weighted equally. The default score uses each task's intended grading method, averaged over 3 attempts.
Why do critics distrust the ranking?
As reported by The Decoder, critics point to small task counts in some sub-domains, rubric grading by language models in law and hardware design, and models running in different provider harnesses. They also note that the 14 task partners sell data to AI labs.
  1. No AI agent scores above 12 percent on SemiAnalysis' new real-world work benchmark — The Decoder
  2. GDPx leaderboard (v1.0) — SemiAnalysis
  3. GDPx: Measuring Frontier Model Capabilities — SemiAnalysis