GPQABrowse 284 families

GPQA

Can the model reason through specialist biology, physics, and chemistry questions?

Version / measure
Domain
Science
Ranked models
27
Reported values
41
Reports
7 · lab
Direction
Higher is better
Status
Canonical static set

Rankings

Best reported score per model across effort settings

27 models
#ModelBest settingScore
1Claude Mythos PreviewAnthropicreportedcost n/a1 value · Jul 9 · source94.6%
2GPT-5.6 SolOpenAIreportedcost n/a2 values · Jul 9 · source94.6%
3Gemini 3.1 Pro PreviewGooglereportedcost n/a1 value · Jul 9 · source94.3%
4Gemini 3.1 ProGooglereportedcost n/a3 values · Jun 16 · source94.3%
5Claude Mythos 5Anthropicreportedcost n/a1 value · Jul 9 · source94.1%
6GPT-5.5OpenAIreportedcost n/a3 values · Jul 9 · source93.6%
7Claude Opus 4.8Anthropicreportedcost n/a3 values · Jun 16 · source93.6%
8Kimi K3Moonshot AIOWmaxcost n/a2 values · Jul 17 · source93.5%
9MiniMax M3MiniMaxOWreportedcost n/a1 value · Jun 16 · source93.0%
10GPT-5.6 TerraOpenAIreportedcost n/a1 value · Jul 9 · source92.9%

Effort curve

Score vs. reported cost. Lines connect complete sweeps only.

0 values
No cost-linked effort sweep for this version.
Definition and comparison boundarypublic methodology

Can the model reason through specialist biology, physics, and chemistry questions?

Multiple-choice science questions written and validated by domain experts. Higher is better. The value is the percentage reported in this lab's table.

Harness, tools, prompts, attempt count, and benchmark version can materially change the result. Compare within one reporting context.

DeepSeek's official V4.1-Flash release table; exact source label GPQA Diamond; harness and effort are not printed. No tools.

Method / source ↗