Hard-negative protein binding predictionBrowse 284 families

Hard-negative protein binding prediction

Can the model reason accurately about difficult scientific material?

Version / measure
Domain
Science
Ranked models
2
Reported values
2
Reports
1 · lab
Direction
Higher is better
Status
Latest stable

Rankings

Best reported score per model across effort settings

2 models
#ModelBest settingScore
1GPT-5.6 SolOpenAIreportedcost n/a1 value · Sep 3 · source7.6%
2GPT-6 AstraOpenAIreportedcost n/a1 value · Sep 3 · source0.0%

Effort curve

Score vs. reported cost. Lines connect complete sweeps only.

0 values
No cost-linked effort sweep for this version.
Definition and comparison boundaryinternal methodology

Can the model reason accurately about difficult scientific material?

Scientific knowledge and reasoning under the benchmark's published question set. Higher is better. Percentage of protein-binding selections scored correct by OpenAI.

This is a publisher-defined internal evaluation. The task set or grading details are not fully public, so treat it as directional evidence.

OpenAI reports 0.0% for ordinary Astra and 7.6% for GPT-5.6 Sol on a proprietary non-contaminated evaluation with 43 protein targets and 492 hotspots; a helpful-only Astra model is also 0.0%. OpenAI is retiring this evaluation and notes an environment-variable leakage issue.

Method / source ↗