SHP2 Protein Function PredictionBrowse 284 families

SHP2 Protein Function Prediction

Can the model reason accurately about difficult scientific material?

Version / measure
Domain
Science
Ranked models
2
Reported values
2
Reports
1 · lab
Direction
Higher is better
Status
Latest stable

Rankings

Best reported score per model across effort settings

2 models
#ModelBest settingScore
1GPT-6 AstraOpenAIreportedcost n/a1 value · Sep 3 · source0.40
2GPT-5.6 SolOpenAIreportedcost n/a1 value · Sep 3 · source0.30

Effort curve

Score vs. reported cost. Lines connect complete sweeps only.

0 values
No cost-linked effort sweep for this version.
Definition and comparison boundaryinternal methodology

Can the model reason accurately about difficult scientific material?

Scientific knowledge and reasoning under the benchmark's published question set. Higher is better. Maximum mean R² across three unpublished assay datasets.

This is a publisher-defined internal evaluation. The task set or grading details are not fully public, so treat it as directional evidence.

OpenAI reports mean R² over three unpublished assay datasets covering 411 single-residue SHP2 mutations; the published maximum is GPT-6 Astra 0.40 versus GPT-5.6 Sol 0.30. OpenAI also prints 0.35 for a helpful-only Astra model, retained in the separate helpful-only row configuration.

Method / source ↗