SHP2 Protein Function Prediction
Can the model reason accurately about difficult scientific material?
Top rankings
One row per model, using its best reported score across effort settings.
Effort curve
Every sourced cost-linked effort value for this exact version. Lines connect complete sweeps only.
Definition and comparison boundaryinternal methodology
Can the model reason accurately about difficult scientific material?
Scientific knowledge and reasoning under the benchmark's published question set. Higher is better. Maximum mean R² across three unpublished assay datasets.
This is a publisher-defined internal evaluation. The task set or grading details are not fully public, so treat it as directional evidence.
OpenAI reports mean R² over three unpublished assay datasets covering 411 single-residue SHP2 mutations; the published maximum is GPT-6 Astra 0.40 versus GPT-5.6 Sol 0.30. OpenAI also prints 0.35 for a helpful-only Astra model, retained in the separate helpful-only row configuration.
Method / source