Internal SycophancyBrowse 284 families
Internal Sycophancy
Can the model solve difficult problems that require more than factual recall?
Version / measure
- Domain
- Reasoning
- Ranked models
- 5
- Reported values
- 5
- Reports
- 1 · lab
- Direction
- Higher is better
- Status
- Version not specified
Rankings
Best reported score per model across effort settings
| # | Model | Best setting | Score |
|---|---|---|---|
| 1 | Gemini 3.1 ProGoogle | highcost n/a1 value · Jul 9 · source | 65.6% |
| 2 | Muse Spark 1.0Meta | reportedcost n/a1 value · Jul 9 · source | 57.9% |
| 3 | Muse Spark 1.1Meta | xhighcost n/a1 value · Jul 9 · source | 49.2% |
| 4 | GPT-5.5OpenAI | xhighcost n/a1 value · Jul 9 · source | 45.5% |
| 5 | Claude Opus 4.8Anthropic | maxcost n/a1 value · Jul 9 · source | 32.4% |
Effort curve
Score vs. reported cost. Lines connect complete sweeps only.
No cost-linked effort sweep for this version.
Definition and comparison boundaryinternal methodology
Can the model solve difficult problems that require more than factual recall?
Multi-step reasoning on academic, mathematical, or abstract problems. Higher is better. The value is the percentage reported in this lab's table.
This is a publisher-defined internal evaluation. The task set or grading details are not fully public, so treat it as directional evidence.
Method / source ↗