GraySwan ART (pass@1 ASR)Browse 284 families
GraySwan ART (pass@1 ASR)
Can the model plan, use tools, and finish a multi-step task?
Version / measure
- Domain
- Agents
- Ranked models
- 5
- Reported values
- 5
- Reports
- 1 · lab
- Direction
- Lower is better
- Status
- Version not specified
Rankings
Best reported score per model across effort settings
| # | Model | Best setting | Score |
|---|---|---|---|
| 1 | Claude Opus 4.8Anthropic | maxcost n/a1 value · Jul 9 · source | 0.1% |
| 2 | Muse Spark 1.1Meta | xhighcost n/a1 value · Jul 9 · source | 0.3% |
| 3 | GPT-5.5OpenAI | xhighcost n/a1 value · Jul 9 · source | 0.8% |
| 4 | Gemini 3.1 ProGoogle | highcost n/a1 value · Jul 9 · source | 1.0% |
| 5 | Muse Spark 1.0Meta | reportedcost n/a1 value · Jul 9 · source | 6.1% |
Effort curve
Score vs. reported cost. Lines connect complete sweeps only.
No cost-linked effort sweep for this version.
Definition and comparison boundarypublic methodology
Can the model plan, use tools, and finish a multi-step task?
Agentic execution across tools, environments, or long-running workflows. Lower is better. The source reports an attack success rate as a percentage.
Harness, tools, prompts, attempt count, and benchmark version can materially change the result. Compare within one reporting context.
Method / source ↗