Harvey's Legal Agent BenchmarkBrowse 284 families

Harvey's Legal Agent Benchmark

Can the model produce useful work in a professional knowledge-work setting?

Version / measure
Domain
Knowledge Work
Ranked models
7
Reported values
7
Reports
2 · lab
Direction
Higher is better
Status
Version not specified

Rankings

Best reported score per model across effort settings

7 models
#ModelBest settingScore
1Grok 4.7SpaceXAIxhighcost n/a1 value · Sep 21 · source19.6%
2Gemini 3.8 FlashGooglereportedcost n/a1 value · Sep 2 · source10.0%
3Gemini 3.7 FlashGooglereportedcost n/a1 value · Sep 2 · source8.8%
4Claude Opus 5Anthropicreportedcost n/a1 value · Sep 2 · source6.7%
5Claude Sonnet 5Anthropicreportedcost n/a1 value · Sep 2 · source5.0%
6GPT-5.6 SolOpenAIreportedcost n/a1 value · Sep 2 · source2.5%
7GPT-5.6 TerraOpenAIreportedcost n/a1 value · Sep 2 · source0.8%

Effort curve

Score vs. reported cost. Lines connect complete sweeps only.

0 values
No cost-linked effort sweep for this version.
Definition and comparison boundarypublic methodology

Can the model produce useful work in a professional knowledge-work setting?

Professional analysis, document, finance, office, or domain-specific tasks. Higher is better. The value is the percentage reported in this lab's table.

Harness, tools, prompts, attempt count, and benchmark version can materially change the result. Compare within one reporting context.

SpaceXAI reports 19.6% for Grok 4.7 at xhigh; the table labels this metric as legal work but does not print the harness or task revision. Complex legal workflows; the model card labels this metric All pass rate.

Method / source ↗