FrontierCodeBrowse 284 families
FrontierCode
Would a repository maintainer merge this software change?
- Domain
- Coding
- Ranked models
- 40
- Reported values
- 115
- Reports
- 1 · maintainer
- Direction
- Higher is better
- Status
- Latest stable
Rankings
Best reported score per model across effort settings
| # | Model | Best setting | Score |
|---|---|---|---|
| 1 | Claude Opus 5.5Anthropic | mediumcost n/a5 values · Sep 23 · source | 65.27% |
| 2 | Claude Fable 5Anthropic | xhighcost n/a5 values · Sep 23 · source | 64.94% |
| 3 | GPT-6 AstraOpenAI | maxcost n/a5 values · Sep 23 · source | 64.48% |
| 4 | Claude Opus 5Anthropic | mediumcost n/a5 values · Sep 23 · source | 63.63% |
| 5 | Claude Fable 5.1Anthropic | mediumcost n/a5 values · Sep 23 · source | 63.60% |
| 6 | SWE-2Cognition | maxcost n/a3 values · Sep 23 · source | 62.46% |
| 7 | Grok 4.6SpaceXAI | highcost n/a3 values · Sep 23 · source | 61.31% |
| 8 | GPT-6 SolOpenAI | maxcost n/a5 values · Sep 23 · source | 60.69% |
| 9 | GPT-5.6 SolOpenAI | maxcost n/a5 values · Sep 23 · source | 60.55% |
| 10 | Claude Opus 4.8Anthropic | maxcost n/a5 values · Sep 23 · source | 59.60% |
Effort curve
Score vs. reported cost. Lines connect complete sweeps only.
Definition and comparison boundarypublic methodology
Would a repository maintainer merge this software change?
End-to-end code quality, including correctness, test quality, scope discipline, style, and adherence to repository standards. Higher is better. Cognition's Score is a weighted aggregate of rubric items; solutions that fail a blocking criterion receive 0.
Weighted Score is not all-blocker Pass Rate. Harness and effort vary by row; compare only exact contexts and splits. The feed does not publish attempt counts.
Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Fable 5"; harness "claude-code"; source effort "high"; Score raw source fraction 0.6425; unfair-internet flagged rate 0.0013 source fraction (0.13%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Fable 5"; harness "claude-code"; source effort "low"; Score raw source fraction 0.608; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Fable 5"; harness "claude-code"; source effort "max"; Score raw source fraction 0.6363; unfair-internet flagged rate 0.0013 source fraction (0.13%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Fable 5"; harness "claude-code"; source effort "medium"; Score raw source fraction 0.6279; unfair-internet flagged rate 0.002 source fraction (0.2%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Fable 5"; harness "claude-code"; source effort "xhigh"; Score raw source fraction 0.6494; unfair-internet flagged rate 0.002 source fraction (0.2%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Fable 5.1"; harness "claude-code"; source effort "high"; Score raw source fraction 0.6268; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Fable 5.1"; harness "claude-code"; source effort "low"; Score raw source fraction 0.6162; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Fable 5.1"; harness "claude-code"; source effort "max"; Score raw source fraction 0.6203; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Fable 5.1"; harness "claude-code"; source effort "medium"; Score raw source fraction 0.636; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Fable 5.1"; harness "claude-code"; source effort "xhigh"; Score raw source fraction 0.6135; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Opus 4.6"; harness "claude-code"; source effort "high"; Score raw source fraction 0.4367; unfair-internet flagged rate 0.0007 source fraction (0.07%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Opus 4.6"; harness "claude-code"; source effort "low"; Score raw source fraction 0.3293; unfair-internet flagged rate 0.002 source fraction (0.2%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Opus 4.6"; harness "claude-code"; source effort "medium"; Score raw source fraction 0.3865; unfair-internet flagged rate 0.0007 source fraction (0.07%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Opus 4.7"; harness "claude-code"; source effort "high"; Score raw source fraction 0.5112; unfair-internet flagged rate 0.0007 source fraction (0.07%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Opus 4.7"; harness "claude-code"; source effort "low"; Score raw source fraction 0.436; unfair-internet flagged rate 0.0007 source fraction (0.07%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Opus 4.7"; harness "claude-code"; source effort "max"; Score raw source fraction 0.5393; unfair-internet flagged rate 0.0007 source fraction (0.07%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Opus 4.7"; harness "claude-code"; source effort "medium"; Score raw source fraction 0.4475; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Opus 4.7"; harness "claude-code"; source effort "xhigh"; Score raw source fraction 0.5141; unfair-internet flagged rate 0.0027 source fraction (0.27%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Opus 4.8"; harness "claude-code"; source effort "high"; Score raw source fraction 0.5563; unfair-internet flagged rate 0.0073 source fraction (0.73%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Opus 4.8"; harness "claude-code"; source effort "low"; Score raw source fraction 0.5083; unfair-internet flagged rate 0.0013 source fraction (0.13%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Opus 4.8"; harness "claude-code"; source effort "max"; Score raw source fraction 0.596; unfair-internet flagged rate 0.004 source fraction (0.4%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Opus 4.8"; harness "claude-code"; source effort "medium"; Score raw source fraction 0.5537; unfair-internet flagged rate 0.004 source fraction (0.4%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Opus 4.8"; harness "claude-code"; source effort "xhigh"; Score raw source fraction 0.5945; unfair-internet flagged rate 0.0033 source fraction (0.33%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Opus 5"; harness "claude-code"; source effort "high"; Score raw source fraction 0.5845; unfair-internet flagged rate 0.0013 source fraction (0.13%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Opus 5"; harness "claude-code"; source effort "low"; Score raw source fraction 0.5575; unfair-internet flagged rate 0.0041 source fraction (0.41%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Opus 5"; harness "claude-code"; source effort "max"; Score raw source fraction 0.5894; unfair-internet flagged rate 0.0067 source fraction (0.67%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Opus 5"; harness "claude-code"; source effort "medium"; Score raw source fraction 0.6363; unfair-internet flagged rate 0.004 source fraction (0.4%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Opus 5"; harness "claude-code"; source effort "xhigh"; Score raw source fraction 0.5687; unfair-internet flagged rate 0.0097 source fraction (0.97%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Opus 5.5"; harness "claude-code"; source effort "high"; Score raw source fraction 0.652; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Opus 5.5"; harness "claude-code"; source effort "low"; Score raw source fraction 0.6033; unfair-internet flagged rate 0.0067 source fraction (0.67%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Opus 5.5"; harness "claude-code"; source effort "max"; Score raw source fraction 0.6358; unfair-internet flagged rate 0.0053 source fraction (0.53%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Opus 5.5"; harness "claude-code"; source effort "medium"; Score raw source fraction 0.6527; unfair-internet flagged rate 0.004 source fraction (0.4%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Opus 5.5"; harness "claude-code"; source effort "xhigh"; Score raw source fraction 0.6353; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Sonnet 4.6"; harness "claude-code"; source effort "high"; Score raw source fraction 0.3986; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Sonnet 4.6"; harness "claude-code"; source effort "low"; Score raw source fraction 0.3044; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Sonnet 4.6"; harness "claude-code"; source effort "max"; Score raw source fraction 0.4; unfair-internet flagged rate 0.0013 source fraction (0.13%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Sonnet 4.6"; harness "claude-code"; source effort "medium"; Score raw source fraction 0.3749; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Sonnet 5"; harness "claude-code"; source effort "high"; Score raw source fraction 0.5271; unfair-internet flagged rate 0.0013 source fraction (0.13%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Sonnet 5"; harness "claude-code"; source effort "low"; Score raw source fraction 0.4446; unfair-internet flagged rate 0.0007 source fraction (0.07%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Sonnet 5"; harness "claude-code"; source effort "max"; Score raw source fraction 0.5485; unfair-internet flagged rate 0.0053 source fraction (0.53%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Sonnet 5"; harness "claude-code"; source effort "medium"; Score raw source fraction 0.4928; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Claude Sonnet 5"; harness "claude-code"; source effort "xhigh"; Score raw source fraction 0.5618; unfair-internet flagged rate 0.006 source fraction (0.6%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Composer 2.5"; harness "cursor-cli"; source effort "none"; Score raw source fraction 0.4075; unfair-internet flagged rate 0.0227 source fraction (2.27%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "DeepSeek V4 Flash 0731"; harness "chisel"; source effort "high"; Score raw source fraction 0.317; unfair-internet flagged rate 0.1911 source fraction (19.11%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "DeepSeek V4 Pro"; harness "mini-swe-agent"; source effort "none"; Score raw source fraction 0.3101; unfair-internet flagged rate 0.0067 source fraction (0.67%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "DeepSeek V4 Pro 0813"; harness "chisel"; source effort "high"; Score raw source fraction 0.4445; unfair-internet flagged rate 0.076 source fraction (7.6%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Gemini 3.6 Flash"; harness "chisel"; source effort "high"; Score raw source fraction 0.4758; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Gemini 3.6 Flash"; harness "chisel"; source effort "low"; Score raw source fraction 0.3277; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Gemini 3.6 Flash"; harness "chisel"; source effort "medium"; Score raw source fraction 0.4802; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Gemini 3.7 Flash"; harness "chisel"; source effort "high"; Score raw source fraction 0.5474; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Gemini 3.7 Flash"; harness "chisel"; source effort "low"; Score raw source fraction 0.5185; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Gemini 3.7 Flash"; harness "chisel"; source effort "medium"; Score raw source fraction 0.5627; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Gemini 3.8 Flash"; harness "chisel"; source effort "high"; Score raw source fraction 0.5124; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Gemini 3.8 Flash"; harness "chisel"; source effort "medium"; Score raw source fraction 0.5345; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GLM 5.2"; harness "mini-swe-agent"; source effort "none"; Score raw source fraction 0.4005; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GLM 5.3"; harness "chisel"; source effort "max"; Score raw source fraction 0.5263; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GLM 5.3 Flash"; harness "chisel"; source effort "max"; Score raw source fraction 0.4621; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-5.4-mini"; harness "codex"; source effort "high"; Score raw source fraction 0.3719; unfair-internet flagged rate 0.0007 source fraction (0.07%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-5.4-mini"; harness "codex"; source effort "low"; Score raw source fraction 0.2058; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-5.4-mini"; harness "codex"; source effort "medium"; Score raw source fraction 0.3506; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-5.4-mini"; harness "codex"; source effort "xhigh"; Score raw source fraction 0.4301; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-5.5"; harness "codex"; source effort "high"; Score raw source fraction 0.5399; unfair-internet flagged rate 0.002 source fraction (0.2%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-5.5"; harness "codex"; source effort "low"; Score raw source fraction 0.4555; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-5.5"; harness "codex"; source effort "medium"; Score raw source fraction 0.5137; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-5.5"; harness "codex"; source effort "xhigh"; Score raw source fraction 0.5666; unfair-internet flagged rate 0.0027 source fraction (0.27%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-5.6 Luna"; harness "codex"; source effort "high"; Score raw source fraction 0.5052; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-5.6 Luna"; harness "codex"; source effort "low"; Score raw source fraction 0.2902; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-5.6 Luna"; harness "codex"; source effort "max"; Score raw source fraction 0.5506; unfair-internet flagged rate 0.0013 source fraction (0.13%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-5.6 Luna"; harness "codex"; source effort "medium"; Score raw source fraction 0.4117; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-5.6 Luna"; harness "codex"; source effort "xhigh"; Score raw source fraction 0.545; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-5.6 Sol"; harness "codex"; source effort "high"; Score raw source fraction 0.5874; unfair-internet flagged rate 0.0008 source fraction (0.08%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-5.6 Sol"; harness "codex"; source effort "low"; Score raw source fraction 0.4999; unfair-internet flagged rate 0.0007 source fraction (0.07%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-5.6 Sol"; harness "codex"; source effort "max"; Score raw source fraction 0.6055; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-5.6 Sol"; harness "codex"; source effort "medium"; Score raw source fraction 0.5468; unfair-internet flagged rate 0.0013 source fraction (0.13%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-5.6 Sol"; harness "codex"; source effort "xhigh"; Score raw source fraction 0.5998; unfair-internet flagged rate 0.0007 source fraction (0.07%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-5.6 Terra"; harness "codex"; source effort "high"; Score raw source fraction 0.5086; unfair-internet flagged rate 0.0007 source fraction (0.07%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-5.6 Terra"; harness "codex"; source effort "low"; Score raw source fraction 0.3779; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-5.6 Terra"; harness "codex"; source effort "max"; Score raw source fraction 0.5584; unfair-internet flagged rate 0.0007 source fraction (0.07%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-5.6 Terra"; harness "codex"; source effort "medium"; Score raw source fraction 0.4766; unfair-internet flagged rate 0.0007 source fraction (0.07%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-5.6 Terra"; harness "codex"; source effort "xhigh"; Score raw source fraction 0.5263; unfair-internet flagged rate 0.0007 source fraction (0.07%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-6 Astra"; harness "codex"; source effort "high"; Score raw source fraction 0.6307; unfair-internet flagged rate not reported; attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-6 Astra"; harness "codex"; source effort "low"; Score raw source fraction 0.574; unfair-internet flagged rate not reported; attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-6 Astra"; harness "codex"; source effort "max"; Score raw source fraction 0.6448; unfair-internet flagged rate not reported; attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-6 Astra"; harness "codex"; source effort "medium"; Score raw source fraction 0.6025; unfair-internet flagged rate not reported; attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-6 Astra"; harness "codex"; source effort "xhigh"; Score raw source fraction 0.6212; unfair-internet flagged rate not reported; attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-6 Luna"; harness "codex"; source effort "high"; Score raw source fraction 0.513; unfair-internet flagged rate 0.0013 source fraction (0.13%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-6 Luna"; harness "codex"; source effort "low"; Score raw source fraction 0.3907; unfair-internet flagged rate 0.0013 source fraction (0.13%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-6 Luna"; harness "codex"; source effort "max"; Score raw source fraction 0.561; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-6 Luna"; harness "codex"; source effort "medium"; Score raw source fraction 0.5015; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-6 Luna"; harness "codex"; source effort "xhigh"; Score raw source fraction 0.5143; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-6 Sol"; harness "codex"; source effort "high"; Score raw source fraction 0.5962; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-6 Sol"; harness "codex"; source effort "low"; Score raw source fraction 0.5055; unfair-internet flagged rate 0.0013 source fraction (0.13%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-6 Sol"; harness "codex"; source effort "max"; Score raw source fraction 0.6069; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-6 Sol"; harness "codex"; source effort "medium"; Score raw source fraction 0.5711; unfair-internet flagged rate 0.0013 source fraction (0.13%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "GPT-6 Sol"; harness "codex"; source effort "xhigh"; Score raw source fraction 0.5913; unfair-internet flagged rate 0.0013 source fraction (0.13%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Grok 4.5"; harness "grok-build"; source effort "high"; Score raw source fraction 0.5655; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Grok 4.5"; harness "grok-build"; source effort "low"; Score raw source fraction 0.5314; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Grok 4.5"; harness "grok-build"; source effort "medium"; Score raw source fraction 0.5607; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Grok 4.6"; harness "grok-build"; source effort "high"; Score raw source fraction 0.6131; unfair-internet flagged rate 0.0047 source fraction (0.47%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Grok 4.6"; harness "grok-build"; source effort "low"; Score raw source fraction 0.5502; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Grok 4.6"; harness "grok-build"; source effort "medium"; Score raw source fraction 0.5962; unfair-internet flagged rate 0.004 source fraction (0.4%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Grok 4.7"; harness "grok-build"; source effort "high"; Score raw source fraction 0.5935; unfair-internet flagged rate 0.0087 source fraction (0.87%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Grok 4.7"; harness "grok-build"; source effort "xhigh"; Score raw source fraction 0.5699; unfair-internet flagged rate 0.0067 source fraction (0.67%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Inkling"; harness "mini-swe-agent"; source effort "0.99"; Score raw source fraction 0.248; unfair-internet flagged rate 0.0727 source fraction (7.27%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Kimi K2.7"; harness "mini-swe-agent"; source effort "none"; Score raw source fraction 0.4538; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Kimi K3"; harness "mini-swe-agent"; source effort "none"; Score raw source fraction 0.5819; unfair-internet flagged rate 0.0014 source fraction (0.14%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "MiniMax M3"; harness "mini-swe-agent"; source effort "none"; Score raw source fraction 0.2854; unfair-internet flagged rate 0.0107 source fraction (1.07%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Mistral 3.5 Medium"; harness "chisel"; source effort "none"; Score raw source fraction 0.1866; unfair-internet flagged rate 0.004 source fraction (0.4%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Nemotron 3 Ultra"; harness "chisel"; source effort "none"; Score raw source fraction 0.2721; unfair-internet flagged rate 0.0013 source fraction (0.13%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "Qwen 3.7 Plus"; harness "mini-swe-agent"; source effort "none"; Score raw source fraction 0.2178; unfair-internet flagged rate 0.006 source fraction (0.6%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "SWE-1.6"; harness "chisel"; source effort "none"; Score raw source fraction 0.205; unfair-internet flagged rate 0 source fraction (0%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "SWE-1.7"; harness "chisel"; source effort "none"; Score raw source fraction 0.5426; unfair-internet flagged rate 0.0093 source fraction (0.93%); attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "SWE-2"; harness "devin"; source effort "high"; Score raw source fraction 0.6008; unfair-internet flagged rate not reported; attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "SWE-2"; harness "devin"; source effort "max"; Score raw source fraction 0.6246; unfair-internet flagged rate not reported; attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23. Official Cognition FrontierCode 1.1 Extended result over 150 tasks; exact source model label "SWE-2"; harness "devin"; source effort "medium"; Score raw source fraction 0.5641; unfair-internet flagged rate not reported; attempt count and fallback behavior are not reported. Scores are retrieved 2026-09-23.
Method / source ↗