Gemini 4 Carbon Nears FrontierCode SOTA
Gemini 4 Carbon scores roughly 40% on Cognition’s tougher FrontierCode 2.0 coding benchmark at about $4.04 per task, placing it just behind leading Claude and GPT models. The benchmark emphasizes mergeable, thorough software changes over narrow spec-following.
Carbon’s result suggests Google has closed much of the gap in agentic coding, but frontier leadership still depends on reliability across messy, real-world repository work.
- –FrontierCode 2.0 evaluates correctness, scope discipline, test quality, regressions, and maintainability across 132 tasks.
- –Carbon’s near-40% score is competitive with the top tier, though Claude Opus 5.5 and GPT-6 Astra remain ahead.
- –The roughly $4.04 task cost makes Carbon attractive for high-volume coding agents.
- –Cognition’s emphasis on unstated requirements and thoroughness makes this more meaningful than benchmarks built around fully specified coding prompts.
- –The result reinforces that coding-model quality is increasingly about autonomous judgment, not just code generation.
DISCOVERED
1h ago
2026-10-30
PUBLISHED
2h ago
2026-10-30
RELEVANCE
AUTHOR
cognition
