SignalTech/AI
Why is Gemini 4 Carbon taking so long?
High-priority alert based on source significance and keyword relevance.
Context
What happened: A benchmark of Gemini 4 Carbon on private bug-fixing evals found it took close to an hour on tasks that Opus and Astra finished in minutes, and the authors traced the gap to slower inference, unnecessary work, and mechanical inefficiencies.
Key numbers: Gemini 4 Carbon low: 22m21s; Opus 5.5 high: 9m33s.
Why it matters: The authors conclude the slowness comes from how Carbon behaves rather than what it knows, and estimate that fixing the mechanical inefficiencies alone would cut its runtime by roughly a quarter.
What changed
A benchmark of Gemini 4 Carbon on private bug-fixing evals found it took close to an hour on tasks that Opus and Astra finished in minutes, and the authors traced the gap to slower inference, unnecessary work, and mechanical inefficiencies.
Why it matters
The authors conclude the slowness comes from how Carbon behaves rather than what it knows, and estimate that fixing the mechanical inefficiencies alone would cut its runtime by roughly a quarter.