On Artificial Analysis’s HLE-Diamond test, the best model with released weights, DeepSeek V4.1 Flash, scores 34.8% on reasoning questions, according to the benchmark’s results page. Gemini 4 Carbon scores 79.6%.
That is a 44.8-point gap, by our arithmetic. On Artificial Analysis’s Terminal-Bench 4.0, the gap between Gemini 4 Carbon and the best open-weights model is 23.3 points, about half as wide.
Business Pill · OPEN WEIGHTS EXPLAINED
A short explainer on open-weights models: renting a model through an API versus running it yourself. It teaches the general idea only and says nothing about these benchmark results.
The key insight: On Artificial Analysis’s HLE-Diamond reasoning questions, Gemini 4 Carbon shows 79.6% and the best open-weights model, DeepSeek V4.1 Flash, 34.8%, a 44.8-point gap by our arithmetic; on Terminal-Bench 4.0 the gap is 23.3 points.
What the Benchmark Shows
Artificial Analysis describes HLE-Diamond as “A refined and updated 1,000-question set of Humanity’s Last Exam, split evenly between reasoning and knowledge questions, with 272 questions that include an image”.
Its page says Gemini 4 Carbon “scores the highest on HLE-Diamond Reasoning with a score of 79.6...