Navigate
Advertise here

Gemini 4 Carbon (medium) vs Pareto (default)

The average score is effectively tied at 9.1 vs 9.1. Pareto (default) has the lower benchmark cost at $1.520 vs $1.933. Pareto (default) is faster at 33.47s vs 38.78s, with pass rates of 95.7% vs 87.0%.

Last updated at: 2026-11-22

Compared models

Rank
#61
Total Output Tokens
131,948
Response Time (avg)
38.78s
Total Cost
$1.933
Rank
#67
Total Output Tokens
128,144
Response Time (avg)
33.47s
Total Cost
$1.520
Recommended model Pareto (default)

It has the strongest score in this comparison (9.1) and the best overall balance of cost and response time across 2 models.

Detailed comparison

Metric Gemini 4 Carbon Gemini 4 Carbon medium Release: 2026-11-12 Pareto Pareto default Release: 2026-09-18
Score 9.1 9.1
Rank #61 #67
Reliability 8.8 10.0
Consistency 8.9 9.2
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 95.7% 87.0%
Flaky tests 3 2
Total Runs 69 69
Cost per result 9.662 8.000
Total Cost $1.933 $1.520
Input Price $2.000 / 1M $2.500 / 1M
Output Price $10.000 / 1M $7.500 / 1M
Cache Read Price $0.100 / 1M $0.250 / 1M
Cache Write Price $0.188 / 1M N/A
Total Input Tokens 306,396 223,559
Output Tokens 5,746 128,144
Reasoning Tokens 126,202 0
Response Time (avg) 38.78s 33.47s
Response Time (max) 206.61s 143.33s
Response Time (total) 892.02s 769.84s
Parameters ~1.2T total (~20B active) -
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#61 Gemini 4 Carbon

medium
Cost
$0.203
Time
336.6s
Tokens
20,353 tok

#67 Pareto

default
Cost
$0.034
Time
170.7s
Tokens
4,581 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 4 Carbon 10.0 10.0 100.0% 0 29.67s 8,448 487 17,950
Pareto 10.0 10.0 100.0% 0 50.12s 7,471 1,949 0

Switch Comparison Pair