Navigate
Advertise here

Gemini 4 Carbon (high) vs GPT-6.1 Sol (low)

GPT-6.1 Sol (low) leads on average score with 9.6 vs 9.3. GPT-6.1 Sol (low) has the lower benchmark cost at $0.460 vs $6.107. GPT-6.1 Sol (low) is faster at 7.15s vs 120.04s, with pass rates of 97.1% vs 92.8%.

Last updated at: 2026-11-13

Compared models

Rank
#36
Total Output Tokens
513,770
Response Time (avg)
120.04s
Total Cost
$6.107
Rank
#17
Total Output Tokens
13,138
Response Time (avg)
7.15s
Total Cost
$0.460
Recommended model GPT-6.1 Sol (low)

It has the best score here (9.6), while costing about 13.3x less than Gemini 4 Carbon (high).

Detailed comparison

Metric Gemini 4 Carbon Gemini 4 Carbon high Release: 2026-11-12 GPT-6.1 Sol GPT-6.1 Sol low Release: 2026-09-29
Score 9.3 9.6
Rank #36 #17
Reliability 9.0 10.0
Consistency 9.3 9.6
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 97.1% 92.8%
Flaky tests 2 1
Total Runs 69 69
Cost per result 29.080 2.187
Total Cost $6.107 $0.460
Input Price $2.000 / 1M $2.000 / 1M
Output Price $10.000 / 1M $10.000 / 1M
Cache Read Price $0.100 / 1M $0.100 / 1M
Cache Write Price $0.188 / 1M $2.500 / 1M
Total Input Tokens 484,505 163,900
Output Tokens 6,098 4,958
Reasoning Tokens 507,672 8,180
Response Time (avg) 120.04s 7.15s
Response Time (max) 443.11s 46.57s
Response Time (total) 2760.87s 164.47s
Parameters ~1.2T total (~20B active) ~2T total (~150B active)
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#36 Gemini 4 Carbon

high
Reached the allocated time limit (600 seconds) without receiving showcase output.
Cost
$0.000
Time
600.0s
Tokens
0 tok

#17 GPT-6.1 Sol

low
Cost
$0.028
Time
44.6s
Tokens
2,881 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 4 Carbon 10.0 10.0 100.0% 0 119.00s 8,448 495 79,534
GPT-6.1 Sol 10.0 10.0 100.0% 0 4.48s 7,302 388 1,286

Quick Compare

Switch Comparison Pair

Gemini 3 Flash PreviewmediumvsGPT-6.1 SollowSeed 2.1 TurbolowvsGemini 4 CarbonhighGemini 4 ArgonhighvsGPT-6.1 SollowGemini 3.7 FlashmediumvsGPT-6.1 SollowGemini 4 CarbonhighvsGPT-6.1 TerralowClaude Opus 5.5mediumvsGemini 4 CarbonhighGemini 4 CarbonhighvsMuse WondermediumGemini 4 CarbonhighvsGPT-6.1 TerraxhighGemini 4 CarbonhighvsGPT-5.5mediumClaude Fable 5.2xhighvsGPT-6.1 SollowClaude Opus 5mediumvsGemini 4 CarbonhighClaude Sonnet 5.5maxvsGemini 4 Carbonhigh