Navigate
AI BENCHY
Advertise here

Gemini 3.1 Pro Preview (medium) vs GPT-5.6 Sol (low)

GPT-5.6 Sol (low) leads on average score with 9.5 vs 9.2. GPT-5.6 Sol (low) has the lower benchmark cost at $0.496 vs $1.352. GPT-5.6 Sol (low) is faster at 9.04s vs 20.62s, with pass rates of 90.9% vs 86.4%.

Last updated at: 2026-08-20

Rank
#12
Total Output Tokens
97,238
Response Time (avg)
20.62s
Total Cost
$1.352
Rank
#4
Total Output Tokens
19,946
Response Time (avg)
9.04s
Total Cost
$0.496
Recommended model GPT-5.6 Sol (low)

It has the best score here (9.5), while costing about 2.7x less than Gemini 3.1 Pro Preview (medium).

Detailed comparison

Metric Gemini 3.1 Pro Preview Gemini 3.1 Pro Preview medium Release: 2026-02-19 GPT-5.6 Sol GPT-5.6 Sol low Release: 2026-07-09
Score 9.2 9.5
Rank #12 #4
Reliability 10.0 10.0
Consistency 10.0 9.2
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 90.9% 86.4%
Flaky tests 0 2
Total Runs 66 66
Cost per result 6.758 5.508
Total Cost $1.352 $0.496
Input Price $2.000 / 1M $2.500 / 1M
Output Price $12.000 / 1M $15.000 / 1M
Total Input Tokens 92,296 78,580
Output Tokens 5,232 4,476
Reasoning Tokens 92,006 15,470
Response Time (avg) 20.62s 9.04s
Response Time (max) 88.68s 53.91s
Response Time (total) 329.94s 198.97s
Parameters ~1.2T total (~20B active) ~2T total (~150B active)
Availability Closed Closed

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#12 Gemini 3.1 Pro Preview

medium
Cost
$0.115
Time
87.2s
Tokens
9,629 tok

#4 GPT-5.6 Sol

low
Cost
$0.062
Time
26.7s
Tokens
2,150 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 3.1 Pro Preview 7.9 9.9 66.7% 0 40.17s 8,124 435 41,247
GPT-5.6 Sol 10.0 10.0 100.0% 0 11.25s 7,302 412 3,482

Quick Compare

Switch Comparison Pair

Claude Opus 5highvsGemini 3.1 Pro PreviewmediumGemini 3 Flash PreviewmediumvsGPT-5.6 SollowGemini 3.1 Pro PreviewmediumvsGrok 4.6highGemini 3.1 Pro PreviewmediumvsGPT-5.5lowGemini 3.1 Pro PreviewmediumvsGPT-5.6 SolhighGemini 3.5 FlashhighvsGPT-5.6 SollowGemini 3.7 FlashmediumvsGPT-5.6 SollowSeed 2.1 TurbolowvsGemini 3.1 Pro PreviewmediumGPT-5.6 SollowvsGrok 4.6highGemini 3.6 FlashmediumvsGPT-5.6 SollowGemini 3.7 FlashhighvsGPT-5.6 SollowGemini 3.1 Pro PreviewmediumvsGrok 4.5high