Navigate
AI BENCHY
Advertise here

Gemini 3.1 Pro Preview (medium) vs GPT-5.6 Sol (high)

GPT-5.6 Sol (high) leads on average score with 9.4 vs 9.2. GPT-5.6 Sol (high) has the lower benchmark cost at $0.629 vs $1.352. GPT-5.6 Sol (high) is faster at 11.48s vs 20.62s, with pass rates of 90.9% vs 89.4%.

Last updated at: 2026-08-20

Rank
#12
Total Output Tokens
97,238
Response Time (avg)
20.62s
Total Cost
$1.352
Rank
#9
Total Output Tokens
28,708
Response Time (avg)
11.48s
Total Cost
$0.629
Recommended model GPT-5.6 Sol (high)

It has the best score here (9.4), while costing about 2.1x less than Gemini 3.1 Pro Preview (medium).

Detailed comparison

Metric Gemini 3.1 Pro Preview Gemini 3.1 Pro Preview medium Release: 2026-02-19 GPT-5.6 Sol GPT-5.6 Sol high Release: 2026-07-09
Score 9.2 9.4
Rank #12 #9
Reliability 10.0 10.0
Consistency 10.0 8.9
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 90.9% 89.4%
Flaky tests 0 3
Total Runs 66 66
Cost per result 6.758 6.987
Total Cost $1.352 $0.629
Input Price $2.000 / 1M $2.500 / 1M
Output Price $12.000 / 1M $15.000 / 1M
Total Input Tokens 92,296 79,258
Output Tokens 5,232 4,855
Reasoning Tokens 92,006 23,853
Response Time (avg) 20.62s 11.48s
Response Time (max) 88.68s 54.79s
Response Time (total) 329.94s 252.62s
Parameters ~1.2T total (~20B active) ~2T total (~150B active)
Availability Closed Closed

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#12 Gemini 3.1 Pro Preview

medium
Cost
$0.115
Time
87.2s
Tokens
9,629 tok

#9 GPT-5.6 Sol

high
Cost
$0.151
Time
201.9s
Tokens
5,100 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 3.1 Pro Preview 7.9 9.9 66.7% 0 40.17s 8,124 435 41,247
GPT-5.6 Sol 10.0 10.0 100.0% 0 12.52s 7,302 404 5,656

Quick Compare

Switch Comparison Pair

Claude Opus 5highvsGemini 3.1 Pro PreviewmediumGemini 3.7 FlashmediumvsGPT-5.6 SolhighGemini 3.1 Pro PreviewmediumvsGrok 4.6highGemini 3.1 Pro PreviewmediumvsGPT-5.5lowGemini 3 Flash PreviewmediumvsGPT-5.6 SolhighGemini 3.7 FlashlowvsGPT-5.6 SolhighClaude Opus 5mediumvsGPT-5.6 SolhighSeed 2.1 TurbolowvsGemini 3.1 Pro PreviewmediumSeed 2.1 TurbolowvsGPT-5.6 SolhighGemini 3.1 Pro PreviewmediumvsGrok 4.5highGemini 3.1 Pro PreviewmediumvsGPT-5.6 SollowGPT-5.6 SolhighvsQwen3.7 Maxmedium