Navigate
AI BENCHY
Advertise here

Gemini 3 Flash Preview (medium) vs GPT-5.6 Sol (low)

GPT-5.6 Sol (low) leads on average score with 9.5 vs 9.5. GPT-5.6 Sol (low) has the lower benchmark cost at $0.496 vs $0.763. GPT-5.6 Sol (low) is faster at 9.04s vs 19.86s, with pass rates of 93.9% vs 86.4%.

Last updated at: 2026-08-20

Rank
#5
Total Output Tokens
239,608
Response Time (avg)
19.86s
Total Cost
$0.763
Rank
#4
Total Output Tokens
19,946
Response Time (avg)
9.04s
Total Cost
$0.496
Recommended model GPT-5.6 Sol (low)

It has the best score here (9.5), while costing about 1.5x less than Gemini 3 Flash Preview (medium).

Detailed comparison

Metric Gemini 3 Flash Preview Gemini 3 Flash Preview medium Release: 2025-12-17 GPT-5.6 Sol GPT-5.6 Sol low Release: 2026-07-09
Score 9.5 9.5
Rank #5 #4
Reliability 10.0 10.0
Consistency 9.7 9.2
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 93.9% 86.4%
Flaky tests 1 2
Total Runs 66 66
Cost per result 3.814 5.508
Total Cost $0.763 $0.496
Input Price $0.500 / 1M $2.500 / 1M
Output Price $3.000 / 1M $15.000 / 1M
Total Input Tokens 87,870 78,580
Output Tokens 5,486 4,476
Reasoning Tokens 234,122 15,470
Response Time (avg) 19.86s 9.04s
Response Time (max) 117.26s 53.91s
Response Time (total) 436.88s 198.97s
Parameters ~500B total (~20B active) ~2T total (~150B active)
Availability Closed Closed

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#5 Gemini 3 Flash Preview

medium
Cost
$0.010
Time
18.4s
Tokens
3,351 tok

#4 GPT-5.6 Sol

low
Cost
$0.062
Time
26.7s
Tokens
2,150 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 3 Flash Preview 8.6 7.6 88.9% 1 84.40s 8,122 462 161,084
GPT-5.6 Sol 10.0 10.0 100.0% 0 11.25s 7,302 412 3,482

Quick Compare

Switch Comparison Pair

Gemini 3 Flash PreviewmediumvsGPT-5.6 SolhighGemini 3.5 FlashhighvsGPT-5.6 SollowGemini 3.7 FlashmediumvsGPT-5.6 SollowGemini 3 Flash PreviewmediumvsGPT-5.5lowGemini 3 Flash PreviewmediumvsGrok 4.6highGPT-5.6 SollowvsGrok 4.6highGemini 3.6 FlashmediumvsGPT-5.6 SollowGemini 3.7 FlashhighvsGPT-5.6 SollowClaude Opus 5highvsGemini 3 Flash PreviewmediumGemini 3.1 Pro PreviewmediumvsGPT-5.6 SollowClaude Opus 5highvsGPT-5.6 SollowClaude Opus 5mediumvsGPT-5.6 Sollow