Navigate
Advertise here

Gemini 4 Neon (medium) vs GPT-6.1 Sol (xhigh)

Gemini 4 Neon (medium) leads on average score with 10.0 vs 9.9. GPT-6.1 Sol (xhigh) has the lower benchmark cost at $1.377 vs $2.910. Gemini 4 Neon (medium) is faster at 19.27s vs 33.11s, with pass rates of 100.0% vs 97.1%.

Last updated at: 2026-11-18

Compared models

Rank
#3
Total Output Tokens
135,940
Response Time (avg)
19.27s
Total Cost
$2.910
Rank
#16
Total Output Tokens
102,482
Response Time (avg)
33.11s
Total Cost
$1.377
Recommended model GPT-6.1 Sol (xhigh)

Its score stays close to the best score here (9.9 vs 10.0), while costing about 2.1x less than Gemini 4 Neon (medium).

Detailed comparison

Metric Gemini 4 Neon Gemini 4 Neon medium Release: 2026-11-18 GPT-6.1 Sol GPT-6.1 Sol xhigh Release: 2026-09-29
Score 10.0 9.9
Rank #3 #16
Reliability 10.0 10.0
Consistency 10.0 9.6
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 100.0% 97.1%
Flaky tests 0 1
Total Runs 69 69
Cost per result 12.649 6.256
Total Cost $2.910 $1.377
Input Price $3.000 / 1M $2.000 / 1M
Output Price $15.000 / 1M $10.000 / 1M
Cache Read Price $0.150 / 1M $0.100 / 1M
Cache Write Price $0.084 / 1M $2.500 / 1M
Total Input Tokens 290,042 175,712
Output Tokens 7,004 5,640
Reasoning Tokens 128,936 96,842
Response Time (avg) 19.27s 33.11s
Response Time (max) 77.07s 491.85s
Response Time (total) 443.14s 761.52s
Parameters ~1.2T total (~20B active) ~2T total (~150B active)
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#3 Gemini 4 Neon

medium
Cost
$0.160
Time
85.1s
Tokens
10,734 tok

#16 GPT-6.1 Sol

xhigh
Cost
$0.147
Time
279.4s
Tokens
14,790 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 4 Neon 10.0 10.0 100.0% 0 21.49s 8,448 492 21,361
GPT-6.1 Sol 10.0 10.0 100.0% 0 10.65s 7,302 393 4,483

Switch Comparison Pair