Navigate
AI BENCHY
Advertise here

GPT-5.4 (medium) vs GPT-5.5 (medium)

GPT-5.5 (medium) leads on average score with 9.0 vs 8.5. GPT-5.4 (medium) has the lower benchmark cost at $1.533 vs $4.137. GPT-5.4 (medium) is faster at 23.10s vs 38.42s, with pass rates of 77.3% vs 87.9%.

Last updated at: 2026-08-01

Rank
#26
Total Output Tokens
88,670
Response Time (avg)
23.10s
Total Cost
$1.533
Rank
#16
Total Output Tokens
124,436
Response Time (avg)
38.42s
Total Cost
$4.137
Recommended model GPT-5.4 (medium)

Its score stays close to the best score here (8.5 vs 9.0), while costing about 2.7x less than GPT-5.5 (medium).

Detailed comparison

Metric GPT-5.4 GPT-5.4 medium Release: 2026-03-05 GPT-5.5 GPT-5.5 medium Release: 2026-04-24
Score 8.5 9.0
Rank #26 #16
Reliability 10.0 10.0
Consistency 8.6 8.9
Tests Correct
Attempt pass rate 77.3% 87.9%
Flaky tests 4 3
Total Runs 66 66
Cost per result 10.220 22.980
Total Cost $1.533 $4.137
Input Price $2.500 / 1M $5.000 / 1M
Output Price $15.000 / 1M $30.000 / 1M
Total Input Tokens 81,127 80,659
Output Tokens 6,155 5,617
Reasoning Tokens 82,515 118,819
Response Time (avg) 23.10s 38.42s
Response Time (max) 100.41s 332.10s
Response Time (total) 508.26s 845.35s

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#26 GPT-5.4

medium
Cost
$0.214
Time
199.6s
Tokens
14,349 tok

#16 GPT-5.5

medium
Cost
$0.112
Time
71.9s
Tokens
3,807 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 8.8 7.8 88.9% 1 44.36s 7,305 433 24,216
GPT-5.5 8.8 7.8 88.9% 1 59.77s 7,305 362 24,959

Quick Compare

Switch Comparison Pair