Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

OpenAI: GPT-5.4 vs OpenAI: GPT-5.5

Last updated at: 2026-04-24

Metric GPT-5.4 GPT-5.4 medium Release: 2026-03-05 GPT-5.5 GPT-5.5 medium Release: 2026-04-24
Score 8.2 9.0
Rank #18 #5
Reliability N/A N/A
Consistency 8.7 9.2
Tests Correct
Attempt pass rate 79.6% 87.0%
Flaky tests 3 2
Total Runs 54 54
Cost per result 6.399 19.226
Total Cost $0.832 $2.884
Input Price $2.500 / 1M $5.000 / 1M
Output Price $15.000 / 1M $30.000 / 1M
Output Tokens 2,169 1,920
Reasoning Tokens 48,732 89,632
Response Time (avg) 18.63s 32.75s
Response Time (max) 100.41s 332.10s
Response Time (total) 335.26s 589.59s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 8.3 10.0 75.0% 0 4.11s 240 1,511
GPT-5.5 10.0 10.0 100.0% 0 4.66s 250 1,335
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 13.03s 389 2,045
GPT-5.5 10.0 10.0 100.0% 0 9.09s 318 1,391
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 20.57s 301 3,543
GPT-5.5 10.0 10.0 100.0% 0 19.29s 312 2,841
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 5.32s 234 804
GPT-5.5 10.0 10.0 100.0% 0 4.18s 234 593
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 5.3 7.2 44.4% 1 74.27s 61 34,748
GPT-5.5 5.3 7.2 44.4% 1 164.14s 67 79,625
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 4.7 3.1 33.3% 1 4.92s 145 321
GPT-5.5 10.0 10.0 100.0% 0 4.16s 138 223
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 3.11s 93 897
GPT-5.5 10.0 10.0 100.0% 0 3.36s 93 538
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 8.2 7.2 88.9% 1 9.13s 442 3,832
GPT-5.5 8.6 7.9 77.8% 1 6.78s 250 2,254
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 13.28s 264 1,031
GPT-5.5 10.0 10.0 100.0% 0 10.57s 258 832

Quick Compare

Switch Comparison Pair

GPT-5.4mediumvsHY3 PreviewlowFree AvailableGemini 3 Flash PreviewnonevsGPT-5.4mediumGemini 3.1 Flash Lite PreviewlowvsGPT-5.4mediumGemini 3 Flash PreviewlowvsGPT-5.5mediumClaude Opus 4.7nonevsGPT-5.5mediumGPT-5.4mediumvsHY3 PreviewhighFree AvailableGemini 3.1 Flash Lite PreviewnonevsGPT-5.4mediumDeepSeek V4 FlashhighvsGPT-5.4mediumGPT-5.5mediumvsHY3 PreviewhighFree AvailableGemini 3 Flash PreviewlowvsGPT-5.4mediumClaude Sonnet 4.6nonevsGPT-5.4mediumGPT-5.5mediumvsHY3 PreviewlowFree Available