Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

Compared models

Summary

GPT-5.4 vs GPT-5.3-Codex vs GPT-5.2 benchmark comparisonGPT-5.3-Codex leads on Score with 8.9. GPT-5.4 leads on Reliability with 10.0. GPT-5.2 has the lowest Total Cost at $0.548. GPT-5.3-Codex is fastest at 16.22s.

Recommended model: GPT-5.2 - Its score stays close to the best score here (8.4 vs 8.9), while costing about 1.8x less than the other models in this comparison.

Last updated at: 2026-06-18

Metric GPT-5.4 GPT-5.4 medium Release: 2026-03-05 GPT-5.3-Codex GPT-5.3-Codex medium Release: 2026-02-05 GPT-5.2 GPT-5.2 medium Release: 2025-12-11
Score 8.5 8.9 8.4
Rank #17 #10 #22
Reliability 10.0 10.0 10.0
Consistency 8.6 8.5 8.4
Tests Correct
Attempt pass rate 76.2% 82.5% 71.4%
Flaky tests 4 4 4
Total Runs 63 63 63
Cost per result 8.640 4.932 4.209
Total Cost $1.210 $0.740 $0.548
Input Price $2.500 / 1M $1.750 / 1M $1.750 / 1M
Output Price $15.000 / 1M $14.000 / 1M $14.000 / 1M
Total Input Tokens 34,108 34,299 33,967
Output Tokens 2,242 2,357 2,901
Reasoning Tokens 72,707 46,189 31,932
Response Time (avg) 22.35s 16.22s 16.88s
Response Time (max) 100.41s 100.93s 77.80s
Response Time (total) 469.29s 340.67s 236.34s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#17 GPT-5.4

medium
Cost
$0.214
Time
199.6s
Tokens
14,349 tok

#10 GPT-5.3-Codex

medium
Cost
$0.049
Time
54.9s
Tokens
3,580 tok

#22 GPT-5.2

medium
Cost
$0.047
Time
49.2s
Tokens
3,396 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 8.3 10.0 75.0% 0 4.11s 606 240 1,511
GPT-5.3-Codex 8.7 7.9 91.7% 1 4.16s 606 240 1,722
GPT-5.2 6.5 8.0 58.3% 1 7.81s 606 567 2,002
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 8.8 7.8 88.9% 1 44.36s 7,305 433 24,216
GPT-5.3-Codex 10.0 10.0 100.0% 0 19.50s 7,302 535 10,890
GPT-5.2 10.0 10.0 100.0% 0 22.73s 7,302 511 11,912
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 20.57s 11,019 301 3,543
GPT-5.3-Codex 10.0 10.0 100.0% 0 19.56s 11,019 364 2,731
GPT-5.2 10.0 10.0 100.0% 0 14.06s 11,019 291 1,757
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 5.32s 7,140 234 804
GPT-5.3-Codex 10.0 10.0 100.0% 0 3.07s 7,140 234 728
GPT-5.2 10.0 10.0 100.0% 0 3.15s 7,140 234 420
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 5.3 7.2 44.4% 1 74.27s 619 61 34,748
GPT-5.3-Codex 5.9 7.2 55.6% 1 64.31s 813 64 25,308
GPT-5.2 5.9 7.2 55.6% 1 77.80s 473 42 10,342
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 4.7 3.1 33.3% 1 4.92s 477 145 321
GPT-5.3-Codex 4.6 10.0 0.0% 0 4.87s 477 187 331
GPT-5.2 3.7 9.7 0.0% 0 4.32s 477 162 269
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 3.11s 660 93 897
GPT-5.3-Codex 10.0 10.0 100.0% 0 3.04s 660 93 693
GPT-5.2 9.9 10.0 100.0% 0 3.12s 660 94 614
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 8.2 7.2 88.9% 1 9.14s 642 441 3,815
GPT-5.3-Codex 9.0 7.9 88.9% 1 5.05s 642 356 1,593
GPT-5.2 7.5 7.3 77.8% 1 5.80s 642 735 924
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 13.28s 5,445 264 1,031
GPT-5.3-Codex 10.0 10.0 100.0% 0 6.37s 5,445 254 492
GPT-5.2 4.7 1.6 66.7% 1 10.30s 5,453 239 469
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 3.0 10.0 0.0% 0 13.95s 195 30 1,821
GPT-5.3-Codex 2.8 1.6 33.3% 1 14.43s 195 30 1,701
GPT-5.2 3.0 10.0 0.0% 0 28.18s 195 26 3,223

Quick Compare

Switch Comparison Pair

DeepSeek V4 FlashhighvsGPT-5.2mediumDeepSeek V4 FlashhighvsGPT-5.4mediumGemini 3.5 FlashlowvsGPT-5.3-CodexmediumDeepSeek V4 FlashhighvsGPT-5.3-CodexmediumGPT-5.2mediumvsStep 3.7 FlashlowGemini 3.5 FlashlowvsGPT-5.4mediumDeepSeek V4 ProhighvsGPT-5.2mediumGPT-5.4mediumvsStep 3.7 FlashlowGemini 3.5 FlashlowvsGPT-5.2mediumGemini 3.5 FlashhighvsGPT-5.3-CodexmediumDeepSeek V4 ProhighvsGPT-5.4mediumGemini 3 Flash PreviewlowvsGPT-5.2medium