Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

Compared models

Last updated at: 2026-03-12

Metric GPT-5.2 GPT-5.2 medium Release: 2025-12-11 GPT-5.3 Chat GPT-5.3 Chat none Release: 2026-03-03 GPT-5.4 GPT-5.4 none Release: 2026-03-05
Rank #29 #20 #51
Avg Score 6.5 7.3 4.5
Consistency 7.9 8.5 8.9
Cost per result 3.125 3.163 1.562
Total Cost $0.313 $0.317 $0.094
Tests Correct
Attempt pass rate 75.0% 70.8% 41.7%
Flaky tests 4 3 2
Total Runs 48 48 48
Output Tokens 2,220 19,272 1,819
Reasoning Tokens 16,811 0 0
Response Time (avg) 15.33s 5.96s 1.48s
Response Time (max) 77.80s 18.33s 2.89s
Response Time (total) 138.01s 95.30s 23.64s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Avg Score vs Response Time (avg)

Total Output Tokens

Avg Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 7.0 7.3 77.8% 1 14.34s 549 2,002
GPT-5.3 Chat 7.3 7.5 77.8% 1 4.72s 3,091 0
GPT-5.4 10.0 7.3 11.1% 1 1.41s 388 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 10.0 10.0 100.0% 0 14.06s 291 1,757
GPT-5.3 Chat 10.0 10.0 100.0% 0 11.96s 2,614 0
GPT-5.4 10.0 10.0 0.0% 0 2.89s 291 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 9.9 10.0 100.0% 0 3.15s 234 420
GPT-5.3 Chat 9.9 10.0 100.0% 0 2.21s 942 0
GPT-5.4 9.9 10.0 100.0% 0 1.04s 222 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 4.0 7.2 55.6% 1 77.80s 42 10,342
GPT-5.3 Chat 10.0 4.4 33.3% 2 13.01s 8,264 0
GPT-5.4 4.0 7.2 44.4% 1 1.07s 50 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 10.0 9.7 0.0% 0 4.32s 162 269
GPT-5.3 Chat 4.0 10.0 0.0% 0 1.99s 319 0
GPT-5.4 3.0 9.9 0.0% 0 1.78s 184 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 9.5 10.0 100.0% 0 3.12s 94 614
GPT-5.3 Chat 9.0 10.0 50.0% 0 3.29s 1,455 0
GPT-5.4 5.5 10.0 50.0% 0 1.07s 81 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 7.0 7.3 77.8% 1 5.47s 609 938
GPT-5.3 Chat 10.0 10.0 100.0% 0 2.93s 1,726 0
GPT-5.4 4.0 9.8 33.3% 0 1.52s 357 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 10.0 1.6 66.7% 1 10.30s 239 469
GPT-5.3 Chat 10.0 10.0 100.0% 0 8.36s 861 0
GPT-5.4 10.0 10.0 100.0% 0 2.75s 246 0

Quick Compare

Switch Comparison Pair

DeepSeek V3.2mediumvsGPT-5.3 ChatnoneGemini 3.1 Flash Lite PreviewlowvsGPT-5.3 ChatnoneGPT-5.3 ChatnonevsMiMo-V2-FlashmediumGemini 2.5 FlashmediumvsGPT-5.3 ChatnoneGPT-5.3 ChatnonevsGLM 5mediumGPT-5.3 ChatnonevsStep 3.5 FlashmediumFree AvailableMiniMax M2.5mediumvsGPT-5.4noneGemini 3.1 Flash Lite PreviewmediumvsGPT-5.3 ChatnoneClaude Sonnet 4.6nonevsGPT-5.2mediumGPT-5.2mediumvsQwen3.5 Plus 2026-02-15noneGPT-5.3 ChatnonevsGrok 4.20 BetamediumSeed-2.0-MinimediumvsGPT-5.3 Chatnone