Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

Compared models

Last updated at: 2026-03-12

Metric GPT-5.3 Chat GPT-5.3 Chat none Release: 2026-03-03 GPT-5.4 GPT-5.4 none Release: 2026-03-05 GPT-5.4 GPT-5.4 medium Release: 2026-03-05
Rank #20 #51 #10
Avg Score 7.3 4.5 8.0
Consistency 8.5 8.9 8.5
Cost per result 3.163 1.562 6.601
Total Cost $0.317 $0.094 $0.793
Tests Correct
Attempt pass rate 70.8% 41.7% 83.3%
Flaky tests 3 2 3
Total Runs 48 48 48
Output Tokens 19,272 1,819 1,756
Reasoning Tokens 0 0 46,642
Response Time (avg) 5.96s 1.48s 20.05s
Response Time (max) 18.33s 2.89s 100.41s
Response Time (total) 95.30s 23.64s 320.87s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Avg Score vs Response Time (avg)

Total Output Tokens

Avg Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.3 Chat 7.3 7.5 77.8% 1 4.72s 3,091 0
GPT-5.4 10.0 7.3 11.1% 1 1.41s 388 0
GPT-5.4 10.0 10.0 100.0% 0 5.02s 216 1,466
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.3 Chat 10.0 10.0 100.0% 0 11.96s 2,614 0
GPT-5.4 10.0 10.0 0.0% 0 2.89s 291 0
GPT-5.4 10.0 10.0 100.0% 0 20.57s 301 3,543
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.3 Chat 9.9 10.0 100.0% 0 2.21s 942 0
GPT-5.4 9.9 10.0 100.0% 0 1.04s 222 0
GPT-5.4 9.9 10.0 100.0% 0 5.32s 234 804
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.3 Chat 10.0 4.4 33.3% 2 13.01s 8,264 0
GPT-5.4 4.0 7.2 44.4% 1 1.07s 50 0
GPT-5.4 4.0 7.2 44.4% 1 74.27s 61 34,748
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.3 Chat 4.0 10.0 0.0% 0 1.99s 319 0
GPT-5.4 3.0 9.9 0.0% 0 1.78s 184 0
GPT-5.4 5.0 3.1 33.3% 1 4.92s 145 321
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.3 Chat 9.0 10.0 50.0% 0 3.29s 1,455 0
GPT-5.4 5.5 10.0 50.0% 0 1.07s 81 0
GPT-5.4 10.0 10.0 100.0% 0 3.11s 93 897
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.3 Chat 10.0 10.0 100.0% 0 2.93s 1,726 0
GPT-5.4 4.0 9.8 33.3% 0 1.52s 357 0
GPT-5.4 7.0 7.2 88.9% 1 9.13s 442 3,832
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.3 Chat 10.0 10.0 100.0% 0 8.36s 861 0
GPT-5.4 10.0 10.0 100.0% 0 2.75s 246 0
GPT-5.4 10.0 10.0 100.0% 0 13.28s 264 1,031

Quick Compare

Switch Comparison Pair

DeepSeek V3.2mediumvsGPT-5.3 ChatnoneGemini 3.1 Flash Lite PreviewlowvsGPT-5.3 ChatnoneGPT-5.3 ChatnonevsMiMo-V2-FlashmediumGemini 2.5 FlashmediumvsGPT-5.3 ChatnoneGPT-5.3 ChatnonevsGLM 5mediumGPT-5.3 ChatnonevsStep 3.5 FlashmediumFree AvailableGemini 3 Flash PreviewlowvsGPT-5.4mediumMiniMax M2.5mediumvsGPT-5.4noneGemini 3.1 Flash Lite PreviewmediumvsGPT-5.3 ChatnoneGPT-5.3 ChatnonevsGrok 4.20 BetamediumSeed-2.0-MinimediumvsGPT-5.3 ChatnoneGPT-5.3 ChatnonevsQwen3.5-Flashmedium