Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

OpenAI: GPT-5.4 vs xAI: Grok 4.20

Last updated at: 2026-04-16

Metric GPT-5.4 GPT-5.4 none Release: 2026-03-05 Grok 4.20 Grok 4.20 medium Release: 2026-03-31
Score 5.9 7.0
Rank #65 #46
Consistency 9.1 7.8
Tests Correct
Attempt pass rate 42.6% 66.7%
Flaky tests 2 5
Total Runs 54 54
Cost per result 1.477 8.252
Total Cost $0.104 $0.743
Input Price $2.500 / 1M $2.000 / 1M
Output Price $15.000 / 1M $6.000 / 1M
Output Tokens 2,317 1,744
Reasoning Tokens 0 109,882
Response Time (avg) 1.51s 10.33s
Response Time (max) 2.95s 29.87s
Response Time (total) 27.21s 185.87s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 3.2 8.0 8.3% 1 1.21s 406 0
Grok 4.20 8.2 7.9 83.3% 1 3.36s 280 8,476
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 2.95s 480 0
Grok 4.20 4.3 1.1 66.7% 1 24.33s 250 12,804
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 3.0 10.0 0.0% 0 2.89s 291 0
Grok 4.20 10.0 10.0 100.0% 0 17.40s 232 9,556
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 1.04s 222 0
Grok 4.20 10.0 10.0 100.0% 0 4.17s 180 5,333
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 5.3 7.2 44.4% 1 1.07s 50 0
Grok 4.20 5.3 10.0 33.3% 0 27.03s 375 49,339
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 4.4 9.9 0.0% 0 1.78s 184 0
Grok 4.20 5.8 2.8 66.7% 1 7.09s 47 4,252
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 6.5 10.0 50.0% 0 1.07s 81 0
Grok 4.20 7.3 5.9 83.3% 1 4.42s 40 5,474
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 5.6 9.8 33.3% 0 1.52s 357 0
Grok 4.20 6.4 7.7 55.6% 1 3.89s 143 8,028
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 2.75s 246 0
Grok 4.20 3.0 10.0 0.0% 0 13.68s 197 6,620

Quick Compare

Switch Comparison Pair

Gemma 4 31BnoneFree AvailablevsGrok 4.20mediumQwen3.5 Plus 2026-02-15nonevsGrok 4.20mediumMiniMax M2.5mediumFree AvailablevsGPT-5.4noneMistral Small 4mediumvsGPT-5.4noneGrok 4.20mediumvsGLM 5noneClaude Sonnet 4.6nonevsGrok 4.20mediumGrok 4.20mediumvsMiMo-V2-OmninoneMercury 2mediumvsGPT-5.4noneMiniMax M2.7mediumvsGPT-5.4noneGPT-5.4nonevsElephantmediumGPT-5.3 ChatnonevsGrok 4.20mediumGrok 4.20mediumvsGLM 5V Turbonone