Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

OpenAI: GPT-4o-mini vs xAI: Grok 4.20

Last updated at: 2026-04-29

Metric GPT-4o-mini GPT-4o-mini none Release: 2024-07-18 Grok 4.20 Grok 4.20 none Release: 2026-03-31
Score 4.9 5.2
Rank #119 #108
Reliability N/A N/A
Consistency 9.9 9.5
Tests Correct
Attempt pass rate 22.2% 29.6%
Flaky tests 0 1
Total Runs 54 54
Cost per result 0.122 1.889
Total Cost $0.005 $0.095
Input Price $0.150 / 1M $2.000 / 1M
Output Price $0.600 / 1M $6.000 / 1M
Output Tokens 1,947 1,967
Reasoning Tokens 0 0
Response Time (avg) 2.00s 1.11s
Response Time (max) 7.58s 6.04s
Response Time (total) 21.99s 20.02s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 4.8 10.0 25.0% 0 1.34s 186 0
Grok 4.20 4.8 10.0 25.0% 0 501ms 267 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 3.0 8.7 0.0% 0 2.55s 347 0
Grok 4.20 3.4 9.3 0.0% 0 1.22s 312 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 3.0 10.0 0.0% 0 7.58s 568 0
Grok 4.20 3.0 10.0 0.0% 0 6.04s 282 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 10.0 10.0 100.0% 0 1.27s 183 0
Grok 4.20 10.0 10.0 100.0% 0 522ms 207 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 3.0 10.0 0.0% 0 637ms 15 0
Grok 4.20 3.0 10.0 0.0% 0 687ms 325 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 4.0 10.0 0.0% 0 909ms 66 0
Grok 4.20 4.8 10.0 0.0% 0 659ms 83 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 4.8 10.0 0.0% 0 1.27s 69 0
Grok 4.20 4.8 10.0 0.0% 0 455ms 60 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 3.7 10.0 0.0% 0 1.30s 308 0
Grok 4.20 5.3 7.4 44.4% 1 487ms 242 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 10.0 10.0 100.0% 0 2.51s 205 0
Grok 4.20 10.0 10.0 100.0% 0 4.63s 189 0

Quick Compare

Switch Comparison Pair

Nemotron 3 Nano Omni 30b A3b ReasoningmediumFree AvailablevsGrok 4.20noneElephant AlphamediumvsGrok 4.20noneMiniMax M2.7mediumvsGrok 4.20noneGPT-4o-mininonevsQwen3 Coder NextmediumGPT-4o-mininonevsGLM 4.7 FlashmediumNemotron 3 Nano Omni 30b A3b ReasoningmediumFree AvailablevsGPT-4o-mininoneGPT-4o-mininonevsElephant AlphamediumMiniMax M2.7mediumvsGPT-4o-mininoneMistral Small 4mediumvsGrok 4.20noneMiniMax M2.5mediumFree AvailablevsGrok 4.20noneQwen3 Coder NextmediumvsGrok 4.20noneGPT-4o-mininonevsQwen3.5-9Bmedium