Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

Elephant vs xAI: Grok 4.20

Last updated at: 2026-04-14

Metric Elephant Elephant none Release: 2026-04-14 Grok 4.20 Grok 4.20 none Release: 2026-03-31
Score 5.2 5.2
Rank #81 #78
Consistency 9.6 9.5
Tests Correct
Attempt pass rate 31.5% 29.6%
Flaky tests 1 1
Total Runs 54 54
Cost per result 0.000 1.889
Total Cost $0.000 $0.095
Input Price $0.000 / 1M $2.000 / 1M
Output Price $0.000 / 1M $6.000 / 1M
Output Tokens 2,573 1,967
Reasoning Tokens 0 0
Response Time (avg) 1.23s 1.11s
Response Time (max) 3.81s 6.04s
Response Time (total) 22.16s 20.02s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Elephant 6.6 10.0 50.0% 0 963ms 610 0
Grok 4.20 4.8 10.0 25.0% 0 501ms 267 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Elephant 6.4 3.3 66.7% 1 1.39s 375 0
Grok 4.20 3.4 9.3 0.0% 0 1.22s 312 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Elephant 3.0 10.0 0.0% 0 3.81s 731 0
Grok 4.20 3.0 10.0 0.0% 0 6.04s 282 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Elephant 6.5 10.0 50.0% 0 1.04s 246 0
Grok 4.20 10.0 10.0 100.0% 0 522ms 207 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Elephant 3.0 10.0 0.0% 0 927ms 24 0
Grok 4.20 3.0 10.0 0.0% 0 687ms 325 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Elephant 4.0 10.0 0.0% 0 854ms 106 0
Grok 4.20 4.8 10.0 0.0% 0 659ms 83 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Elephant 9.8 10.0 100.0% 0 1.03s 81 0
Grok 4.20 4.8 10.0 0.0% 0 455ms 60 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Elephant 3.3 10.0 0.0% 0 849ms 170 0
Grok 4.20 5.3 7.4 44.4% 1 487ms 242 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Elephant 3.0 10.0 0.0% 0 2.79s 230 0
Grok 4.20 10.0 10.0 100.0% 0 4.63s 189 0

Quick Compare

Switch Comparison Pair

ElephantmediumvsGrok 4.20noneMiniMax M2.7mediumvsGrok 4.20noneMiniMax M2.7mediumvsElephantnoneMistral Small 4mediumvsGrok 4.20noneMistral Small 4mediumvsElephantnoneElephantnonevsQwen3 Coder NextmediumMiniMax M2.5mediumFree AvailablevsGrok 4.20noneQwen3 Coder NextmediumvsGrok 4.20noneMiniMax M2.5mediumFree AvailablevsElephantnoneElephantnonevsGLM 4.7 FlashmediumGrok 4.20nonevsGLM 4.7 Flashmediumgpt-oss-120bmediumFree AvailablevsGrok 4.20none