Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Elephant vs xAI: Grok 4.20

Last updated at: 2026-04-14

Metric Elephant Elephant medium Release: 2026-04-14 Grok 4.20 Grok 4.20 none Release: 2026-03-31
Score 5.2 5.2
Rank #77 #78
Consistency 9.6 9.5
Tests Correct
Attempt pass rate 29.6% 29.6%
Flaky tests 1 1
Total Runs 54 54
Cost per result 0.000 1.889
Total Cost $0.000 $0.095
Input Price $0.000 / 1M $2.000 / 1M
Output Price $0.000 / 1M $6.000 / 1M
Output Tokens 2,596 1,967
Reasoning Tokens 0 0
Response Time (avg) 1.27s 1.11s
Response Time (max) 3.70s 6.04s
Response Time (total) 22.82s 20.02s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Elephant 6.6 10.0 50.0% 0 1.19s 815 0
Grok 4.20 4.8 10.0 25.0% 0 501ms 267 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Elephant 5.1 3.3 33.3% 1 1.30s 365 0
Grok 4.20 3.4 9.3 0.0% 0 1.22s 312 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Elephant 3.0 10.0 0.0% 0 3.70s 562 0
Grok 4.20 3.0 10.0 0.0% 0 6.04s 282 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Elephant 6.5 10.0 50.0% 0 979ms 246 0
Grok 4.20 10.0 10.0 100.0% 0 522ms 207 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Elephant 3.0 10.0 0.0% 0 925ms 24 0
Grok 4.20 3.0 10.0 0.0% 0 687ms 325 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Elephant 4.3 10.0 0.0% 0 920ms 105 0
Grok 4.20 4.8 10.0 0.0% 0 659ms 83 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Elephant 9.8 10.0 100.0% 0 987ms 82 0
Grok 4.20 4.8 10.0 0.0% 0 455ms 60 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Elephant 3.7 10.0 0.0% 0 867ms 166 0
Grok 4.20 5.3 7.4 44.4% 1 487ms 242 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Elephant 3.0 10.0 0.0% 0 2.83s 231 0
Grok 4.20 10.0 10.0 100.0% 0 4.63s 189 0

Quick Compare

Switch Comparison Pair

Mistral Small 4nonevsElephantmediumgpt-oss-120bnoneFree AvailablevsElephantmediumMiniMax M2.7mediumvsGrok 4.20noneTrinity Large PreviewnoneFree AvailablevsElephantmediumGPT-5.4 MininonevsElephantmediumElephantmediumvsQwen3 Coder NextnoneNemotron 3 SupernoneFree AvailablevsElephantmediumElephantmediumvsGLM 5 TurbononeKimi K2.5nonevsElephantmediumElephantmediumvsGLM 5.1noneElephantmediumvsGLM 4.7 FlashnoneGPT-4o-mininonevsElephantmedium