Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

Inception: Mercury 2 vs xAI: Grok 4.20

Summary

Mercury 2 vs Grok 4.20 benchmark comparison: Mercury 2 leads on average score with 4.6 vs 4.4. Mercury 2 has the lower benchmark cost at $0.011 vs $0.057. Mercury 2 is faster at 653ms vs 1.11s, with pass rates of 23.8% vs 28.6%.

Recommended model: Mercury 2 - It has the best score here (4.6), while costing about 5.5x less than Grok 4.20.

Last updated at: 2026-06-18

Metric Mercury 2 Mercury 2 none Release: 2026-02-24 Grok 4.20 Grok 4.20 none Release: 2026-03-31
Score 4.6 4.4
Rank #151 #155
Reliability 10.0 N/A
Consistency 9.2 8.5
Tests Correct
Attempt pass rate 23.8% 28.6%
Flaky tests 2 0
Total Runs 63 54
Cost per result 0.259 1.570
Total Cost $0.011 $0.057
Input Price $0.250 / 1M $1.250 / 1M
Output Price $0.750 / 1M $2.500 / 1M
Total Input Tokens 28,113 41,313
Output Tokens 4,439 1,923
Reasoning Tokens 0 0
Response Time (avg) 653ms 1.11s
Response Time (max) 1.43s 6.04s
Response Time (total) 13.72s 19.96s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#151 Mercury 2

none
Cost
$0.002
Time
1.8s
Tokens
1,514 tok

#155 xAI: Grok 4.20

none
Cost
$0.004
Time
6.5s
Tokens
1,367 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 3.0 10.0 0.0% 0 483ms 631 286 0
Grok 4.20 4.8 10.0 25.0% 0 501ms 1,986 267 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 3.4 9.6 0.0% 0 1.03s 7,229 3,088 0
Grok 4.20 1.1 3.1 0.0% 0 1.22s 1,074 312 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 3.0 10.0 0.0% 0 606ms 4,821 131 0
Grok 4.20 3.0 10.0 0.0% 0 6.04s 17,673 282 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 7.3 5.9 83.3% 1 667ms 6,362 180 0
Grok 4.20 10.0 10.0 100.0% 0 522ms 7,749 207 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 5.3 7.2 44.4% 1 534ms 784 46 0
Grok 4.20 3.0 10.0 0.0% 0 687ms 1,746 325 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 4.8 10.0 0.0% 0 628ms 495 159 0
Grok 4.20 4.8 10.0 0.0% 0 659ms 819 83 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 6.5 10.0 50.0% 0 551ms 691 82 0
Grok 4.20 6.3 10.0 50.0% 0 445ms 1,350 60 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 3.1 10.0 0.0% 0 535ms 694 251 0
Grok 4.20 5.3 10.0 33.3% 0 473ms 1,671 198 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 10.0 10.0 100.0% 0 1.27s 6,193 197 0
Grok 4.20 10.0 10.0 100.0% 0 4.63s 7,245 189 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 3.0 10.0 0.0% 0 548ms 213 19 0
Grok 4.20 0.0 0.0 0.0% 0 0ms 0 0 0

Quick Compare

Switch Comparison Pair

Mercury 2nonevsQwen3 Coder NextmediumGrok 4.20nonevsGLM 4.7 FlashmediumMercury 2nonevsMiniMax M2.5mediumCobuddymediumvsMercury 2noneQwen3 Coder NextmediumvsGrok 4.20noneMercury 2nonevsGLM 4.7 FlashmediumMiniMax M2.5mediumvsGrok 4.20noneMercury 2nonevsMistral Small 4mediumMercury 2nonevsMiniMax M2.7mediumCobuddymediumvsGrok 4.20noneQwen3.5-9BmediumvsGrok 4.20noneMistral Small 4mediumvsGrok 4.20none