Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Inception: Mercury 2 vs xAI: Grok 4.3

Summary

Mercury 2 vs Grok 4.3 benchmark comparison: Grok 4.3 leads on average score with 7.7 vs 7.5. Mercury 2 has the lower benchmark cost at $0.058 vs $0.614. Mercury 2 is faster at 2.24s vs 47.51s, with pass rates of 54.0% vs 71.4%.

Recommended model: Mercury 2 - Its score stays close to the best score here (7.5 vs 7.7), while costing about 10.6x less than Grok 4.3.

Last updated at: 2026-06-18

Metric Mercury 2 Mercury 2 medium Release: 2026-02-24 Grok 4.3 Grok 4.3 medium Release: 2026-05-01
Score 7.5 7.7
Rank #44 #37
Reliability 10.0 10.0
Consistency 8.8 8.5
Tests Correct
Attempt pass rate 54.0% 71.4%
Flaky tests 3 4
Total Runs 63 63
Cost per result 0.578 4.724
Total Cost $0.058 $0.614
Input Price $0.250 / 1M $1.250 / 1M
Output Price $0.750 / 1M $2.500 / 1M
Total Input Tokens 35,116 44,472
Output Tokens 4,048 1,981
Reasoning Tokens 61,219 221,382
Response Time (avg) 2.24s 47.51s
Response Time (max) 14.63s 216.69s
Response Time (total) 44.72s 997.68s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#44 Mercury 2

medium
Cost
$0.002
Time
2.1s
Tokens
1,702 tok

#37 xAI: Grok 4.3

medium
Cost
$0.009
Time
19.0s
Tokens
3,661 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 6.9 9.9 50.0% 0 1.12s 554 2,546 2,609
Grok 4.3 10.0 10.0 100.0% 0 8.83s 2,010 88 8,207
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 8.2 7.7 77.8% 1 2.04s 7,065 296 11,328
Grok 4.3 5.9 7.7 44.4% 1 41.23s 8,340 1,028 31,226
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 10.0 10.0 100.0% 0 3.28s 12,909 268 4,887
Grok 4.3 10.0 10.0 100.0% 0 63.99s 12,909 234 15,301
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 7.3 5.9 83.3% 1 1.11s 6,234 183 1,656
Grok 4.3 10.0 10.0 100.0% 0 18.97s 7,761 180 9,546
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 2.9 7.2 11.1% 1 6.48s 695 41 30,754
Grok 4.3 5.3 7.2 44.4% 1 181.74s 1,764 14 111,300
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 4.8 10.0 0.0% 0 821ms 456 137 542
Grok 4.3 5.4 2.5 66.7% 1 24.70s 825 70 5,020
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 10.0 10.0 100.0% 0 1.07s 340 14 958
Grok 4.3 9.8 10.0 100.0% 0 18.58s 1,362 57 8,713
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 5.4 10.0 33.3% 0 949ms 601 361 2,781
Grok 4.3 5.9 7.2 55.6% 1 22.52s 1,689 128 14,468
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 10.0 10.0 100.0% 0 1.89s 6,080 180 1,956
Grok 4.3 10.0 10.0 100.0% 0 17.66s 7,263 168 4,615
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 3.0 10.0 0.0% 0 2.58s 182 22 3,748
Grok 4.3 3.0 10.0 0.0% 0 44.47s 549 14 12,986

Quick Compare

Switch Comparison Pair

Step 3.7 FlashlowvsGrok 4.3mediumMercury 2mediumvsGPT-5.3 ChatnoneDeepSeek V4 ProhighvsMercury 2mediumDeepSeek V4 ProhighvsGrok 4.3mediumMercury 2mediumvsStep 3.7 FlashlowGemini 3 Flash PreviewlowvsMercury 2mediumGPT-5.3 ChatnonevsGrok 4.3mediumClaude Sonnet 4.6nonevsMercury 2mediumClaude Opus 4.8nonevsMercury 2mediumGemini 3 Flash PreviewlowvsGrok 4.3mediumDeepSeek V4 PrononevsMercury 2mediumMercury 2mediumvsQwen3.7 Plusnone