Navigate
Advertise here

Mercury 2.5 Preview (high) vs Grok 4.3 (medium)

The average score is effectively tied at 6.5 vs 6.5. Mercury 2.5 Preview (high) has the lower benchmark cost at $0.040 vs $0.989. Mercury 2.5 Preview (high) is faster at 7.61s vs 44.53s, with pass rates of 65.2% vs 63.8%.

Last updated at: 2026-11-13

Compared models

Rank
#270
Total Output Tokens
180,597
Response Time (avg)
7.61s
Total Cost
$0.040
Rank
#276
Total Output Tokens
232,542
Response Time (avg)
44.53s
Total Cost
$0.989
Recommended model Mercury 2.5 Preview (high)

It has the best score here (6.5), while costing about 25.3x less than Grok 4.3 (medium).

Detailed comparison

Metric Mercury 2.5 Preview Mercury 2.5 Preview high Release: 2026-09-02 Grok 4.3 Grok 4.3 medium Release: 2026-05-01
Score 6.5 6.5
Rank #270 #276
Reliability 9.9 10.0
Consistency 8.0 8.3
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 65.2% 63.8%
Flaky tests 6 5
Total Runs 69 69
Cost per result 0.319 8.235
Total Cost $0.040 $0.989
Input Price $0.040 / 1M $1.250 / 1M
Output Price $0.150 / 1M $2.500 / 1M
Cache Read Price N/A $0.200 / 1M
Cache Write Price N/A N/A
Total Input Tokens 298,512 325,471
Output Tokens 3,178 14,867
Reasoning Tokens 177,419 217,675
Response Time (avg) 7.61s 44.53s
Response Time (max) 86.84s 216.69s
Response Time (total) 175.08s 1024.25s
Parameters ~100B ~1.5T total (~150B active)
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#270 Mercury 2.5 Preview

high
Cost
$0.001
Time
4.5s
Tokens
3,851 tok

#276 SpaceXAI: Grok 4.3

medium
Cost
$0.009
Time
19.0s
Tokens
3,661 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2.5 Preview 6.7 7.8 55.6% 1 6.13s 7,751 485 42,569
Grok 4.3 5.9 7.7 44.4% 1 41.23s 8,340 1,028 31,226

Switch Comparison Pair