Navigate
Advertise here

Mercury 2.5 (low) vs Inkling 2 Mini (max)

The average score is effectively tied at 5.1 vs 5.1. Mercury 2.5 (low) has the lower benchmark cost at $0.020 vs $0.807. Mercury 2.5 (low) is faster at 3.34s vs 101.15s, with pass rates of 37.7% vs 44.9%.

Last updated at: 2026-11-22

Compared models

Rank
#423
Total Output Tokens
40,302
Response Time (avg)
3.34s
Total Cost
$0.020
Rank
#422
Total Output Tokens
1,905,544
Response Time (avg)
101.15s
Total Cost
$0.807
Recommended model Mercury 2.5 (low)

It has the best score here (5.1), while costing about 42.3x less than Inkling 2 Mini (max).

Detailed comparison

Metric Mercury 2.5 Mercury 2.5 low Release: 2026-09-08 Inkling 2 Mini Inkling 2 Mini max Release: 2026-11-20
Score 5.1 5.1
Rank #423 #422
Reliability 9.8 10.0
Consistency 8.2 8.8
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 37.7% 44.9%
Flaky tests 5 3
Total Runs 69 69
Cost per result 0.319 8.966
Total Cost $0.020 $0.807
Input Price $0.040 / 1M $0.100 / 1M
Output Price $0.150 / 1M $0.400 / 1M
Cache Read Price $0.004 / 1M $0.020 / 1M
Cache Write Price N/A N/A
Total Input Tokens 326,083 447,169
Output Tokens 7,224 13,089
Reasoning Tokens 33,078 1,892,455
Response Time (avg) 3.34s 101.15s
Response Time (max) 47.06s 329.72s
Response Time (total) 76.80s 2326.39s
Parameters ~100B 26.4B total (3.4B active)
Availability Closed Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#423 Mercury 2.5

low
Cost
$0.001
Time
2.4s
Tokens
1,236 tok

#422 Thinking Machines: Inkling 2 Mini

max
Cost
$0.003
Time
48.7s
Tokens
7,967 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2.5 5.5 10.0 33.3% 0 972ms 7,909 521 2,269
Inkling 2 Mini 2.9 10.0 0.0% 0 222.76s 8,814 0 589,824

Switch Comparison Pair