Navigate
Advertise here

Mercury 2 (medium) vs Inkling

Mercury 2 (medium) leads on average score with 6.6 vs 6.1. Mercury 2 (medium) has the lower benchmark cost at $0.121 vs $0.292. Mercury 2 (medium) is faster at 4.40s vs 5.30s, with pass rates of 53.6% vs 31.9%.

Last updated at: 2026-10-16

Compared models

Rank
#218
Total Output Tokens
96,943
Response Time (avg)
4.40s
Total Cost
$0.121
Rank
#264
Total Output Tokens
16,536
Response Time (avg)
5.30s
Total Cost
$0.292
Recommended model Mercury 2 (medium)

It has the best score here (6.6), while costing about 2.4x less than Inkling.

Detailed comparison

Metric Mercury 2 Mercury 2 medium Release: 2026-02-24 Inkling Inkling none Release: 2026-07-18 Free Available
Score 6.6 6.1
Rank #218 #264
Reliability 10.0 10.0
Consistency 8.1 9.6
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 53.6% 31.9%
Flaky tests 5 1
Total Runs 69 69
Cost per result 1.201 4.337
Total Cost $0.121 $0.292
Input Price $0.250 / 1M $0.950 / 1M
Output Price $0.750 / 1M $4.050 / 1M
Cache Read Price $0.025 / 1M $0.160 / 1M
Cache Write Price N/A N/A
Total Input Tokens 189,300 236,599
Output Tokens 10,854 11,561
Reasoning Tokens 86,089 4,975
Response Time (avg) 4.40s 5.30s
Response Time (max) 34.92s 48.02s
Response Time (total) 96.81s 121.91s
Parameters ~100B 975B total (41B active)
Availability Closed Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#218 Mercury 2

medium
Cost
$0.002
Time
2.1s
Tokens
1,702 tok

#264 Thinking Machines: Inkling

none
Provider returned error
Cost
$0.000
Time
5.3s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 8.2 7.7 77.8% 1 2.04s 7,065 296 11,328
Inkling 4.5 10.0 0.0% 0 1.01s 7,356 436 0

Switch Comparison Pair