Navigate
Advertise here

Claude Sonnet 5.5 (low) vs Mercury 2.5 Preview (medium)

The average score is effectively tied at 6.9 vs 6.8. Mercury 2.5 Preview (medium) has the lower benchmark cost at $0.039 vs $0.909. Mercury 2.5 Preview (medium) is faster at 6.66s vs 7.46s, with pass rates of 46.4% vs 66.7%.

Last updated at: 2026-11-13

Compared models

Rank
#238
Total Output Tokens
32,443
Response Time (avg)
7.46s
Total Cost
$0.909
Rank
#243
Total Output Tokens
150,107
Response Time (avg)
6.66s
Total Cost
$0.039
Recommended model Mercury 2.5 Preview (medium)

It has the best score here (6.8), while costing about 23.6x less than Claude Sonnet 5.5 (low).

Detailed comparison

Metric Claude Sonnet 5.5 Claude Sonnet 5.5 low Release: 2026-09-29 Mercury 2.5 Preview Mercury 2.5 Preview medium Release: 2026-09-02
Score 6.9 6.8
Rank #238 #243
Reliability 10.0 10.0
Consistency 9.4 9.6
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 46.4% 66.7%
Flaky tests 2 1
Total Runs 69 69
Cost per result 9.082 0.244
Total Cost $0.909 $0.039
Input Price $2.000 / 1M $0.040 / 1M
Output Price $10.000 / 1M $0.150 / 1M
Cache Read Price $0.200 / 1M N/A
Cache Write Price $2.500 / 1M N/A
Total Input Tokens 291,853 397,291
Output Tokens 24,116 6,355
Reasoning Tokens 8,327 143,752
Response Time (avg) 7.46s 6.66s
Response Time (max) 46.61s 74.63s
Response Time (total) 171.47s 153.29s
Parameters ~1T total (~100B active) ~100B
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#238 Claude Sonnet 5.5

low
Cost
$0.020
Time
15.3s
Tokens
2,077 tok

#243 Mercury 2.5 Preview

medium
Cost
$0.001
Time
2.7s
Tokens
2,241 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Sonnet 5.5 3.2 9.7 0.0% 0 5.81s 10,608 5,903 0
Mercury 2.5 Preview 7.8 10.0 66.7% 0 3.86s 7,839 552 22,126

Switch Comparison Pair