Navigate
Advertise here

Mercury 2 vs LFM3-1.7B (default)

Mercury 2 leads on average score with 4.4 vs 4.1. Mercury 2 has the lower benchmark cost at $0.033 vs $0.084. Mercury 2 is faster at 1.18s vs 16.99s, with pass rates of 23.2% vs 34.8%.

Last updated at: 2026-11-10

Compared models

Rank
#423
Total Output Tokens
9,709
Response Time (avg)
1.18s
Total Cost
$0.033
Rank
#430
Total Output Tokens
329,997
Response Time (avg)
16.99s
Total Cost
$0.084
Recommended model Mercury 2

It has the best score here (4.4), while costing about 2.6x less than LFM3-1.7B (default).

Detailed comparison

Metric Mercury 2 Mercury 2 none Release: 2026-02-24 LFM3-1.7B LFM3-1.7B default Release: 2026-11-06 Free Available
Score 4.4 4.1
Rank #423 #430
Reliability 10.0 10.0
Consistency 9.2 8.2
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 23.2% 34.8%
Flaky tests 2 5
Total Runs 69 69
Cost per result 0.812 1.672
Total Cost $0.033 $0.084
Input Price $0.250 / 1M $0.080 / 1M
Output Price $0.750 / 1M $0.200 / 1M
Cache Read Price $0.025 / 1M $0.020 / 1M
Cache Write Price N/A N/A
Total Input Tokens 100,634 219,830
Output Tokens 9,609 5,711
Reasoning Tokens 100 324,286
Response Time (avg) 1.18s 16.99s
Response Time (max) 9.00s 56.52s
Response Time (total) 27.14s 390.77s
Parameters ~100B 1.7B
Availability Closed Weights available

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#423 Mercury 2

none
Cost
$0.002
Time
1.8s
Tokens
1,514 tok

#430 LiquidAI: LFM3-1.7B

default
OpenRouter returned no showcase content (finish_reason: length).
Cost
$0.002
Time
23.3s
Tokens
8,320 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 3.4 9.6 0.0% 0 1.03s 7,229 3,088 0
LFM3-1.7B 2.9 10.0 0.0% 0 26.48s 7,461 0 73,728

Switch Comparison Pair