Navigate
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Mercury 2 (medium) vs Step 3.7 Flash (high)

The average score is effectively tied at 6.6 vs 6.6. Mercury 2 (medium) has the lower benchmark cost at $0.121 vs $1.478. Mercury 2 (medium) is faster at 4.40s vs 72.72s, with pass rates of 53.6% vs 58.0%.

Last updated at: 2026-11-16

Compared models

Rank
#268
Total Output Tokens
96,943
Response Time (avg)
4.40s
Total Cost
$0.121
Rank
#269
Total Output Tokens
1,100,052
Response Time (avg)
72.72s
Total Cost
$1.478
Recommended model Mercury 2 (medium)

It has the best score here (6.6), while costing about 12.3x less than Step 3.7 Flash (high).

Detailed comparison

Metric Mercury 2 Mercury 2 medium Release: 2026-02-24 Step 3.7 Flash Step 3.7 Flash high Release: 2026-05-29
Score 6.6 6.6
Rank #268 #269
Reliability 10.0 10.0
Consistency 8.1 8.5
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 53.6% 58.0%
Flaky tests 5 4
Total Runs 69 69
Cost per result 1.201 12.267
Total Cost $0.121 $1.478
Input Price $0.250 / 1M $0.200 / 1M
Output Price $0.750 / 1M $1.150 / 1M
Cache Read Price $0.025 / 1M $0.040 / 1M
Cache Write Price N/A N/A
Total Input Tokens 189,300 421,200
Output Tokens 10,854 1,100,052
Reasoning Tokens 86,089 0
Response Time (avg) 4.40s 72.72s
Response Time (max) 34.92s 364.99s
Response Time (total) 96.81s 1672.53s
Parameters ~100B 198B total (11B active)
Availability Closed Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#268 Mercury 2

medium
Cost
$0.002
Time
2.1s
Tokens
1,702 tok

#269 Step 3.7 Flash

high
Cost
$0.007
Time
63.6s
Tokens
6,030 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 8.2 7.7 77.8% 1 2.04s 7,065 296 11,328
Step 3.7 Flash 4.0 6.0 22.2% 1 206.21s 6,057 327,340 0

Switch Comparison Pair