Navigate
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Dots 3 Note Preview (low) vs Mercury 2.5 (medium)

The average score is effectively tied at 6.4 vs 6.4. Dots 3 Note Preview (low) has the lower benchmark cost at $0.000 vs $0.034. Mercury 2.5 (medium) is faster at 7.74s vs 66.13s, with pass rates of 58.0% vs 63.8%.

Last updated at: 2026-11-13

Compared models

Rank
#291
Total Output Tokens
600,852
Response Time (avg)
66.13s
Total Cost
$0.000
Rank
#286
Total Output Tokens
138,946
Response Time (avg)
7.74s
Total Cost
$0.034
Recommended model Mercury 2.5 (medium)

It has the best score here (6.4), while responding about 8.5x faster than Dots 3 Note Preview (low).

Detailed comparison

Metric Dots 3 Note Preview Dots 3 Note Preview low Release: 2026-08-14 Free Available Mercury 2.5 Mercury 2.5 medium Release: 2026-09-08
Score 6.4 6.4
Rank #291 #286
Reliability 10.0 9.7
Consistency 8.0 8.3
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 58.0% 63.8%
Flaky tests 6 5
Total Runs 69 69
Cost per result 0.000 0.280
Total Cost $0.000 $0.034
Input Price $0.000 / 1M $0.040 / 1M
Output Price $0.000 / 1M $0.150 / 1M
Cache Read Price N/A $0.004 / 1M
Cache Write Price N/A N/A
Total Input Tokens 260,850 317,982
Output Tokens 125,908 3,918
Reasoning Tokens 516,424 135,028
Response Time (avg) 66.13s 7.74s
Response Time (max) 417.36s 107.89s
Response Time (total) 1520.96s 178.07s
Parameters 280B total (16B active) ~100B
Availability Open source Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#291 Dots 3 Note Preview

low
Cost
$0.000
Time
64.3s
Tokens
8,666 tok

#286 Mercury 2.5

medium
Cost
$0.001
Time
3.8s
Tokens
3,386 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Dots 3 Note Preview 5.9 7.2 55.6% 1 287.61s 7,368 52,120 338,264
Mercury 2.5 5.0 5.1 44.5% 2 3.70s 7,807 488 21,857

Switch Comparison Pair