Navigate
Advertise here

Dots 3 Note Preview (default) vs GPT-4o-mini (default)

The average score is effectively tied at 5.0 vs 5.0. Dots 3 Note Preview (default) has the lower benchmark cost at $0.000 vs $0.024. GPT-4o-mini (default) is faster at 4.16s vs 5.36s, with pass rates of 15.9% vs 21.7%.

Last updated at: 2026-11-17

Compared models

Rank
#416
Total Output Tokens
22,507
Response Time (avg)
5.36s
Total Cost
$0.000
Rank
#417
Total Output Tokens
3,627
Response Time (avg)
4.16s
Total Cost
$0.024
Recommended model GPT-4o-mini (default)

It has the strongest score in this comparison (5.0) and the best overall balance of cost and response time across 2 models.

Detailed comparison

Metric Dots 3 Note Preview Dots 3 Note Preview default Release: 2026-08-14 Free Available GPT-4o-mini GPT-4o-mini default Release: 2024-07-18
Score 5.0 5.0
Rank #416 #417
Reliability 10.0 10.0
Consistency 9.7 9.9
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 15.9% 21.7%
Flaky tests 1 0
Total Runs 69 69
Cost per result 0.000 0.480
Total Cost $0.000 $0.024
Input Price $0.000 / 1M $0.150 / 1M
Output Price $0.000 / 1M $0.600 / 1M
Cache Read Price N/A $0.075 / 1M
Cache Write Price N/A N/A
Total Input Tokens 225,907 145,180
Output Tokens 22,507 3,627
Reasoning Tokens 0 0
Response Time (avg) 5.36s 4.16s
Response Time (max) 45.71s 39.99s
Response Time (total) 123.38s 70.70s
Parameters 280B total (16B active) ~8B
Availability Open source Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#416 Dots 3 Note Preview

default
Cost
$0.000
Time
88.3s
Tokens
10,531 tok

#417 GPT-4o-mini

default
Cost
$0.001
Time
6.6s
Tokens
742 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Dots 3 Note Preview 4.6 7.9 22.2% 1 6.12s 7,413 6,390 0
GPT-4o-mini 3.2 9.6 0.0% 0 1.63s 7,314 367 0

Switch Comparison Pair