Navigate
Advertise here

Dots 3 Note Preview (medium) vs GPT-5.4

Dots 3 Note Preview (medium) leads on average score with 5.7 vs 5.6. Dots 3 Note Preview (medium) has the lower benchmark cost at $0.000 vs $0.690. GPT-5.4 is faster at 3.89s vs 70.32s, with pass rates of 58.0% vs 33.3%.

Last updated at: 2026-11-13

Compared models

Rank
#351
Total Output Tokens
661,931
Response Time (avg)
70.32s
Total Cost
$0.000
Rank
#354
Total Output Tokens
9,372
Response Time (avg)
3.89s
Total Cost
$0.690
Recommended model GPT-5.4

Its score stays close to the best score here (5.6 vs 5.7), while responding about 18.1x faster than Dots 3 Note Preview (medium).

Detailed comparison

Metric Dots 3 Note Preview Dots 3 Note Preview medium Release: 2026-08-14 Free Available GPT-5.4 GPT-5.4 none Release: 2026-03-05
Score 5.7 5.6
Rank #351 #354
Reliability 10.0 10.0
Consistency 6.9 9.3
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 58.0% 33.3%
Flaky tests 9 2
Total Runs 69 69
Cost per result 0.000 9.845
Total Cost $0.000 $0.690
Input Price $0.000 / 1M $2.500 / 1M
Output Price $0.000 / 1M $15.000 / 1M
Cache Read Price N/A $0.250 / 1M
Cache Write Price N/A N/A
Total Input Tokens 208,598 219,404
Output Tokens 120,583 9,372
Reasoning Tokens 590,044 0
Response Time (avg) 70.32s 3.89s
Response Time (max) 459.19s 43.73s
Response Time (total) 1617.43s 89.48s
Parameters 280B total (16B active) ~1.5T total (~100B active)
Availability Open source Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#351 Dots 3 Note Preview

medium
Cost
$0.000
Time
585.4s
Tokens
12,198 tok

#354 GPT-5.4

none
Cost
$0.026
Time
18.1s
Tokens
1,792 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Dots 3 Note Preview 4.2 5.1 33.3% 2 309.15s 7,368 29,392 373,137
GPT-5.4 5.5 10.0 33.3% 0 1.62s 7,305 516 0

Switch Comparison Pair