Navigate
Advertise here

GPT-5.4 Nano vs Qwen3 Coder Next (medium)

The average score is effectively tied at 4.6 vs 4.7. GPT-5.4 Nano has the lower benchmark cost at $0.068 vs $0.071. GPT-5.4 Nano is faster at 4.42s vs 16.97s, with pass rates of 26.1% vs 24.6%.

Last updated at: 2026-10-26

Compared models

Rank
#383
Total Output Tokens
14,894
Response Time (avg)
4.42s
Total Cost
$0.068
Rank
#381
Total Output Tokens
40,395
Response Time (avg)
16.97s
Total Cost
$0.071
Recommended model GPT-5.4 Nano

It has the best score here (4.6), while responding about 3.8x faster than Qwen3 Coder Next (medium).

Detailed comparison

Metric GPT-5.4 Nano GPT-5.4 Nano none Release: 2026-03-17 Qwen3 Coder Next Qwen3 Coder Next medium Release: 2026-02-03
Score 4.6 4.7
Rank #383 #381
Reliability 10.0 10.0
Consistency 8.7 8.7
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 26.1% 24.6%
Flaky tests 4 4
Total Runs 69 69
Cost per result 1.699 2.280
Total Cost $0.068 $0.071
Input Price $0.200 / 1M $0.120 / 1M
Output Price $1.250 / 1M $0.800 / 1M
Cache Read Price $0.020 / 1M $0.070 / 1M
Cache Write Price N/A N/A
Total Input Tokens 246,687 311,647
Output Tokens 14,894 40,395
Reasoning Tokens 0 0
Response Time (avg) 4.42s 16.97s
Response Time (max) 45.38s 151.35s
Response Time (total) 101.75s 305.55s
Parameters ~120B total (~5B active) 80B total (3B active)
Availability Closed Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#383 GPT-5.4 Nano

none
Cost
$0.008
Time
46.1s
Tokens
5,735 tok

#381 Qwen3 Coder Next

medium
Reached the allocated time limit (300 seconds) without receiving showcase output.
Cost
$0.000
Time
300.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 Nano 4.6 7.9 22.2% 1 2.22s 7,305 613 0
Qwen3 Coder Next 3.7 7.2 22.2% 1 924ms 7,185 336 0

Switch Comparison Pair