Navigate
Advertise here

GPT-5.4 Mini (medium) vs Qwen3.8 2.4T A95B (high)

GPT-5.4 Mini (medium) leads on average score with 7.9 vs 7.9. GPT-5.4 Mini (medium) has the lower benchmark cost at $1.102 vs $2.949. GPT-5.4 Mini (medium) is faster at 29.94s vs 120.88s, with pass rates of 69.6% vs 75.4%.

Last updated at: 2026-11-16

Compared models

Rank
#158
Total Output Tokens
184,172
Response Time (avg)
29.94s
Total Cost
$1.102
Rank
#163
Total Output Tokens
368,836
Response Time (avg)
120.88s
Total Cost
$2.949
Recommended model GPT-5.4 Mini (medium)

It has the best score here (7.9), while costing about 2.7x less than Qwen3.8 2.4T A95B (high).

Detailed comparison

Metric GPT-5.4 Mini GPT-5.4 Mini medium Release: 2026-03-17 Qwen3.8 2.4T A95B Qwen3.8 2.4T A95B high Release: 2026-08-12
Score 7.9 7.9
Rank #158 #163
Reliability 10.0 9.6
Consistency 8.2 8.4
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 69.6% 75.4%
Flaky tests 5 4
Total Runs 69 69
Cost per result 7.754 18.696
Total Cost $1.102 $2.949
Input Price $0.750 / 1M $2.000 / 1M
Output Price $4.500 / 1M $6.000 / 1M
Cache Read Price $0.075 / 1M $0.250 / 1M
Cache Write Price N/A N/A
Total Input Tokens 238,925 295,642
Output Tokens 7,109 115,041
Reasoning Tokens 177,063 353,398
Response Time (avg) 29.94s 120.88s
Response Time (max) 138.75s 532.28s
Response Time (total) 688.57s 2780.16s
Parameters ~400B total (~17B active) 2.4T total (95B active)
Availability Closed Weights available

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#158 GPT-5.4 Mini

medium
Cost
$0.056
Time
95.5s
Tokens
12,464 tok

#163 Qwen3.8 2.4T A95B

high
Reached the allocated time limit (600 seconds) without receiving showcase output.
Cost
$0.000
Time
600.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 Mini 8.4 7.4 88.9% 1 57.87s 7,305 467 40,902
Qwen3.8 2.4T A95B 5.9 6.3 55.6% 1 160.52s 6,399 3,310 48,078

Switch Comparison Pair