Navigate
Advertise here

Qwen4 Max vs Step 5 Preview (high)

The average score is effectively tied at 7.0 vs 7.0. Qwen4 Max has the lower benchmark cost at $0.465 vs $4.513. Qwen4 Max is faster at 6.38s vs 154.41s, with pass rates of 63.8% vs 52.2%.

Last updated at: 2026-11-16

Compared models

Rank
#230
Total Output Tokens
9,342
Response Time (avg)
6.38s
Total Cost
$0.465
Rank
#233
Total Output Tokens
1,581,325
Response Time (avg)
154.41s
Total Cost
$4.513
Recommended model Qwen4 Max

It has the best score here (7.0), while costing about 9.7x less than Step 5 Preview (high).

Detailed comparison

Metric Qwen4 Max Qwen4 Max none Release: 2026-11-16 Step 5 Preview Step 5 Preview high Release: 2026-10-09
Score 7.0 7.0
Rank #230 #233
Reliability 10.0 9.5
Consistency 9.6 8.5
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 63.8% 52.2%
Flaky tests 1 4
Total Runs 69 69
Cost per result 3.321 45.130
Total Cost $0.465 $4.513
Input Price $1.500 / 1M $1.000 / 1M
Output Price $4.500 / 1M $2.700 / 1M
Cache Read Price $0.075 / 1M $0.050 / 1M
Cache Write Price $1.875 / 1M N/A
Total Input Tokens 281,902 243,381
Output Tokens 9,342 1,581,325
Reasoning Tokens 0 0
Response Time (avg) 6.38s 154.41s
Response Time (max) 67.27s 455.72s
Response Time (total) 146.64s 3551.40s
Parameters ~2.4T total (~95B active) 600B total (27B active)
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#230 Qwen4 Max

none
Cost
$0.027
Time
123.5s
Tokens
6,091 tok

#233 Step 5 Preview

high
Cost
$0.057
Time
150.1s
Tokens
20,970 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen4 Max 5.8 10.0 33.3% 0 1.97s 8,010 384 0
Step 5 Preview 2.9 10.0 0.0% 0 421.68s 7,383 576,000 0

Switch Comparison Pair