Navigate
Advertise here

Step 3.5 Flash (medium) vs Hy4 preview (low)

The average score is effectively tied at 5.4 vs 5.4. Step 3.5 Flash (medium) has the lower benchmark cost at $0.105 vs $1.844. Step 3.5 Flash (medium) is faster at 190.48s vs 207.21s, with pass rates of 49.3% vs 21.7%.

Last updated at: 2026-11-13

Compared models

Rank
#374
Total Output Tokens
454,482
Response Time (avg)
190.48s
Total Cost
$0.105
Rank
#372
Total Output Tokens
687,477
Response Time (avg)
207.21s
Total Cost
$1.844
Recommended model Step 3.5 Flash (medium)

It has the best score here (5.4), while costing about 17.6x less than Hy4 preview (low).

Detailed comparison

Metric Step 3.5 Flash Step 3.5 Flash medium Release: 2026-02-01 Hy4 preview Hy4 preview low Release: 2026-08-29
Score 5.4 5.4
Rank #374 #372
Reliability 10.0 6.5
Consistency 8.3 8.2
Attempts 66/69 69/69
Tests Correct
Attempt pass rate 49.3% 21.7%
Flaky tests 3 4
Total Runs 66 69
Cost per result 1.047 61.455
Total Cost $0.105 $1.844
Input Price $0.100 / 1M $0.751 / 1M
Output Price $0.300 / 1M $2.251 / 1M
Cache Read Price N/A $0.038 / 1M
Cache Write Price N/A N/A
Total Input Tokens 139,086 162,180
Output Tokens 193,584 5,030
Reasoning Tokens 413,546 682,447
Response Time (avg) 190.48s 207.21s
Response Time (max) 1597.85s 597.45s
Response Time (total) 3238.23s 4765.91s
Parameters 196B total (11B active) 770B total (49B active)
Availability Open source Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#374 Step 3.5 Flash

medium
Cost
$0.008
Time
277.1s
Tokens
23,695 tok

#372 Hy4 preview

low
Provider returned error
Cost
$0.000
Time
1.1s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Step 3.5 Flash 2.4 5.2 0.0% 0 258.38s 2,211 13,207 22,429
Hy4 preview 5.2 8.6 0.0% 0 219.15s 6,110 135 96,407

Switch Comparison Pair