Navigate
Advertise here

Qwen3.8 27B (medium) vs Step 3.7 Flash (low)

The average score is effectively tied at 7.2 vs 7.2. Qwen3.8 27B (medium) has the lower benchmark cost at ~$0.073 vs $0.449. Step 3.7 Flash (low) is faster at 20.72s vs 40.09s, with pass rates of 66.7% vs 63.8%.

Last updated at: 2026-11-13

Compared models

Rank
#209
Total Output Tokens
170,696
Response Time (avg)
40.09s
Total Cost
~$0.073
Rank
#215
Total Output Tokens
339,108
Response Time (avg)
20.72s
Total Cost
$0.449
Recommended model Qwen3.8 27B (medium)

It has the best score here (7.2), while costing about 6.2x less than Step 3.7 Flash (low).

Detailed comparison

Metric Qwen3.8 27B Qwen3.8 27B medium Release: 2026-08-14 Free Available Step 3.7 Flash Step 3.7 Flash low Release: 2026-05-29
Score 7.2 7.2
Rank #209 #215
Reliability 9.7 10.0
Consistency 9.4 7.9
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 66.7% 63.8%
Flaky tests 2 6
Total Runs 69 69
Cost per result ~0.520 4.078
Total Cost ~$0.073 $0.449
Input Price N/A $0.200 / 1M
Output Price N/A $1.150 / 1M
Cache Read Price N/A $0.040 / 1M
Cache Write Price N/A N/A
Total Input Tokens 277,164 292,685
Output Tokens 1,913 339,108
Reasoning Tokens 168,783 0
Response Time (avg) 40.09s 20.72s
Response Time (max) 214.63s 124.75s
Response Time (total) 881.89s 476.67s
Parameters 27.3B 198B total (11B active)
Availability Weights available Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#209 Qwen3.8 27B

medium
Cost
~$0.002
Time
43.4s
Tokens
2,956 tok

#215 Step 3.7 Flash

low
Invalid SVG
Cost
$0.004
Time
25.3s
Tokens
3,072 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.8 27B 10.0 10.0 100.0% 0 40.50s 7,893 585 26,808
Step 3.7 Flash 8.2 7.2 88.9% 1 9.46s 7,437 18,685 0

Switch Comparison Pair