Navigate
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Qwen3.5-27B vs Step 3.7 Flash (low)

Qwen3.5-27B leads on average score with 7.2 vs 7.2. Qwen3.5-27B has the lower benchmark cost at $0.116 vs $0.449. Qwen3.5-27B is faster at 9.98s vs 20.72s, with pass rates of 47.8% vs 63.8%.

Last updated at: 2026-11-13

Compared models

Rank
#206
Total Output Tokens
36,422
Response Time (avg)
9.98s
Total Cost
$0.116
Rank
#215
Total Output Tokens
339,108
Response Time (avg)
20.72s
Total Cost
$0.449
Recommended model Qwen3.5-27B

It has the best score here (7.2), while costing about 3.9x less than Step 3.7 Flash (low).

Detailed comparison

Metric Qwen3.5-27B Qwen3.5-27B none Release: 2026-02-24 Step 3.7 Flash Step 3.7 Flash low Release: 2026-05-29
Score 7.2 7.2
Rank #206 #215
Reliability 10.0 10.0
Consistency 9.4 7.9
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 47.8% 63.8%
Flaky tests 2 6
Total Runs 69 69
Cost per result 1.153 4.078
Total Cost $0.116 $0.449
Input Price $0.195 / 1M $0.200 / 1M
Output Price $1.560 / 1M $1.150 / 1M
Cache Read Price N/A $0.040 / 1M
Cache Write Price N/A N/A
Total Input Tokens 283,977 292,685
Output Tokens 36,422 339,108
Reasoning Tokens 0 0
Response Time (avg) 9.98s 20.72s
Response Time (max) 124.53s 124.75s
Response Time (total) 229.52s 476.67s
Parameters 27B 198B total (11B active)
Availability Open source Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#206 Qwen3.5-27B

none
Cost
$0.007
Time
42.9s
Tokens
4,273 tok

#215 Step 3.7 Flash

low
Invalid SVG
Cost
$0.004
Time
25.3s
Tokens
3,072 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-27B 5.8 10.0 33.3% 0 1.80s 7,913 415 0
Step 3.7 Flash 8.2 7.2 88.9% 1 9.46s 7,437 18,685 0

Switch Comparison Pair