Navigate
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Step 3.7 Flash (low) vs GLM 5 (medium)

The average score is effectively tied at 7.2 vs 7.2. Step 3.7 Flash (low) has the lower benchmark cost at $0.449 vs $0.479. Step 3.7 Flash (low) is faster at 20.72s vs 39.05s, with pass rates of 63.8% vs 76.8%.

Last updated at: 2026-11-13

Compared models

Rank
#215
Total Output Tokens
339,108
Response Time (avg)
20.72s
Total Cost
$0.449
Rank
#214
Total Output Tokens
120,942
Response Time (avg)
39.05s
Total Cost
$0.479
Recommended model Step 3.7 Flash (low)

It has the best score here (7.2), while responding about 1.9x faster than GLM 5 (medium).

Detailed comparison

Metric Step 3.7 Flash Step 3.7 Flash low Release: 2026-05-29 GLM 5 GLM 5 medium Release: 2026-02-12
Score 7.2 7.2
Rank #215 #214
Reliability 10.0 10.0
Consistency 7.9 7.9
Attempts 69/69 66/69
Tests Correct
Attempt pass rate 63.8% 76.8%
Flaky tests 6 5
Total Runs 69 66
Cost per result 4.078 2.552
Total Cost $0.449 $0.479
Input Price $0.200 / 1M $0.600 / 1M
Output Price $1.150 / 1M $1.920 / 1M
Cache Read Price $0.040 / 1M $0.120 / 1M
Cache Write Price N/A N/A
Total Input Tokens 292,685 212,440
Output Tokens 339,108 22,922
Reasoning Tokens 0 115,335
Response Time (avg) 20.72s 39.05s
Response Time (max) 124.75s 110.70s
Response Time (total) 476.67s 546.68s
Parameters 198B total (11B active) 744B total (40B active)
Availability Open source Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#215 Step 3.7 Flash

low
Invalid SVG
Cost
$0.004
Time
25.3s
Tokens
3,072 tok

#214 GLM 5

medium
Cost
$0.005
Time
20.7s
Tokens
2,068 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Step 3.7 Flash 8.2 7.2 88.9% 1 9.46s 7,437 18,685 0
GLM 5 10.0 10.0 100.0% 0 74.30s 7,254 2,997 52,930

Switch Comparison Pair