Navigate
Advertise here

Step 3.7 Flash (medium) vs GLM 5.3 (high)

The average score is effectively tied at 7.8 vs 7.8. GLM 5.3 (high) has the lower benchmark cost at $0.495 vs $0.571. Step 3.7 Flash (medium) is faster at 26.57s vs 28.38s, with pass rates of 68.1% vs 75.4%.

Last updated at: 2026-11-16

Compared models

Rank
#170
Total Output Tokens
440,835
Response Time (avg)
26.57s
Total Cost
$0.571
Rank
#169
Total Output Tokens
68,482
Response Time (avg)
28.38s
Total Cost
$0.495
Recommended model GLM 5.3 (high)

It has the strongest score in this comparison (7.8) and the best overall balance of cost and response time across 2 models.

Detailed comparison

Metric Step 3.7 Flash Step 3.7 Flash medium Release: 2026-05-29 GLM 5.3 GLM 5.3 high Release: 2026-08-20
Score 7.8 7.8
Rank #170 #169
Reliability 10.0 10.0
Consistency 8.7 7.6
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 68.1% 75.4%
Flaky tests 4 7
Total Runs 69 69
Cost per result 4.392 4.351
Total Cost $0.571 $0.495
Input Price $0.200 / 1M $0.070 / 1M
Output Price $1.150 / 1M $7.000 / 1M
Cache Read Price $0.040 / 1M $0.065 / 1M
Cache Write Price N/A N/A
Total Input Tokens 319,524 219,811
Output Tokens 440,835 8,811
Reasoning Tokens 0 59,671
Response Time (avg) 26.57s 28.38s
Response Time (max) 152.83s 159.91s
Response Time (total) 611.09s 652.78s
Parameters 198B total (11B active) 744B total (40B active)
Availability Open source Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#170 Step 3.7 Flash

medium
Cost
$0.006
Time
46.2s
Tokens
4,466 tok

#169 GLM 5.3

high
Cost
$0.085
Time
362.5s
Tokens
19,310 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Step 3.7 Flash 8.8 7.8 88.9% 1 27.42s 7,437 44,797 0
GLM 5.3 6.6 5.0 66.7% 2 18.89s 7,317 473 8,190

Switch Comparison Pair