Navigate
Advertise here

Step 3.7 Flash (high) vs GLM 5.2

GLM 5.2 leads on average score with 6.6 vs 6.6. GLM 5.2 has the lower benchmark cost at $0.250 vs $1.478. GLM 5.2 is faster at 11.27s vs 72.72s, with pass rates of 58.0% vs 63.8%.

Last updated at: 2026-11-16

Compared models

Rank
#269
Total Output Tokens
1,100,052
Response Time (avg)
72.72s
Total Cost
$1.478
Rank
#265
Total Output Tokens
17,685
Response Time (avg)
11.27s
Total Cost
$0.250
Recommended model GLM 5.2

It has the best score here (6.6), while costing about 5.9x less than Step 3.7 Flash (high).

Detailed comparison

Metric Step 3.7 Flash Step 3.7 Flash high Release: 2026-05-29 GLM 5.2 GLM 5.2 none Release: 2026-06-17
Score 6.6 6.6
Rank #269 #265
Reliability 10.0 10.0
Consistency 8.5 9.0
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 58.0% 63.8%
Flaky tests 4 3
Total Runs 69 69
Cost per result 12.267 1.753
Total Cost $1.478 $0.250
Input Price $0.200 / 1M $0.153 / 1M
Output Price $1.150 / 1M $12.000 / 1M
Cache Read Price $0.040 / 1M $0.150 / 1M
Cache Write Price N/A N/A
Total Input Tokens 421,200 247,919
Output Tokens 1,100,052 17,685
Reasoning Tokens 0 0
Response Time (avg) 72.72s 11.27s
Response Time (max) 364.99s 79.65s
Response Time (total) 1672.53s 259.32s
Parameters 198B total (11B active) 744B total (40B active)
Availability Open source Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#269 Step 3.7 Flash

high
Cost
$0.007
Time
63.6s
Tokens
6,030 tok

#265 GLM 5.2

none
Cost
$0.033
Time
87.7s
Tokens
7,455 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Step 3.7 Flash 4.0 6.0 22.2% 1 206.21s 6,057 327,340 0
GLM 5.2 3.7 9.5 0.0% 0 7.55s 7,263 1,958 0

Switch Comparison Pair