Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

StepFun: Step 3.7 Flash vs Z.ai: GLM 5

Summary

Step 3.7 Flash vs GLM 5 benchmark comparison: GLM 5 leads on average score with 8.6 vs 7.7. GLM 5 has the lower benchmark cost at $0.228 vs $0.341. Step 3.7 Flash is faster at 15.74s vs 33.54s, with pass rates of 68.3% vs 82.5%.

Recommended model: GLM 5 - It has the best score here (8.6), while costing about 1.5x less than Step 3.7 Flash.

Last updated at: 2026-06-17

Metric Step 3.7 Flash Step 3.7 Flash low Release: 2026-05-29 GLM 5 GLM 5 medium Release: 2026-02-12
Score 7.7 8.6
Rank #39 #15
Reliability 10.0 10.0
Consistency 8.4 8.5
Tests Correct
Attempt pass rate 68.3% 82.5%
Flaky tests 4 4
Total Runs 63 63
Cost per result 2.840 1.668
Total Cost $0.341 $0.228
Input Price $0.200 / 1M $0.600 / 1M
Output Price $1.150 / 1M $1.920 / 1M
Total Input Tokens 40,101 35,224
Output Tokens 289,325 21,570
Reasoning Tokens 0 102,996
Response Time (avg) 15.74s 33.54s
Response Time (max) 124.75s 99.85s
Response Time (total) 330.63s 435.99s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#39 Step 3.7 Flash

low
Invalid SVG
Cost
$0.004
Time
25.3s
Tokens
3,072 tok

#15 GLM 5

medium
Cost
$0.005
Time
20.7s
Tokens
2,068 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Step 3.7 Flash 8.7 7.9 91.7% 1 4.02s 756 10,896 0
GLM 5 10.0 10.0 100.0% 0 23.66s 555 480 7,056
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Step 3.7 Flash 8.2 7.2 88.9% 1 9.46s 7,437 18,685 0
GLM 5 10.0 10.0 100.0% 0 74.30s 7,254 2,997 52,930
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Step 3.7 Flash 10.0 10.0 100.0% 0 7.98s 13,683 6,426 0
GLM 5 10.0 10.0 100.0% 0 28.96s 12,804 662 3,242
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Step 3.7 Flash 7.3 5.8 83.3% 1 2.29s 7,398 2,667 0
GLM 5 7.1 5.6 83.3% 1 8.90s 5,508 567 3,734
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Step 3.7 Flash 5.3 7.2 44.4% 1 43.31s 828 104,487 0
GLM 5 3.5 4.4 33.3% 2 0ms 260 13,176 14,137
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Step 3.7 Flash 3.4 9.3 0.0% 0 7.00s 525 4,604 0
GLM 5 6.1 3.1 66.7% 1 14.69s 477 2,020 2,248
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Step 3.7 Flash 9.8 10.0 100.0% 0 1.58s 735 1,857 0
GLM 5 10.0 10.0 100.0% 0 7.25s 636 1,001 2,129
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Step 3.7 Flash 5.5 9.9 33.3% 0 1.84s 756 3,564 0
GLM 5 10.0 10.0 100.0% 0 11.33s 609 33 4,076
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Step 3.7 Flash 10.0 10.0 100.0% 0 3.25s 7,746 1,360 0
GLM 5 10.0 10.0 100.0% 0 15.93s 6,935 233 994
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Step 3.7 Flash 3.0 10.0 0.0% 0 124.75s 237 134,779 0
GLM 5 3.0 10.0 0.0% 0 67.37s 186 401 12,450

Quick Compare

Switch Comparison Pair

Claude Opus 4.6mediumvsStep 3.7 FlashlowStep 3.7 FlashlowvsGrok 4.3mediumQwen3.5-122B-A10BmediumvsStep 3.7 FlashlowKimi K2.6mediumFree AvailablevsStep 3.7 FlashlowGPT-5.2 ChatnonevsGLM 5mediumGemini 3.1 Flash LitemediumvsStep 3.7 FlashlowQwen3.5 Plus 2026-04-20mediumvsStep 3.7 FlashlowGemini 3.1 Flash Lite PreviewmediumvsStep 3.7 FlashlowMiniMax M3mediumvsStep 3.7 FlashlowDeepSeek V4 ProhighvsStep 3.7 FlashlowStep 3.7 FlashlowvsGrok Build 0.1mediumClaude Sonnet 4.6mediumvsStep 3.7 Flashlow