Step 3.7 Flash (medium) vs GLM 5.2 (high)

Compared models

Rank: #129
Total Output Tokens: 440,835
Response Time (avg): 26.57s
Total Cost: $0.571

Rank: #90
Total Output Tokens: 382,333
Response Time (avg): 69.11s
Total Cost: $4.632

Recommended model Step 3.7 Flash (medium)

Its score stays close to the best score here (7.8 vs 8.4), while costing about 8.1x less than GLM 5.2 (high).

Detailed comparison

Metric	Step 3.7 Flash Step 3.7 Flash medium Release: 2026-05-29	GLM 5.2 GLM 5.2 high Release: 2026-06-17

Metric	Step 3.7 Flash Step 3.7 Flash medium Release: 2026-05-29	GLM 5.2 GLM 5.2 high Release: 2026-06-17
Score	7.8	8.4
Rank	#129	#90
Reliability	10.0	10.0
Consistency	8.7	8.6
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	68.1%	71.0%
Flaky tests	4	3
Total Runs	69	69
Cost per result	4.392	7.314
Total Cost	$0.571	$4.632
Input Price	$0.200 / 1M	$0.153 / 1M
Output Price	$1.150 / 1M	$12.000 / 1M
Cache Read Price	$0.040 / 1M	$0.150 / 1M
Cache Write Price	N/A	N/A
Total Input Tokens	319,524	288,913
Output Tokens	440,835	79,462
Reasoning Tokens	0	303,120
Response Time (avg)	26.57s	69.11s
Response Time (max)	152.83s	599.43s
Response Time (total)	611.09s	1589.43s
Parameters	198B total (11B active)	744B total (40B active)
Availability	Open source	Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#129 Step 3.7 Flash

medium

Cost: $0.006
Time: 46.2s
Tokens: 4,466 tok

#90 GLM 5.2

high

Reached the allocated time limit (300 seconds) without receiving showcase output.

Cost: $0.000
Time: 300.0s
Tokens: 0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Step 3.7 Flash	7.4	3.8	66.7%	1		93.88s	205,333	31,126	0
GLM 5.2	10.0	10.0	100.0%	0		52.45s	205,091	7,422	10,505

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Step 3.7 Flash	8.7	7.9	91.7%	1		9.65s	756	32,185	0
GLM 5.2	10.0	10.0	100.0%	0		5.80s	639	406	2,660

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Step 3.7 Flash	8.8	7.8	88.9%	1		27.42s	7,437	44,797	0
GLM 5.2	6.4	8.6	33.3%	0		73.03s	5,124	2,302	22,546

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Step 3.7 Flash	7.3	5.8	83.3%	1		80.94s	87,764	114,720	0
GLM 5.2	10.0	10.0	100.0%	0		321.47s	61,516	18,824	63,861

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Step 3.7 Flash	10.0	10.0	100.0%	0		2.75s	7,398	3,020	0
GLM 5.2	10.0	10.0	100.0%	0		5.81s	7,143	435	1,414

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Step 3.7 Flash	5.3	10.0	33.3%	0		27.26s	837	52,484	0
GLM 5.2	3.1	6.5	11.1%	1		126.85s	560	49,045	157,522

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Step 3.7 Flash	4.0	10.0	0.0%	0		6.85s	525	3,987	0
GLM 5.2	10.0	10.0	100.0%	0		12.90s	498	63	1,743

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Step 3.7 Flash	9.8	10.0	100.0%	0		1.83s	735	2,166	0
GLM 5.2	10.0	10.0	100.0%	0		4.26s	678	151	1,210

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Step 3.7 Flash	5.7	9.9	33.3%	0		6.19s	756	15,071	0
GLM 5.2	6.0	4.6	66.7%	2		33.71s	665	568	22,392

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Step 3.7 Flash	10.0	10.0	100.0%	0		4.16s	7,746	2,115	0
GLM 5.2	10.0	10.0	100.0%	0		9.25s	6,861	246	503

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Step 3.7 Flash	3.0	10.0	0.0%	0		113.98s	237	139,164	0
GLM 5.2	3.0	10.0	0.0%	0		127.82s	138	0	18,764

Switch Comparison Pair

Step 3.7 FlashmediumvsGLM 5.3high Qwen3.7 PlusnonevsStep 3.7 Flashmedium Step 3.7 FlashmediumvsGrok 4.5low DeepSeek V4.1 Flash 1017highvsStep 3.7 Flashmedium Ling 3.1 FlashhighvsStep 3.7 Flashmedium Muse WondermaxvsStep 3.7 Flashmedium Qwen3.8 2.4T A95BhighvsStep 3.7 Flashmedium Kimi K3maxvsGLM 5.2high Gemini 3.1 Pro PreviewmediumvsGLM 5.2high Muse Glimmer 30BxhighvsGLM 5.2high GPT-5 MinimediumvsGLM 5.2high Qwen3.8 2.4T A95BlowvsGLM 5.2high