AI BENCHY Compare

Qwen: Qwen3.7 Max vs Z.ai: GLM 5.1

Summary

Qwen3.7 Max vs GLM 5.1 benchmark comparison: GLM 5.1 leads on average score with 7.1 vs 6.9. Qwen3.7 Max has the lower benchmark cost at $0.054 vs $0.395. Qwen3.7 Max is faster at 1.30s vs 33.67s, with pass rates of 66.7% vs 68.3%.

Recommended model: Qwen3.7 Max - Its score stays close to the best score here (6.9 vs 7.1), while costing about 7.3x less than GLM 5.1.

Last updated at: 2026-07-02

Metric	Qwen3.7 Max Qwen3.7 Max none Release: 2026-05-22	GLM 5.1 GLM 5.1 medium Release: 2026-04-07

Metric	Qwen3.7 Max Qwen3.7 Max none Release: 2026-05-22	GLM 5.1 GLM 5.1 medium Release: 2026-04-07
Score	6.9	7.1
Rank	#71	#66
Reliability	10.0	6.7
Consistency	10.0	8.3
Tests Correct
Attempt pass rate	66.7%	68.3%
Flaky tests	0	4
Total Runs	63	63
Cost per result	0.744	2.496
Total Cost	$0.054	$0.395
Input Price	$1.250 / 1M	$0.975 / 1M
Output Price	$3.750 / 1M	$4.301 / 1M
Total Input Tokens	37,107	32,995
Output Tokens	1,994	11,655
Reasoning Tokens	0	75,421
Response Time (avg)	1.30s	33.67s
Response Time (max)	3.92s	172.60s
Response Time (total)	27.21s	673.41s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#71 Qwen3.7 Max

none

Cost: $0.046
Time: 195.0s
Tokens: 12,171 tok

#66 GLM 5.1

medium

Invalid SVG

Cost: $0.000
Time: 300.0s
Tokens: 0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Max	6.5	10.0	50.0%	0		1.08s	696	242	0
GLM 5.1	10.0	10.0	100.0%	0		8.31s	555	401	5,122

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Max	5.5	10.0	33.3%	0		1.35s	7,911	582	0
GLM 5.1	4.6	3.7	44.5%	2		109.63s	5,702	4,871	37,826

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Max	3.0	10.0	0.0%	0		2.17s	9,549	171	0
GLM 5.1	9.5	10.0	100.0%	0		43.11s	17,298	327	4,206

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Max	10.0	10.0	100.0%	0		1.35s	7,794	243	0
GLM 5.1	10.0	10.0	100.0%	0		9.33s	7,107	991	4,552

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Max	7.7	10.0	66.7%	0		975ms	789	15	0
GLM 5.1	5.3	10.0	33.3%	0		29.77s	489	969	11,314

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Max	10.0	10.0	100.0%	0		1.04s	522	120	0
GLM 5.1	10.0	10.0	100.0%	0		20.95s	477	2,875	2,875

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Max	10.0	10.0	100.0%	0		943ms	711	72	0
GLM 5.1	6.4	5.8	66.7%	1		7.47s	634	204	1,617

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Max	10.0	10.0	100.0%	0		1.13s	714	314	0
GLM 5.1	8.2	7.2	88.9%	1		31.64s	609	935	5,730

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Max	10.0	10.0	100.0%	0		3.92s	8,211	222	0
GLM 5.1	3.0	10.0	0.0%	0		0ms	0	0	0

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Max	3.0	10.0	0.0%	0		856ms	210	13	0
GLM 5.1	3.0	10.0	0.0%	0		29.40s	124	82	2,179

Quick Compare

Switch Comparison Pair

Step 3.7 FlashhighvsGLM 5.1medium Gemini 3.5 FlashminimalvsQwen3.7 Maxnone Ring-2.6-1TmediumvsQwen3.7 Maxnone Qwen3.7 PlusnonevsGLM 5.1medium DeepSeek V4 PrononevsGLM 5.1medium Gemini 3.5 FlashnonevsGLM 5.1medium Qwen3.7 MaxnonevsMiMo-V2.5medium Claude Opus 4.8nonevsGLM 5.1medium Kimi K2.7 CodemediumvsQwen3.7 Maxnone gpt-oss-120bmediumFree AvailablevsQwen3.7 Maxnone Gemini 3 Flash PreviewnonevsGLM 5.1medium Laguna XS 2.1mediumFree AvailablevsQwen3.7 Maxnone