AI BENCHY Compare

Qwen: Qwen3.7 Plus vs Z.ai: GLM 5.1

Summary

Qwen3.7 Plus vs GLM 5.1 benchmark comparison: Qwen3.7 Plus leads on average score with 7.2 vs 7.1. Qwen3.7 Plus has the lower benchmark cost at $0.023 vs $0.292. Qwen3.7 Plus is faster at 2.85s vs 33.67s, with pass rates of 47.6% vs 68.3%.

Recommended model: Qwen3.7 Plus - It has the best score here (7.2), while costing about 13.2x less than GLM 5.1.

Last updated at: 2026-06-12

Metric	Qwen3.7 Plus Qwen3.7 Plus none Release: 2026-06-03	GLM 5.1 GLM 5.1 medium Release: 2026-04-07

Metric	Qwen3.7 Plus Qwen3.7 Plus none Release: 2026-06-03	GLM 5.1 GLM 5.1 medium Release: 2026-04-07
Score	7.2	7.1
Rank	#61	#64
Reliability	10.0	6.7
Consistency	10.0	8.3
Tests Correct
Attempt pass rate	47.6%	68.3%
Flaky tests	0	4
Total Runs	63	63
Cost per result	0.276	2.496
Total Cost	$0.023	$0.292
Input Price	$0.320 / 1M	$0.980 / 1M
Output Price	$1.280 / 1M	$3.080 / 1M
Total Input Tokens	42,510	32,995
Output Tokens	6,578	11,655
Reasoning Tokens	0	75,421
Response Time (avg)	2.85s	33.67s
Response Time (max)	29.38s	172.60s
Response Time (total)	59.86s	673.41s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#61 Qwen3.7 Plus

none

Cost: $0.019
Time: 213.5s
Tokens: 11,960 tok

#64 GLM 5.1

medium

Invalid SVG

Cost: $0.000
Time: 300.0s
Tokens: 0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Plus	6.5	10.0	50.0%	0		1.38s	696	349	0
GLM 5.1	10.0	10.0	100.0%	0		8.31s	555	401	5,122

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Plus	5.5	10.0	33.3%	0		2.15s	7,911	639	0
GLM 5.1	4.6	3.7	44.5%	2		109.63s	5,702	4,871	37,826

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Plus	10.0	10.0	100.0%	0		29.38s	14,952	4,505	0
GLM 5.1	9.5	10.0	100.0%	0		43.11s	17,298	327	4,206

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Plus	10.0	10.0	100.0%	0		1.43s	7,794	243	0
GLM 5.1	10.0	10.0	100.0%	0		9.33s	7,107	991	4,552

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Plus	3.0	10.0	0.0%	0		868ms	789	18	0
GLM 5.1	5.3	10.0	33.3%	0		29.77s	489	969	11,314

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Plus	5.3	10.0	0.0%	0		1.33s	522	78	0
GLM 5.1	10.0	10.0	100.0%	0		20.95s	477	2,875	2,875

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Plus	6.3	10.0	50.0%	0		929ms	711	72	0
GLM 5.1	6.4	5.8	66.7%	1		7.47s	634	204	1,617

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Plus	7.7	10.0	66.7%	0		1.71s	714	443	0
GLM 5.1	8.2	7.2	88.9%	1		31.64s	609	935	5,730

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Plus	10.0	10.0	100.0%	0		3.54s	8,211	222	0
GLM 5.1	3.0	10.0	0.0%	0		0ms	0	0	0

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Plus	3.0	10.0	0.0%	0		1.21s	210	9	0
GLM 5.1	3.0	10.0	0.0%	0		29.40s	124	82	2,179

Quick Compare

Switch Comparison Pair

Step 3.7 FlashhighvsGLM 5.1medium Gemma 4 26B A4BmediumFree AvailablevsQwen3.7 Plusnone Qwen3.7 PlusnonevsMiMo-V2-Flashmedium Qwen3.7 PlusnonevsStep 3.7 Flashhigh Qwen3.7 PlusnonevsGLM 5V Turbomedium Gemini 3.5 FlashnonevsGLM 5.1medium Claude Opus 4.8nonevsGLM 5.1medium Kimi K2.7 CodemediumvsQwen3.7 Plusnone Gemini 3 Flash PreviewnonevsGLM 5.1medium Qwen3.7 PlusnonevsGrok 4.20medium Gemini 3 Flash PreviewlowvsQwen3.7 Plusnone Claude Sonnet 4.6nonevsGLM 5.1medium