AI BENCHY Compare

Google: Gemma 4 31B vs Z.ai: GLM 5 Turbo

Summary

Gemma 4 31B vs GLM 5 Turbo benchmark comparison: Gemma 4 31B leads on average score with 6.3 vs 5.3. Gemma 4 31B has the lower benchmark cost at $0.033 vs $0.047. GLM 5 Turbo is faster at 2.82s vs 56.55s, with pass rates of 69.8% vs 31.8%.

Recommended model: GLM 5 Turbo - It offers the best overall trade-off: a competitive score (5.3), faster response than Gemma 4 31B, and balanced cost.

Last updated at: 2026-06-12

Metric	Gemma 4 31B Gemma 4 31B medium Release: 2026-04-02 Free Available	GLM 5 Turbo GLM 5 Turbo none Release: 2026-03-15

Metric	Gemma 4 31B Gemma 4 31B medium Release: 2026-04-02 Free Available	GLM 5 Turbo GLM 5 Turbo none Release: 2026-03-15
Score	6.3	5.3
Rank	#87	#128
Reliability	10.0	10.0
Consistency	9.4	9.3
Tests Correct
Attempt pass rate	69.8%	31.8%
Flaky tests	1	2
Total Runs	63	63
Cost per result	0.257	0.655
Total Cost	$0.033	$0.047
Input Price	$0.120 / 1M	$1.200 / 1M
Output Price	$0.350 / 1M	$4.000 / 1M
Total Input Tokens	17,957	32,525
Output Tokens	22,356	1,815
Reasoning Tokens	65,726	0
Response Time (avg)	56.55s	2.82s
Response Time (max)	437.40s	8.21s
Response Time (total)	1074.41s	59.29s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#87 Gemma 4 31B

medium

Cost: $0.002
Time: 45.7s
Tokens: 2,696 tok

#128 GLM 5 Turbo

none

Cost: $0.047
Time: 129.2s
Tokens: 11,775 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		12.89s	816	962	2,046
GLM 5 Turbo	3.0	10.0	0.0%	0		2.84s	555	382	0

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	4.3	5.8	22.2%	1		219.76s	5,568	11,098	33,212
GLM 5 Turbo	3.9	7.8	11.1%	1		2.41s	7,256	529	0

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	3.0	10.0	0.0%	0		0ms	0	0	0
GLM 5 Turbo	3.0	10.0	0.0%	0		4.89s	8,133	144	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		21.11s	8,334	1,822	2,951
GLM 5 Turbo	10.0	10.0	100.0%	0		2.47s	7,107	204	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	7.7	10.0	66.7%	0		38.48s	876	4,349	8,985
GLM 5 Turbo	5.3	10.0	33.3%	0		1.97s	687	25	0

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		9.57s	567	105	888
GLM 5 Turbo	4.2	9.9	0.0%	0		2.18s	477	48	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		12.76s	777	533	2,035
GLM 5 Turbo	6.5	10.0	50.0%	0		2.13s	636	65	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	9.9	10.0	100.0%	0		26.91s	801	1,795	5,595
GLM 5 Turbo	5.5	7.4	44.4%	1		2.65s	609	180	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	3.0	10.0	0.0%	0		0ms	0	0	0
GLM 5 Turbo	10.0	10.0	100.0%	0		8.21s	6,879	222	0

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	3.0	10.0	0.0%	0		90.14s	218	1,692	10,014
GLM 5 Turbo	3.0	10.0	0.0%	0		2.37s	186	16	0

Quick Compare

Switch Comparison Pair