AI BENCHY Compare

Google: Gemma 4 31B vs Z.ai: GLM 5

Last updated at: 2026-04-02

Metric	Gemma 4 31B Gemma 4 31B none Release: 2026-04-02	GLM 5 GLM 5 none Release: 2026-02-12

Metric	Gemma 4 31B Gemma 4 31B none Release: 2026-04-02	GLM 5 GLM 5 none Release: 2026-02-12
Score	6.7	6.7
Rank	#47	#48
Consistency	10.0	10.0
Tests Correct
Attempt pass rate	52.9%	52.9%
Flaky tests	0	0
Total Runs	51	51
Cost per result	0.023	0.201
Total Cost	$0.002	$0.019
Input Price	$0.140 / 1M	$0.720 / 1M
Output Price	$0.400 / 1M	$2.300 / 1M
Output Tokens	660	1,551
Reasoning Tokens	0	0
Response Time (avg)	2.55s	3.77s
Response Time (max)	4.68s	11.07s
Response Time (total)	38.20s	37.66s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Gemma 4 31B	6.5	10.0	50.0%	0		1.85s	45	0
GLM 5	4.8	10.0	25.0%	0		2.37s	275	0

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Gemma 4 31B	3.0	10.0	0.0%	0		0ms	0	0
GLM 5	3.0	10.0	0.0%	0		4.98s	406	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		2.25s	285	0
GLM 5	10.0	10.0	100.0%	0		5.78s	203	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Gemma 4 31B	7.7	10.0	66.7%	0		3.22s	27	0
GLM 5	3.0	10.0	0.0%	0		2.24s	19	0

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		2.09s	117	0
GLM 5	10.0	10.0	100.0%	0		3.27s	103	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Gemma 4 31B	6.5	10.0	50.0%	0		2.84s	78	0
GLM 5	10.0	10.0	100.0%	0		1.48s	61	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Gemma 4 31B	5.5	10.0	33.3%	0		2.95s	108	0
GLM 5	7.7	10.0	66.7%	0		2.05s	264	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Gemma 4 31B	3.0	10.0	0.0%	0		0ms	0	0
GLM 5	10.0	10.0	100.0%	0		11.07s	220	0

Quick Compare

Switch Comparison Pair

Gemma 4 31BnonevsGPT-5 Minimedium GPT-5 MinimediumvsGLM 5none Gemma 4 31BnonevsNemotron 3 SupermediumFree Available Nemotron 3 SupermediumFree AvailablevsGLM 5none Gemma 4 31BnonevsGrok 4.1 Fastmedium Grok 4.1 FastmediumvsGLM 5none Gemma 4 31BnonevsHunter Alphamedium Hunter AlphamediumvsGLM 5none Gemma 4 31BnonevsGPT-5.4 Minimedium GPT-5.4 MinimediumvsGLM 5none Gemma 4 31BnonevsGrok 4.20medium Grok 4.20mediumvsGLM 5none