Gemma 4 31B vs GLM 5

Compared models

Recommended model Gemma 4 31B

It has the best score here (5.7), while costing about 4.5x less than GLM 5.

Metric	Gemma 4 31B Gemma 4 31B none Release: 2026-04-02 Free Available	GLM 5 GLM 5 none Release: 2026-02-12

Metric	Gemma 4 31B Gemma 4 31B none Release: 2026-04-02 Free Available	GLM 5 GLM 5 none Release: 2026-02-12
Score	5.7	5.6
Rank	#258	#262
Reliability	10.0	10.0
Consistency	9.6	9.3
Attempts	69/69	66/69
Tests Correct
Attempt pass rate	42.0%	40.6%
Flaky tests	1	1
Total Runs	69	66
Cost per result	0.520	1.363
Total Cost	$0.031	$0.140
Input Price	$0.090 / 1M	$0.600 / 1M
Output Price	$0.340 / 1M	$1.920 / 1M
Cache Read Price	$0.050 / 1M	$0.120 / 1M
Cache Write Price	N/A	N/A
Total Input Tokens	270,970	190,675
Output Tokens	15,499	5,577
Reasoning Tokens	0	0
Response Time (avg)	7.28s	8.74s
Response Time (max)	44.73s	74.80s
Response Time (total)	152.84s	131.17s
Parameters	30.7B	744B total (40B active)
Availability	Open source	Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

none

none

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	3.9	9.6	0.0%	0		44.73s	145,267	2,182	0
GLM 5	5.0	10.0	0.0%	0		74.80s	153,540	3,588	0

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	6.5	10.0	50.0%	0		1.85s	852	45	0
GLM 5	4.8	10.0	25.0%	0		2.37s	510	275	0

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	5.5	10.0	33.3%	0		11.19s	8,381	735	0
GLM 5	4.0	7.8	11.1%	1		5.12s	7,256	428	0

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	3.8	5.8	33.3%	1		29.95s	104,817	11,910	0
GLM 5	1.5	5.0	0.0%	0		4.98s	12,812	406	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		2.25s	8,352	285	0
GLM 5	10.0	10.0	100.0%	0		5.78s	7,107	203	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	5.3	10.0	33.3%	0		3.65s	878	27	0
GLM 5	3.0	10.0	0.0%	0		2.24s	643	19	0

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		2.09s	576	117	0
GLM 5	10.0	10.0	100.0%	0		3.27s	477	103	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	6.5	10.0	50.0%	0		2.84s	795	78	0
GLM 5	10.0	10.0	100.0%	0		1.48s	636	61	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	6.5	10.0	33.3%	0		4.23s	828	108	0
GLM 5	7.7	10.0	66.7%	0		1.91s	609	261	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	3.0	10.0	0.0%	0		0ms	0	0	0
GLM 5	10.0	10.0	100.0%	0		11.07s	6,899	220	0

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	3.0	10.0	0.0%	0		1.25s	224	12	0
GLM 5	3.0	10.0	0.0%	0		3.62s	186	13	0

Switch Comparison Pair