AI BENCHY Compare

Google: Gemma 4 31B vs Z.ai: GLM 5 Turbo

Last updated at: 2026-05-22

Metric	Gemma 4 31B Gemma 4 31B medium Release: 2026-04-02 Free Available	GLM 5 Turbo GLM 5 Turbo medium Release: 2026-03-15

Metric	Gemma 4 31B Gemma 4 31B medium Release: 2026-04-02 Free Available	GLM 5 Turbo GLM 5 Turbo medium Release: 2026-03-15
Score	8.0	7.9
Rank	#23	#28
Reliability	6.7	8.3
Consistency	9.2	8.1
Tests Correct
Attempt pass rate	75.0%	76.7%
Flaky tests	2	5
Total Runs	60	60
Cost per result	0.205	1.872
Total Cost	$0.029	$0.244
Input Price	$0.120 / 1M	$1.200 / 1M
Output Price	$0.370 / 1M	$4.000 / 1M
Output Tokens	19,604	12,231
Reasoning Tokens	49,687	53,558
Response Time (avg)	35.51s	22.69s
Response Time (max)	150.90s	194.23s
Response Time (total)	639.17s	453.72s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		12.89s	962	2,046
GLM 5 Turbo	10.0	10.0	100.0%	0		4.82s	362	3,137

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Gemma 4 31B	3.8	1.6	50.0%	2		110.94s	8,344	17,172
GLM 5 Turbo	7.3	5.8	83.3%	1		53.92s	346	16,607

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Gemma 4 31B	3.0	10.0	0.0%	0		0ms	0	0
GLM 5 Turbo	10.0	10.0	100.0%	0		13.88s	390	2,037

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		21.11s	1,822	2,951
GLM 5 Turbo	10.0	10.0	100.0%	0		6.19s	577	3,632

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Gemma 4 31B	7.7	10.0	66.7%	0		38.48s	4,349	8,985
GLM 5 Turbo	2.9	4.4	22.2%	2		71.07s	9,665	19,279

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		9.57s	105	888
GLM 5 Turbo	6.1	3.1	66.7%	1		10.05s	60	2,216

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		12.76s	533	2,035
GLM 5 Turbo	10.0	10.0	100.0%	0		5.38s	255	2,183

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Gemma 4 31B	9.9	10.0	100.0%	0		27.63s	1,797	5,596
GLM 5 Turbo	8.7	7.9	77.8%	1		5.44s	315	2,702

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Gemma 4 31B	3.0	10.0	0.0%	0		0ms	0	0
GLM 5 Turbo	10.0	10.0	100.0%	0		9.84s	241	446

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Gemma 4 31B	3.0	10.0	0.0%	0		90.14s	1,692	10,014
GLM 5 Turbo	3.0	10.0	0.0%	0		40.17s	20	1,319

Quick Compare

Switch Comparison Pair

Qwen3.7 MaxnonevsGLM 5 Turbomedium Gemini 3.5 FlashminimalvsGLM 5 Turbomedium Gemma 4 31BmediumFree AvailablevsQwen3.7 Maxnone Gemini 3 Flash PreviewnonevsGLM 5 Turbomedium Gemini 3.1 Flash Lite PreviewlowvsGLM 5 Turbomedium GPT-5.2 ChatnonevsGLM 5 Turbomedium Gemma 4 31BmediumFree AvailablevsGPT-5.2 Chatnone Gemini 3.1 Flash Lite PreviewnonevsGLM 5 Turbomedium Gemini 3.1 Flash LitelowvsGLM 5 Turbomedium GPT-5.3 ChatnonevsGLM 5 Turbomedium DeepSeek V4 FlashhighFree AvailablevsGLM 5 Turbomedium Gemma 4 31BmediumFree AvailablevsGPT-5.3 Chatnone