Gemma 4 31B (medium) vs Muse Glimmer 30B (low)

Compared models

Recommended model Muse Glimmer 30B (low)

It has the best score here (6.9), while responding about 3.5x faster than Gemma 4 31B (medium).

Metric	Gemma 4 31B Gemma 4 31B medium Release: 2026-04-02 Free Available	Muse Glimmer 30B Muse Glimmer 30B low Release: 2026-08-11

Metric	Gemma 4 31B Gemma 4 31B medium Release: 2026-04-02 Free Available	Muse Glimmer 30B Muse Glimmer 30B low Release: 2026-08-11
Score	6.9	6.9
Rank	#165	#161
Reliability	10.0	10.0
Consistency	8.7	8.0
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	66.7%	63.8%
Flaky tests	3	6
Total Runs	69	69
Cost per result	1.195	2.414
Total Cost	$0.117	$0.266
Input Price	$0.090 / 1M	$0.350 / 1M
Output Price	$0.340 / 1M	$1.500 / 1M
Total Input Tokens	251,164	307,228
Output Tokens	36,112	36,044
Reasoning Tokens	241,203	71,621
Response Time (avg)	78.76s	22.40s
Response Time (max)	437.40s	234.92s
Response Time (total)	1653.96s	515.14s
Parameters	30.7B	30B
Availability	Open source	Open source

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

medium

low

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		82.13s	156,195	1,713	8,181
Muse Glimmer 30B	6.1	3.1	66.7%	1		104.96s	176,916	2,177	9,518

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		12.89s	816	962	2,046
Muse Glimmer 30B	8.7	8.0	91.7%	1		3.57s	810	1,054	2,240

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	4.3	5.8	22.2%	1		219.76s	5,568	11,098	33,212
Muse Glimmer 30B	8.1	9.9	66.7%	0		16.52s	7,419	2,759	10,173

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	2.9	5.8	16.7%	1		433.11s	77,035	12,112	157,552
Muse Glimmer 30B	3.8	5.8	33.3%	1		131.97s	102,271	24,417	33,400

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		21.11s	8,334	1,822	2,951
Muse Glimmer 30B	10.0	10.0	100.0%	0		4.17s	7,065	1,219	1,841

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	5.3	7.2	44.4%	1		59.92s	853	4,280	18,729
Muse Glimmer 30B	3.5	4.4	33.3%	2		11.48s	885	3,067	6,658

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		9.57s	567	105	888
Muse Glimmer 30B	5.0	10.0	0.0%	0		2.50s	525	33	542

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		12.76s	777	533	2,035
Muse Glimmer 30B	8.4	6.9	83.3%	1		3.60s	765	139	1,467

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	9.9	10.0	100.0%	0		26.91s	801	1,795	5,595
Muse Glimmer 30B	7.7	10.0	66.7%	0		5.06s	795	545	2,721

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	3.0	10.0	0.0%	0		0ms	0	0	0
Muse Glimmer 30B	10.0	10.0	100.0%	0		5.04s	9,546	385	803

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	3.0	10.0	0.0%	0		90.14s	218	1,692	10,014
Muse Glimmer 30B	3.0	10.0	0.0%	0		9.71s	231	249	2,258

Switch Comparison Pair