Google: Gemma 4 31B vs Qwen: Qwen3.5-35B-A3B

Gemma 4 31B (medium) leads on average score with 6.3 vs 6.2. Gemma 4 31B (medium) has the lower benchmark cost at $0.116 vs $0.837. Gemma 4 31B (medium) is faster at 75.38s vs 112.47s, with pass rates of 68.2% vs 66.7%.

Recommended modelGemma 4 31B (medium)It has the best score here (6.3), while costing about 7.2x less than Qwen3.5-35B-A3B (medium).

Last updated at: 2026-07-25

Metric	Gemma 4 31B Gemma 4 31B medium Release: 2026-04-02 Free Available	Qwen3.5-35B-A3B Qwen3.5-35B-A3B medium Release: 2026-02-24

Metric	Gemma 4 31B Gemma 4 31B medium Release: 2026-04-02 Free Available	Qwen3.5-35B-A3B Qwen3.5-35B-A3B medium Release: 2026-02-24
Score	6.3	6.2
Rank	#121	#130
Reliability	10.0	10.0
Consistency	9.0	7.6
Tests Correct
Attempt pass rate	68.2%	66.7%
Flaky tests	2	6
Total Runs	66	66
Cost per result	1.044	9.130
Total Cost	$0.116	$0.837
Input Price	$0.140 / 1M	$0.140 / 1M
Output Price	$0.400 / 1M	$1.000 / 1M
Total Input Tokens	94,992	130,388
Output Tokens	34,468	40,630
Reasoning Tokens	223,278	786,040
Response Time (avg)	75.38s	112.47s
Response Time (max)	437.40s	950.25s
Response Time (total)	1507.52s	2474.28s

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#121 Gemma 4 31B

medium

Cost: $0.002
Time: 45.7s
Tokens: 2,696 tok

#130 Qwen3.5-35B-A3B

medium

Cost: $0.009
Time: 71.4s
Tokens: 8,631 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		12.89s	816	962	2,046
Qwen3.5-35B-A3B	10.0	10.0	100.0%	0		21.13s	672	798	42,652

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	4.3	5.8	22.2%	1		219.76s	5,568	11,098	33,212
Qwen3.5-35B-A3B	5.9	9.3	33.3%	0		206.65s	4,106	23,844	111,462

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	2.9	5.8	16.7%	1		433.11s	77,035	12,112	157,552
Qwen3.5-35B-A3B	3.8	5.8	33.3%	1		512.79s	109,184	775	444,948

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		21.11s	8,334	1,822	2,951
Qwen3.5-35B-A3B	7.3	5.9	83.3%	1		59.33s	6,061	235	19,493

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	7.7	10.0	66.7%	0		38.48s	876	4,349	8,985
Qwen3.5-35B-A3B	4.1	4.4	44.5%	2		88.34s	500	41	46,368

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		9.57s	567	105	888
Qwen3.5-35B-A3B	2.8	1.6	33.3%	1		30.30s	172	20	3,753

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		12.76s	777	533	2,035
Qwen3.5-35B-A3B	10.0	10.0	100.0%	0		24.45s	699	97	17,361

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	9.9	10.0	100.0%	0		26.91s	801	1,795	5,595
Qwen3.5-35B-A3B	8.2	7.2	88.9%	1		33.13s	597	3,592	26,585

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	3.0	10.0	0.0%	0		0ms	0	0	0
Qwen3.5-35B-A3B	10.0	10.0	100.0%	0		4.65s	8,193	309	1,365

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	3.0	10.0	0.0%	0		90.14s	218	1,692	10,014
Qwen3.5-35B-A3B	3.0	10.0	0.0%	0		177.35s	204	10,919	72,053

Quick Compare

Switch Comparison Pair

Gemini 2.5 FlashnonevsQwen3.5-35B-A3Bmedium Gemma 4 31BmediumFree AvailablevsLongCat 2.0none Gemini 3.1 Flash LiteminimalvsQwen3.5-35B-A3Bmedium Claude Sonnet 5nonevsGemma 4 31BmediumFree Available GPT-5.6 LunalowvsQwen3.5-35B-A3Bmedium Seed-2.0-LitenonevsQwen3.5-35B-A3Bmedium Gemini 3.1 Flash LitenonevsQwen3.5-35B-A3Bmedium Qwen3.5-35B-A3BmediumvsInklinglow Gemma 4 31BnoneFree AvailablevsQwen3.5-35B-A3Bmedium Gemma 4 31BmediumFree AvailablevsLing 3.0 FlashhighFree Available Seed-2.0-LitenonevsGemma 4 31BmediumFree Available Nemotron 3 UltranoneFree AvailablevsQwen3.5-35B-A3Bmedium