AI BENCHY Compare

Google: Gemma 4 26B A4B vs Qwen: Qwen3.5-35B-A3B

Summary

Gemma 4 26B A4B vs Qwen3.5-35B-A3B benchmark comparison: Qwen3.5-35B-A3B leads on average score with 6.3 vs 5.5. Gemma 4 26B A4B has the lower benchmark cost at $0.004 vs $0.401. Gemma 4 26B A4B is faster at 5.91s vs 72.57s, with pass rates of 44.4% vs 69.8%.

Recommended model: Gemma 4 26B A4B - It offers the best overall trade-off: a competitive score (5.5), lower cost than Qwen3.5-35B-A3B, and balanced response time.

Last updated at: 2026-07-02

Metric	Gemma 4 26B A4B Gemma 4 26B A4B none Release: 2026-04-03 Free Available	Qwen3.5-35B-A3B Qwen3.5-35B-A3B medium Release: 2026-02-24

Metric	Gemma 4 26B A4B Gemma 4 26B A4B none Release: 2026-04-03 Free Available	Qwen3.5-35B-A3B Qwen3.5-35B-A3B medium Release: 2026-02-24
Score	5.5	6.3
Rank	#125	#92
Reliability	10.0	10.0
Consistency	9.2	7.5
Tests Correct
Attempt pass rate	44.4%	69.8%
Flaky tests	2	6
Total Runs	63	63
Cost per result	0.068	5.162
Total Cost	$0.004	$0.401
Input Price	$0.060 / 1M	$0.140 / 1M
Output Price	$0.330 / 1M	$1.000 / 1M
Total Input Tokens	40,038	42,196
Output Tokens	1,824	40,630
Reasoning Tokens	0	353,577
Response Time (avg)	5.91s	72.57s
Response Time (max)	57.10s	409.98s
Response Time (total)	124.05s	1524.04s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#125 Gemma 4 26B A4B

none

Cost: $0.001
Time: 39.5s
Tokens: 790 tok

#92 Qwen3.5-35B-A3B

medium

Cost: $0.009
Time: 71.4s
Tokens: 8,631 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 26B A4B	8.3	10.0	75.0%	0		1.28s	852	230	0
Qwen3.5-35B-A3B	10.0	10.0	100.0%	0		21.13s	672	798	42,652

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 26B A4B	3.7	7.2	22.2%	1		4.16s	7,736	476	0
Qwen3.5-35B-A3B	5.9	9.3	33.3%	0		206.65s	4,106	23,844	111,462

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 26B A4B	3.0	10.0	0.0%	0		30.53s	13,650	309	0
Qwen3.5-35B-A3B	4.7	1.6	66.7%	1		75.34s	20,992	775	12,485

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 26B A4B	10.0	10.0	100.0%	0		1.70s	8,352	285	0
Qwen3.5-35B-A3B	7.3	5.9	83.3%	1		59.33s	6,061	235	19,493

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 26B A4B	3.6	7.2	22.2%	1		2.49s	903	27	0
Qwen3.5-35B-A3B	4.1	4.4	44.5%	2		88.34s	500	41	46,368

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 26B A4B	4.0	10.0	0.0%	0		3.54s	576	85	0
Qwen3.5-35B-A3B	2.8	1.6	33.3%	1		30.30s	172	20	3,753

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 26B A4B	6.3	10.0	50.0%	0		690ms	795	75	0
Qwen3.5-35B-A3B	10.0	10.0	100.0%	0		24.45s	699	97	17,361

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 26B A4B	6.2	10.0	33.3%	0		744ms	828	114	0
Qwen3.5-35B-A3B	8.2	7.2	88.9%	1		33.13s	597	3,592	26,585

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 26B A4B	10.0	10.0	100.0%	0		57.10s	6,123	210	0
Qwen3.5-35B-A3B	10.0	10.0	100.0%	0		4.65s	8,193	309	1,365

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 26B A4B	3.0	10.0	0.0%	0		778ms	223	13	0
Qwen3.5-35B-A3B	3.0	10.0	0.0%	0		177.35s	204	10,919	72,053

Quick Compare

Switch Comparison Pair