AI BENCHY Compare

Google: Gemma 4 31B vs Qwen: Qwen3.6 35B A3B

Last updated at: 2026-04-27

Metric	Gemma 4 31B Gemma 4 31B medium Release: 2026-04-02 Free Available	Qwen3.6 35B A3B Qwen3.6 35B A3B medium Release: 2026-04-20

Metric	Gemma 4 31B Gemma 4 31B medium Release: 2026-04-02 Free Available	Qwen3.6 35B A3B Qwen3.6 35B A3B medium Release: 2026-04-20
Score	8.3	8.8
Rank	#19	#9
Reliability	N/A	10.0
Consistency	9.2	9.5
Tests Correct
Attempt pass rate	79.6%	83.3%
Flaky tests	2	1
Total Runs	54	54
Cost per result	0.136	0.800
Total Cost	$0.018	$0.104
Input Price	$0.130 / 1M	$0.162 / 1M
Output Price	$0.380 / 1M	$0.966 / 1M
Output Tokens	12,734	14,256
Reasoning Tokens	27,950	98,005
Response Time (avg)	24.88s	11.98s
Response Time (max)	70.97s	45.02s
Response Time (total)	398.13s	191.76s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		12.89s	962	2,046
Qwen3.6 35B A3B	10.0	10.0	100.0%	0		6.02s	1,154	12,385

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Gemma 4 31B	4.7	1.6	66.7%	1		70.97s	3,166	5,449
Qwen3.6 35B A3B	10.0	10.0	100.0%	0		32.58s	3,294	15,116

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Gemma 4 31B	3.0	10.0	0.0%	0		0ms	0	0
Qwen3.6 35B A3B	0.0	0.0	0.0%	0		0ms	0	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		21.11s	1,822	2,951
Qwen3.6 35B A3B	10.0	10.0	100.0%	0		12.99s	2,591	9,968

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Gemma 4 31B	7.7	10.0	66.7%	0		38.48s	4,349	8,985
Qwen3.6 35B A3B	5.3	7.2	44.4%	1		22.50s	6,193	39,116

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		9.57s	105	888
Qwen3.6 35B A3B	4.4	9.9	0.0%	0		8.66s	129	4,569

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		12.76s	533	2,035
Qwen3.6 35B A3B	10.0	10.0	100.0%	0		7.50s	219	7,404

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Gemma 4 31B	8.8	7.9	88.9%	1		27.63s	1,797	5,596
Qwen3.6 35B A3B	10.0	10.0	100.0%	0		5.98s	676	9,447

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Gemma 4 31B	3.0	10.0	0.0%	0		0ms	0	0
Qwen3.6 35B A3B	0.0	0.0	0.0%	0		0ms	0	0

Quick Compare

Switch Comparison Pair

Gemini 3 Flash PreviewlowvsQwen3.6 35B A3Bmedium Gemma 4 31BmediumFree AvailablevsHY3 PreviewhighFree Available Gemma 4 31BmediumFree AvailablevsHY3 PreviewlowFree Available GPT-5.5lowvsQwen3.6 35B A3Bmedium Qwen3.6 35B A3BmediumvsHY3 PreviewhighFree Available Claude Opus 4.7nonevsQwen3.6 35B A3Bmedium Gemma 4 31BmediumFree AvailablevsGPT-5.2 Chatnone DeepSeek V4 FlashhighvsGemma 4 31BmediumFree Available Qwen3.6 35B A3BmediumvsHY3 PreviewlowFree Available Gemini 3 Flash PreviewnonevsQwen3.6 35B A3Bmedium Gemini 3.1 Flash Lite PreviewlowvsQwen3.6 35B A3Bmedium Gemma 4 31BmediumFree AvailablevsGPT-5.3 Chatnone