Google: Gemma 4 31B vs Qwen: Qwen3.6 27B

Qwen3.6 27B (medium) leads on average score with 6.5 vs 6.3. Gemma 4 31B (medium) has the lower benchmark cost at $0.116 vs $0.680. Gemma 4 31B (medium) is faster at 75.38s vs 106.32s, with pass rates of 68.2% vs 59.1%.

Recommended modelGemma 4 31B (medium)Its score stays close to the best score here (6.3 vs 6.5), while costing about 5.9x less than Qwen3.6 27B (medium).

Last updated at: 2026-07-25

Metric	Gemma 4 31B Gemma 4 31B medium Release: 2026-04-02 Free Available	Qwen3.6 27B Qwen3.6 27B medium Release: 2026-04-20

Metric	Gemma 4 31B Gemma 4 31B medium Release: 2026-04-02 Free Available	Qwen3.6 27B Qwen3.6 27B medium Release: 2026-04-20
Score	6.3	6.5
Rank	#121	#109
Reliability	10.0	10.0
Consistency	9.0	8.0
Tests Correct
Attempt pass rate	68.2%	59.1%
Flaky tests	2	6
Total Runs	66	66
Cost per result	1.044	7.319
Total Cost	$0.116	$0.680
Input Price	$0.140 / 1M	$0.290 / 1M
Output Price	$0.400 / 1M	$2.400 / 1M
Total Input Tokens	94,992	106,167
Output Tokens	34,468	32,889
Reasoning Tokens	223,278	241,303
Response Time (avg)	75.38s	106.32s
Response Time (max)	437.40s	1085.11s
Response Time (total)	1507.52s	2339.12s

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#121 Gemma 4 31B

medium

Cost: $0.002
Time: 45.7s
Tokens: 2,696 tok

#109 Qwen3.6 27B

medium

Cost: $0.009
Time: 39.6s
Tokens: 3,090 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		12.89s	816	962	2,046
Qwen3.6 27B	8.3	10.0	75.0%	0		12.62s	453	582	4,311

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	4.3	5.8	22.2%	1		219.76s	5,568	11,098	33,212
Qwen3.6 27B	7.7	10.0	66.7%	0		142.99s	5,051	7,968	43,367

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	2.9	5.8	16.7%	1		433.11s	77,035	12,112	157,552
Qwen3.6 27B	6.7	3.7	50.0%	2		584.09s	81,895	18,788	133,471

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		21.11s	8,334	1,822	2,951
Qwen3.6 27B	3.5	1.4	50.0%	2		37.30s	7,778	568	9,404

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	7.7	10.0	66.7%	0		38.48s	876	4,349	8,985
Qwen3.6 27B	2.9	7.2	11.1%	1		73.38s	662	3,510	20,352

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		9.57s	567	105	888
Qwen3.6 27B	6.5	3.4	66.7%	1		39.53s	516	81	3,045

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		12.76s	777	533	2,035
Qwen3.6 27B	10.0	10.0	100.0%	0		37.96s	699	346	6,548

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	9.9	10.0	100.0%	0		26.91s	801	1,795	5,595
Qwen3.6 27B	7.7	10.0	66.7%	0		61.14s	696	255	12,044

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	3.0	10.0	0.0%	0		0ms	0	0	0
Qwen3.6 27B	10.0	10.0	100.0%	0		16.88s	8,213	390	2,954

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	3.0	10.0	0.0%	0		90.14s	218	1,692	10,014
Qwen3.6 27B	3.0	10.0	0.0%	0		80.99s	204	401	5,807

Quick Compare

Switch Comparison Pair

Gemma 4 31BmediumFree AvailablevsLongCat 2.0none Claude Sonnet 5nonevsGemma 4 31BmediumFree Available Gemini 3.1 Flash Lite PreviewlowvsQwen3.6 27Bmedium Gemini 3.1 Flash LitelowvsQwen3.6 27Bmedium LongCat 2.0highvsQwen3.6 27Bmedium Qwen3.6 27BmediumvsGLM 5.2none Gemini 3.1 Flash Lite PreviewnonevsQwen3.6 27Bmedium Gemma 4 31BmediumFree AvailablevsLing 3.0 FlashhighFree Available Seed-2.0-LitenonevsGemma 4 31BmediumFree Available Gemma 4 31BmediumFree AvailablevsGPT-5.6 Lunalow Gemma 4 31BmediumFree AvailablevsQwen3.5 Plus 2026-02-15none Ling 3.0 FlashhighFree AvailablevsQwen3.6 27Bmedium