Gemma 4 31B (medium) vs Qwen3.5 Plus 2026-02-15

Recommended model Qwen3.5 Plus 2026-02-15

It has the best score here (6.6), while responding about 8.0x faster than Gemma 4 31B (medium).

Detailed comparison

Metric	Gemma 4 31B Gemma 4 31B medium Release: 2026-04-02 Free Available	Qwen3.5 Plus 2026-02-15 Qwen3.5 Plus 2026-02-15 none Release: 2026-02-15

Metric	Gemma 4 31B Gemma 4 31B medium Release: 2026-04-02 Free Available	Qwen3.5 Plus 2026-02-15 Qwen3.5 Plus 2026-02-15 none Release: 2026-02-15
Score	6.2	6.6
Rank	#166	#151
Reliability	10.0	10.0
Consistency	8.7	9.4
Attempts	66/66	66/66
Tests Correct
Attempt pass rate	65.2%	53.0%
Flaky tests	3	2
Total Runs	66	66
Cost per result	1.152	0.682
Total Cost	$0.100	$0.073
Input Price	$0.090 / 1M	$0.260 / 1M
Output Price	$0.340 / 1M	$1.560 / 1M
Total Input Tokens	94,969	102,655
Output Tokens	34,399	29,370
Reasoning Tokens	233,022	0
Response Time (avg)	78.59s	9.86s
Response Time (max)	437.40s	123.00s
Response Time (total)	1571.84s	157.77s
Parameters	30.7B	~397B total (~17B active)
Availability	Open source	Closed

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

medium

none

Category:

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		12.89s	816	962	2,046
Qwen3.5 Plus 2026-02-15	4.8	10.0	25.0%	0		1.91s	696	517	0

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	4.3	5.8	22.2%	1		219.76s	5,568	11,098	33,212
Qwen3.5 Plus 2026-02-15	4.3	7.9	11.1%	1		2.05s	7,913	473	0

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	2.9	5.8	16.7%	1		433.11s	77,035	12,112	157,552
Qwen3.5 Plus 2026-02-15	6.5	10.0	50.0%	0		64.83s	75,086	27,204	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		21.11s	8,334	1,822	2,951
Qwen3.5 Plus 2026-02-15	10.0	10.0	100.0%	0		1.89s	7,794	243	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	5.3	7.2	44.4%	1		59.92s	853	4,280	18,729
Qwen3.5 Plus 2026-02-15	7.7	10.0	66.7%	0		1.24s	798	17	0

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		9.57s	567	105	888
Qwen3.5 Plus 2026-02-15	4.4	3.0	33.3%	1		2.26s	522	117	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		12.76s	777	533	2,035
Qwen3.5 Plus 2026-02-15	10.0	10.0	100.0%	0		1.67s	711	72	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	9.9	10.0	100.0%	0		26.91s	801	1,795	5,595
Qwen3.5 Plus 2026-02-15	7.7	10.0	66.7%	0		2.71s	714	494	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	3.0	10.0	0.0%	0		0ms	0	0	0
Qwen3.5 Plus 2026-02-15	10.0	10.0	100.0%	0		3.33s	8,211	222	0

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	3.0	10.0	0.0%	0		90.14s	218	1,692	10,014
Qwen3.5 Plus 2026-02-15	3.0	10.0	0.0%	0		1.11s	210	11	0

Switch Comparison Pair