Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Google: Gemma 4 31B vs Qwen: Qwen3.5 Plus 2026-02-15

Last updated at: 2026-04-02

Metric Gemma 4 31B Gemma 4 31B none Release: 2026-04-02 Qwen3.5 Plus 2026-02-15 Qwen3.5 Plus 2026-02-15 none Release: 2026-02-15
Score 6.7 6.8
Rank #47 #46
Consistency 10.0 9.6
Tests Correct
Attempt pass rate 52.9% 54.9%
Flaky tests 0 1
Total Runs 51 51
Cost per result 0.023 0.172
Total Cost $0.002 $0.016
Input Price $0.140 / 1M $0.260 / 1M
Output Price $0.400 / 1M $1.560 / 1M
Output Tokens 660 2,018
Reasoning Tokens 0 0
Response Time (avg) 2.55s 2.51s
Response Time (max) 4.68s 6.65s
Response Time (total) 38.20s 27.60s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 6.5 10.0 50.0% 0 1.85s 45 0
Qwen3.5 Plus 2026-02-15 4.8 10.0 25.0% 0 1.91s 517 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
Qwen3.5 Plus 2026-02-15 3.0 10.0 0.0% 0 6.65s 314 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 2.25s 285 0
Qwen3.5 Plus 2026-02-15 10.0 10.0 100.0% 0 1.89s 243 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 7.7 10.0 66.7% 0 3.22s 27 0
Qwen3.5 Plus 2026-02-15 5.3 10.0 33.3% 0 1.17s 17 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 2.09s 117 0
Qwen3.5 Plus 2026-02-15 4.4 3.0 33.3% 1 2.26s 117 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 6.5 10.0 50.0% 0 2.84s 78 0
Qwen3.5 Plus 2026-02-15 10.0 10.0 100.0% 0 1.67s 72 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 5.5 10.0 33.3% 0 2.95s 108 0
Qwen3.5 Plus 2026-02-15 7.7 10.0 66.7% 0 2.82s 516 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
Qwen3.5 Plus 2026-02-15 10.0 10.0 100.0% 0 3.33s 222 0

Quick Compare

Switch Comparison Pair

GPT-5 MinimediumvsQwen3.5 Plus 2026-02-15noneGemma 4 31BnonevsGPT-5 MinimediumNemotron 3 SupermediumFree AvailablevsQwen3.5 Plus 2026-02-15noneQwen3.5 Plus 2026-02-15nonevsGrok 4.1 FastmediumHunter AlphamediumvsQwen3.5 Plus 2026-02-15noneGemma 4 31BnonevsNemotron 3 SupermediumFree AvailableGemma 4 31BnonevsGrok 4.1 FastmediumGemma 4 31BnonevsHunter AlphamediumGPT-5.4 MinimediumvsQwen3.5 Plus 2026-02-15noneQwen3.5 Plus 2026-02-15nonevsGrok 4.20mediumGemma 4 31BnonevsGPT-5.4 MinimediumGemma 4 31BnonevsGrok 4.20medium