Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Google: Gemma 4 31B vs Qwen: Qwen3.5-Flash

Last updated at: 2026-04-14

Metric Gemma 4 31B Gemma 4 31B none Release: 2026-04-02 Free Available Qwen3.5-Flash Qwen3.5-Flash medium Release: 2026-02-24
Score 6.9 7.8
Rank #45 #30
Consistency 10.0 7.3
Tests Correct
Attempt pass rate 55.6% 81.5%
Flaky tests 0 6
Total Runs 54 54
Cost per result 0.024 0.719
Total Cost $0.003 $0.080
Input Price $0.130 / 1M $0.065 / 1M
Output Price $0.380 / 1M $0.260 / 1M
Output Tokens 1,359 2,073
Reasoning Tokens 0 191,899
Response Time (avg) 4.02s 66.72s
Response Time (max) 26.13s 234.29s
Response Time (total) 64.33s 1201.03s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 6.5 10.0 50.0% 0 1.85s 45 0
Qwen3.5-Flash 10.0 10.0 100.0% 0 59.11s 383 32,992
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 26.13s 699 0
Qwen3.5-Flash 4.7 1.6 66.7% 1 45.75s 246 12,600
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
Qwen3.5-Flash 10.0 10.0 100.0% 0 17.78s 483 8,270
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 2.25s 285 0
Qwen3.5-Flash 7.3 5.9 83.3% 1 56.99s 235 16,237
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 7.7 10.0 66.7% 0 3.22s 27 0
Qwen3.5-Flash 5.3 7.2 44.4% 1 146.50s 58 43,615
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 2.09s 117 0
Qwen3.5-Flash 6.1 3.1 66.7% 1 40.05s 99 38,486
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 6.5 10.0 50.0% 0 2.84s 78 0
Qwen3.5-Flash 10.0 10.0 100.0% 0 63.49s 98 14,139
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 5.5 10.0 33.3% 0 2.95s 108 0
Qwen3.5-Flash 6.4 4.4 77.8% 2 56.74s 162 24,276
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
Qwen3.5-Flash 10.0 10.0 100.0% 0 10.33s 309 1,284

Quick Compare

Switch Comparison Pair

Gemma 4 31BnoneFree AvailablevsGrok 4.20mediumGemini 3.1 Flash Lite PreviewnonevsQwen3.5-FlashmediumGPT-5.2 ChatnonevsQwen3.5-FlashmediumGemma 4 31BnoneFree AvailablevsKimi K2.5mediumGemma 4 31BnoneFree AvailablevsGPT-5 MinimediumGPT-5.3 ChatnonevsQwen3.5-FlashmediumGemma 4 31BnoneFree AvailablevsNemotron 3 SupermediumFree AvailableGemma 4 31BnoneFree AvailablevsGrok 4.1 FastmediumGemini 3.1 Flash Lite PreviewlowvsQwen3.5-FlashmediumGemini 3 Flash PreviewnonevsQwen3.5-FlashmediumGemma 4 31BnoneFree AvailablevsGPT-5.4 MinimediumClaude Sonnet 4.6nonevsQwen3.5-Flashmedium