Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Google: Gemma 4 31B vs Qwen: Qwen3.5-27B

Last updated at: 2026-04-02

Metric Gemma 4 31B Gemma 4 31B none Release: 2026-04-02 Qwen3.5-27B Qwen3.5-27B medium Release: 2026-02-24
Score 6.7 8.3
Rank #47 #13
Consistency 10.0 8.7
Tests Correct
Attempt pass rate 52.9% 80.4%
Flaky tests 0 3
Total Runs 51 51
Cost per result 0.023 3.885
Total Cost $0.002 $0.467
Input Price $0.140 / 1M $0.195 / 1M
Output Price $0.400 / 1M $1.560 / 1M
Output Tokens 660 2,125
Reasoning Tokens 0 223,335
Response Time (avg) 2.55s 52.01s
Response Time (max) 4.68s 163.96s
Response Time (total) 38.20s 884.10s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 6.5 10.0 50.0% 0 1.85s 45 0
Qwen3.5-27B 8.7 7.9 91.7% 1 19.75s 569 31,505
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
Qwen3.5-27B 10.0 10.0 100.0% 0 163.96s 483 9,991
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 2.25s 285 0
Qwen3.5-27B 10.0 10.0 100.0% 0 30.26s 270 16,150
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 7.7 10.0 66.7% 0 3.22s 27 0
Qwen3.5-27B 5.3 10.0 33.3% 0 79.53s 43 52,368
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 2.09s 117 0
Qwen3.5-27B 6.1 3.1 66.7% 1 101.41s 70 23,147
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 6.5 10.0 50.0% 0 2.84s 78 0
Qwen3.5-27B 10.0 10.0 100.0% 0 19.66s 97 11,638
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 5.5 10.0 33.3% 0 2.95s 108 0
Qwen3.5-27B 8.2 7.7 77.8% 1 64.61s 245 77,213
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
Qwen3.5-27B 10.0 10.0 100.0% 0 7.45s 348 1,323

Quick Compare

Switch Comparison Pair

Gemma 4 31BnonevsGPT-5 MinimediumGemma 4 31BnonevsNemotron 3 SupermediumFree AvailableGemma 4 31BnonevsGrok 4.1 FastmediumGemma 4 31BnonevsHunter AlphamediumGemini 3.1 Flash Lite PreviewlowvsQwen3.5-27BmediumGemini 3 Flash PreviewnonevsQwen3.5-27BmediumGemma 4 31BnonevsGPT-5.4 MinimediumGemma 4 31BnonevsGrok 4.20mediumGemini 3 Flash PreviewlowvsQwen3.5-27BmediumGemma 4 31BnonevsMercury 2mediumGemma 4 31BnonevsGPT-5 NanomediumGemma 4 31BnonevsKimi K2.5medium