Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Google: Gemma 4 31B vs Qwen: Qwen3.5-27B

Last updated at: 2026-05-19

Metric Gemma 4 31B Gemma 4 31B medium Release: 2026-04-02 Free Available Qwen3.5-27B Qwen3.5-27B medium Release: 2026-02-24
Score 8.2 8.1
Rank #18 #22
Reliability 6.7 10.0
Consistency 9.6 8.8
Tests Correct
Attempt pass rate 77.2% 77.2%
Flaky tests 1 3
Total Runs 57 57
Cost per result 0.158 4.107
Total Cost $0.023 $0.534
Input Price $0.120 / 1M $0.195 / 1M
Output Price $0.370 / 1M $1.560 / 1M
Output Tokens 14,426 2,531
Reasoning Tokens 37,964 266,183
Response Time (avg) 28.72s 54.71s
Response Time (max) 90.14s 163.96s
Response Time (total) 488.27s 1039.57s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 12.89s 962 2,046
Qwen3.5-27B 8.7 7.9 91.7% 1 19.75s 569 31,505
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 4.7 1.6 66.7% 1 70.97s 3,166 5,449
Qwen3.5-27B 10.0 10.0 100.0% 0 70.35s 375 19,165
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
Qwen3.5-27B 10.0 10.0 100.0% 0 163.96s 483 9,991
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 21.11s 1,822 2,951
Qwen3.5-27B 10.0 10.0 100.0% 0 30.26s 270 16,150
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 7.7 10.0 66.7% 0 38.48s 4,349 8,985
Qwen3.5-27B 5.3 10.0 33.3% 0 79.53s 43 52,368
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 9.57s 105 888
Qwen3.5-27B 6.1 3.1 66.7% 1 101.41s 70 23,147
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 12.76s 533 2,035
Qwen3.5-27B 10.0 10.0 100.0% 0 19.66s 97 11,638
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 9.9 10.0 100.0% 0 27.63s 1,797 5,596
Qwen3.5-27B 8.2 7.7 77.8% 1 64.61s 245 77,213
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
Qwen3.5-27B 10.0 10.0 100.0% 0 7.45s 348 1,323
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 90.14s 1,692 10,014
Qwen3.5-27B 3.0 10.0 0.0% 0 85.11s 31 23,683

Quick Compare

Switch Comparison Pair

Gemini 3.5 FlashminimalvsQwen3.5-27BmediumGemini 3 Flash PreviewnonevsQwen3.5-27BmediumGemini 3.1 Flash Lite PreviewlowvsQwen3.5-27BmediumGemini 3.1 Flash Lite PreviewnonevsQwen3.5-27BmediumGPT-5.2 ChatnonevsQwen3.5-27BmediumGemini 3.1 Flash LitelowvsQwen3.5-27BmediumGPT-5.3 ChatnonevsQwen3.5-27BmediumDeepSeek V4 FlashhighFree AvailablevsQwen3.5-27BmediumGemma 4 31BmediumFree AvailablevsGPT-5.2 ChatnoneGemma 4 31BmediumFree AvailablevsGPT-5.5lowGemma 4 31BmediumFree AvailablevsGPT-5.3 ChatnoneDeepSeek V4 FlashhighFree AvailablevsGemma 4 31BmediumFree Available