Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Google: Gemma 4 31B vs Qwen: Qwen3.6 Plus

Last updated at: 2026-05-10

Metric Gemma 4 31B Gemma 4 31B none Release: 2026-04-02 Free Available Qwen3.6 Plus Qwen3.6 Plus medium Release: 2026-04-20
Score 6.9 7.9
Rank #66 #28
Reliability 10.0 10.0
Consistency 10.0 9.6
Tests Correct
Attempt pass rate 52.6% 70.2%
Flaky tests 0 1
Total Runs 57 57
Cost per result 0.025 0.118
Total Cost $0.003 $0.016
Input Price $0.130 / 1M $0.325 / 1M
Output Price $0.380 / 1M $1.950 / 1M
Output Tokens 1,371 1,784
Reasoning Tokens 0 91,543
Response Time (avg) 3.86s 17.06s
Response Time (max) 26.13s 47.51s
Response Time (total) 65.57s 307.07s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 6.5 10.0 50.0% 0 1.85s 45 0
Qwen3.6 Plus 10.0 10.0 100.0% 0 9.90s 207 7,557
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 26.13s 699 0
Qwen3.6 Plus 3.0 10.0 0.0% 0 0ms 0 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
Qwen3.6 Plus 10.0 10.0 100.0% 0 34.95s 452 13,073
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 2.25s 285 0
Qwen3.6 Plus 10.0 10.0 100.0% 0 14.95s 270 10,706
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 7.7 10.0 66.7% 0 3.22s 27 0
Qwen3.6 Plus 2.9 7.2 11.1% 1 29.59s 56 33,464
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 2.09s 117 0
Qwen3.6 Plus 5.1 10.0 0.0% 0 27.05s 111 5,232
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 6.5 10.0 50.0% 0 2.84s 78 0
Qwen3.6 Plus 10.0 10.0 100.0% 0 7.54s 102 5,552
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 6.5 10.0 33.3% 0 2.95s 108 0
Qwen3.6 Plus 10.0 10.0 100.0% 0 6.11s 298 6,868
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
Qwen3.6 Plus 10.0 10.0 100.0% 0 5.87s 267 1,330
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 1.25s 12 0
Qwen3.6 Plus 3.0 10.0 0.0% 0 47.51s 21 7,761

Quick Compare

Switch Comparison Pair

DeepSeek V4 ProhighvsGemma 4 31BnoneFree AvailableGemma 4 31BnoneFree AvailablevsGrok 4.20mediumGemini 3 Flash PreviewnonevsQwen3.6 PlusmediumGemma 4 31BnoneFree AvailablevsGPT-5 MinimediumGemini 3.1 Flash Lite PreviewlowvsQwen3.6 PlusmediumGemma 4 31BnoneFree AvailablevsKimi K2.5mediumGemma 4 31BnoneFree AvailablevsQwen3.6 27BmediumGemini 3.1 Flash Lite PreviewnonevsQwen3.6 PlusmediumGPT-5.2 ChatnonevsQwen3.6 PlusmediumGemini 3.1 Flash LitelowvsQwen3.6 PlusmediumGemma 4 31BnoneFree AvailablevsMiMo-V2-OmnimediumGemma 4 31BnoneFree AvailablevsGPT-5.4 Minimedium