Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Google: Gemma 4 31B vs Qwen: Qwen3.7 Max

Last updated at: 2026-05-22

Metric Gemma 4 31B Gemma 4 31B medium Release: 2026-04-02 Free Available Qwen3.7 Max Qwen3.7 Max medium Release: 2026-05-22
Score 8.0 9.0
Rank #23 #5
Reliability 6.7 10.0
Consistency 9.2 9.6
Tests Correct
Attempt pass rate 75.0% 88.3%
Flaky tests 2 1
Total Runs 60 60
Cost per result 0.205 5.540
Total Cost $0.029 $0.942
Input Price $0.120 / 1M $2.500 / 1M
Output Price $0.370 / 1M $7.500 / 1M
Output Tokens 19,604 2,109
Reasoning Tokens 49,687 110,285
Response Time (avg) 35.51s 13.83s
Response Time (max) 150.90s 33.37s
Response Time (total) 639.17s 276.53s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 12.89s 962 2,046
Qwen3.7 Max 10.0 10.0 100.0% 0 6.36s 222 8,742
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.8 1.6 50.0% 2 110.94s 8,344 17,172
Qwen3.7 Max 10.0 10.0 100.0% 0 22.98s 403 22,134
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
Qwen3.7 Max 10.0 10.0 100.0% 0 19.60s 366 8,405
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 21.11s 1,822 2,951
Qwen3.7 Max 10.0 10.0 100.0% 0 8.80s 270 6,254
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 7.7 10.0 66.7% 0 38.48s 4,349 8,985
Qwen3.7 Max 5.9 7.2 55.6% 1 24.94s 61 31,793
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 9.57s 105 888
Qwen3.7 Max 10.0 10.0 100.0% 0 11.70s 135 4,457
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 12.76s 533 2,035
Qwen3.7 Max 10.0 10.0 100.0% 0 7.46s 102 5,452
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 9.9 10.0 100.0% 0 27.63s 1,797 5,596
Qwen3.7 Max 10.0 10.0 100.0% 0 8.84s 259 8,908
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
Qwen3.7 Max 10.0 10.0 100.0% 0 6.63s 267 1,220
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 90.14s 1,692 10,014
Qwen3.7 Max 3.0 10.0 0.0% 0 33.37s 24 12,920

Quick Compare

Switch Comparison Pair

Gemma 4 31BmediumFree AvailablevsQwen3.7 MaxnoneGPT-5.5lowvsQwen3.7 MaxmediumGemini 3.5 FlashnonevsQwen3.7 MaxmediumGemini 3.5 FlashlowvsQwen3.7 MaxmediumGemma 4 31BmediumFree AvailablevsGPT-5.2 ChatnoneGemini 3 Flash PreviewlowvsQwen3.7 MaxmediumGemma 4 31BmediumFree AvailablevsGPT-5.3 ChatnoneDeepSeek V4 FlashhighFree AvailablevsGemma 4 31BmediumFree AvailableGemini 3.5 FlashhighvsQwen3.7 MaxmediumGemma 4 31BmediumFree AvailablevsRing-2.6-1TnoneGemma 4 31BmediumFree AvailablevsQwen3.6 Max PreviewnoneClaude Sonnet 4.6nonevsGemma 4 31BmediumFree Available