Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

Google: Gemma 4 31B vs Qwen: Qwen3.7 Max

Last updated at: 2026-05-22

Metric Gemma 4 31B Gemma 4 31B medium Release: 2026-04-02 Free Available Qwen3.7 Max Qwen3.7 Max none Release: 2026-05-22
Score 8.0 7.9
Rank #24 #27
Reliability 6.7 10.0
Consistency 9.2 10.0
Tests Correct
Attempt pass rate 75.0% 70.0%
Flaky tests 2 0
Total Runs 60 60
Cost per result 0.205 0.719
Total Cost $0.029 $0.101
Input Price $0.120 / 1M $2.500 / 1M
Output Price $0.370 / 1M $7.500 / 1M
Output Tokens 19,604 1,988
Reasoning Tokens 49,687 0
Response Time (avg) 35.51s 1.30s
Response Time (max) 150.90s 3.92s
Response Time (total) 639.17s 25.95s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 12.89s 962 2,046
Qwen3.7 Max 6.5 10.0 50.0% 0 1.08s 242 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.8 1.6 50.0% 2 110.94s 8,344 17,172
Qwen3.7 Max 6.8 10.0 50.0% 0 1.39s 576 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
Qwen3.7 Max 3.0 10.0 0.0% 0 2.17s 171 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 21.11s 1,822 2,951
Qwen3.7 Max 10.0 10.0 100.0% 0 1.35s 243 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 7.7 10.0 66.7% 0 38.48s 4,349 8,985
Qwen3.7 Max 7.7 10.0 66.7% 0 975ms 15 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 9.57s 105 888
Qwen3.7 Max 10.0 10.0 100.0% 0 1.04s 120 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 12.76s 533 2,035
Qwen3.7 Max 10.0 10.0 100.0% 0 943ms 72 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 9.9 10.0 100.0% 0 27.63s 1,797 5,596
Qwen3.7 Max 10.0 10.0 100.0% 0 1.13s 314 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
Qwen3.7 Max 10.0 10.0 100.0% 0 3.92s 222 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 90.14s 1,692 10,014
Qwen3.7 Max 3.0 10.0 0.0% 0 856ms 13 0

Quick Compare

Switch Comparison Pair

GPT-5.4mediumvsQwen3.7 MaxnoneQwen3.7 MaxnonevsGLM 5 TurbomediumGemini 3.5 FlashminimalvsQwen3.7 MaxnoneQwen3.7 MaxnonevsMiMo-V2.5mediumQwen3.7 MaxnonevsGrok 4.3mediumSeed-2.0-LitemediumvsQwen3.7 MaxnoneGemini 3.1 Flash Lite PreviewmediumvsQwen3.7 MaxnoneGemini 3.1 Flash LitemediumvsQwen3.7 MaxnoneGemini 2.5 FlashmediumvsQwen3.7 MaxnoneQwen3.7 MaxnonevsMiMo-V2.5-PromediumGemini 3 PRO PreviewmediumvsQwen3.7 MaxnoneGemini 3.1 Flash Lite PreviewlowvsQwen3.7 Maxnone