Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Google: Gemma 4 26B A4B vs Qwen: Qwen3.7 Max

Last updated at: 2026-05-28

Metric Gemma 4 26B A4B Gemma 4 26B A4B medium Release: 2026-04-03 Free Available Qwen3.7 Max Qwen3.7 Max none Release: 2026-05-22
Score 7.8 7.9
Rank #32 #28
Reliability 10.0 10.0
Consistency 9.2 10.0
Tests Correct
Attempt pass rate 73.3% 70.0%
Flaky tests 2 0
Total Runs 60 60
Cost per result 0.317 0.719
Total Cost $0.038 $0.051
Input Price $0.060 / 1M $1.250 / 1M
Output Price $0.330 / 1M $3.750 / 1M
Output Tokens 28,000 1,988
Reasoning Tokens 82,045 0
Response Time (avg) 50.92s 1.30s
Response Time (max) 369.32s 3.92s
Response Time (total) 967.47s 25.95s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 6.20s 1,142 3,045
Qwen3.7 Max 6.5 10.0 50.0% 0 1.08s 242 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 2.9 10.0 0.0% 0 258.40s 14,838 26,122
Qwen3.7 Max 6.8 10.0 50.0% 0 1.39s 576 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 9.6 10.0 100.0% 0 73.55s 5,415 13,112
Qwen3.7 Max 3.0 10.0 0.0% 0 2.17s 171 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 16.51s 1,567 2,827
Qwen3.7 Max 10.0 10.0 100.0% 0 1.35s 243 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 2.9 4.4 22.2% 2 23.62s 2,469 7,105
Qwen3.7 Max 7.7 10.0 66.7% 0 975ms 15 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 29.76s 25 5,075
Qwen3.7 Max 10.0 10.0 100.0% 0 1.04s 120 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 17.54s 887 4,470
Qwen3.7 Max 10.0 10.0 100.0% 0 943ms 72 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 5.79s 410 2,128
Qwen3.7 Max 10.0 10.0 100.0% 0 1.13s 314 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 9.01s 450 1,256
Qwen3.7 Max 10.0 10.0 100.0% 0 3.92s 222 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.0 10.0 0.0% 0 180.87s 797 16,905
Qwen3.7 Max 3.0 10.0 0.0% 0 856ms 13 0

Quick Compare

Switch Comparison Pair

GPT-5.4mediumvsQwen3.7 MaxnoneQwen3.7 MaxnonevsGLM 5 TurbomediumGemma 4 26B A4BmediumFree AvailablevsGPT-5.2 ChatnoneGemini 3.5 FlashminimalvsQwen3.7 MaxnoneGemma 4 31BmediumFree AvailablevsQwen3.7 MaxnoneQwen3.7 MaxnonevsGrok 4.3mediumSeed-2.0-LitemediumvsQwen3.7 MaxnoneGemini 3.1 Flash Lite PreviewmediumvsQwen3.7 MaxnoneGemini 3.1 Flash LitemediumvsQwen3.7 MaxnoneGemini 2.5 FlashmediumvsQwen3.7 MaxnoneDeepSeek V4 FlashhighFree AvailablevsGemma 4 26B A4BmediumFree AvailableGemini 3 PRO PreviewmediumvsQwen3.7 Maxnone