Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Google: Gemma 4 26B A4B vs Qwen: Qwen3.6 Flash

Summary

Gemma 4 26B A4B vs Qwen3.6 Flash benchmark comparison: Gemma 4 26B A4B leads on average score with 7.6 vs 7.5. Gemma 4 26B A4B has the lower benchmark cost at $0.045 vs $0.288. Qwen3.6 Flash is faster at 19.25s vs 63.41s, with pass rates of 69.8% vs 71.4%.

Recommended model: Gemma 4 26B A4B - It has the best score here (7.6), while costing about 6.5x less than Qwen3.6 Flash.

Last updated at: 2026-06-10

Metric Gemma 4 26B A4B Gemma 4 26B A4B medium Release: 2026-04-03 Free Available Qwen3.6 Flash Qwen3.6 Flash medium Release: 2026-04-20
Score 7.6 7.5
Rank #38 #40
Reliability 10.0 10.0
Consistency 9.2 8.1
Tests Correct
Attempt pass rate 69.8% 71.4%
Flaky tests 2 5
Total Runs 63 63
Cost per result 0.361 3.030
Total Cost $0.045 $0.288
Input Price $0.060 / 1M $0.188 / 1M
Output Price $0.330 / 1M $1.125 / 1M
Total Input Tokens 40,252 42,362
Output Tokens 28,000 2,995
Reasoning Tokens 100,490 245,358
Response Time (avg) 63.41s 19.25s
Response Time (max) 369.32s 122.87s
Response Time (total) 1268.28s 404.20s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#38 Gemma 4 26B A4B

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

#40 Qwen3.6 Flash

medium
Invalid SVG
Cost
$0.008
Time
29.9s
Tokens
6,784 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 6.20s 816 1,142 3,045
Qwen3.6 Flash 10.0 10.0 100.0% 0 6.10s 672 624 14,024
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 2.9 10.0 0.0% 0 272.54s 5,062 14,838 44,567
Qwen3.6 Flash 5.0 5.1 44.5% 2 42.85s 7,895 495 67,967
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 9.6 10.0 100.0% 0 73.55s 17,092 5,415 13,112
Qwen3.6 Flash 10.0 10.0 100.0% 0 20.28s 14,934 483 13,839
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 16.51s 8,334 1,567 2,827
Qwen3.6 Flash 10.0 10.0 100.0% 0 9.65s 7,782 270 13,155
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 2.9 4.4 22.2% 2 23.62s 516 2,469 7,105
Qwen3.6 Flash 3.5 4.4 33.3% 2 14.65s 771 60 24,409
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 29.76s 567 25 5,075
Qwen3.6 Flash 4.8 9.9 0.0% 0 9.88s 516 140 5,445
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 17.54s 777 887 4,470
Qwen3.6 Flash 10.0 10.0 100.0% 0 6.05s 699 102 7,423
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 5.79s 801 410 2,128
Qwen3.6 Flash 8.2 7.2 88.9% 1 6.29s 696 460 10,860
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 9.01s 6,096 450 1,256
Qwen3.6 Flash 10.0 10.0 100.0% 0 4.00s 8,193 335 1,188
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.0 10.0 0.0% 0 180.87s 191 797 16,905
Qwen3.6 Flash 3.0 10.0 0.0% 0 122.87s 204 26 87,048

Quick Compare

Switch Comparison Pair

Gemma 4 26B A4BmediumFree AvailablevsQwen3.7 MaxnoneGemini 3 Flash PreviewnonevsQwen3.6 FlashmediumGemini 3.1 Flash Lite PreviewlowvsQwen3.6 FlashmediumDeepSeek V4 FlashhighvsGemma 4 26B A4BmediumFree AvailableGemini 3.5 FlashminimalvsQwen3.6 FlashmediumDeepSeek V4 FlashhighvsQwen3.6 FlashmediumQwen3.6 FlashmediumvsStep 3.7 FlashlowGemini 3.1 Flash Lite PreviewnonevsQwen3.6 FlashmediumGemini 3.1 Flash LitelowvsQwen3.6 FlashmediumGPT-5.3 ChatnonevsQwen3.6 FlashmediumGemma 4 26B A4BmediumFree AvailablevsStep 3.7 FlashlowGemma 4 26B A4BmediumFree AvailablevsGPT-5.2 Chatnone