Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Google: Gemma 4 26B A4B vs Qwen: Qwen3.5-Flash

Last updated at: 2026-04-04

Metric Gemma 4 26B A4B Gemma 4 26B A4B medium Release: 2026-04-03 Qwen3.5-Flash Qwen3.5-Flash none Release: 2026-02-24
Score 8.3 6.0
Rank #13 #56
Consistency 8.9 9.6
Tests Correct
Attempt pass rate 80.4% 43.1%
Flaky tests 2 1
Total Runs 51 51
Cost per result 0.189 0.077
Total Cost $0.025 $0.006
Input Price $0.130 / 1M $0.065 / 1M
Output Price $0.400 / 1M $0.260 / 1M
Output Tokens 12,412 3,777
Reasoning Tokens 39,955 0
Response Time (avg) 17.38s 3.36s
Response Time (max) 73.55s 13.73s
Response Time (total) 278.01s 57.15s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 6.20s 1,142 3,045
Qwen3.5-Flash 3.5 8.3 8.3% 1 1.32s 690 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 9.6 10.0 100.0% 0 73.55s 5,415 13,112
Qwen3.5-Flash 3.0 10.0 0.0% 0 6.22s 1,794 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 16.51s 1,567 2,827
Qwen3.5-Flash 10.0 10.0 100.0% 0 1.57s 243 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 2.9 4.4 22.2% 2 23.62s 2,469 7,105
Qwen3.5-Flash 7.7 10.0 66.7% 0 905ms 15 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 29.76s 25 5,075
Qwen3.5-Flash 10.0 10.0 100.0% 0 803ms 100 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 17.54s 887 4,470
Qwen3.5-Flash 6.3 10.0 50.0% 0 8.81s 63 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 7.9 9.6 66.7% 0 8.52s 457 3,065
Qwen3.5-Flash 3.3 10.0 0.0% 0 5.90s 608 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 9.01s 450 1,256
Qwen3.5-Flash 10.0 10.0 100.0% 0 3.67s 264 0

Quick Compare

Switch Comparison Pair

gpt-oss-120bmediumFree AvailablevsQwen3.5-FlashnoneMiniMax M2.5mediumFree AvailablevsQwen3.5-FlashnoneQwen3.5-FlashnonevsGrok 4.20 Multi Agent BetamediumGPT-5 NanomediumvsQwen3.5-FlashnoneMercury 2mediumvsQwen3.5-FlashnoneMistral Small 4mediumvsQwen3.5-FlashnoneGemma 4 26B A4BmediumvsGPT-5.2 ChatnoneGemma 4 26B A4BmediumvsGPT-5.3 ChatnoneGPT-5 MinimediumvsQwen3.5-FlashnoneNemotron 3 SupermediumFree AvailablevsQwen3.5-FlashnoneQwen3.5-FlashnonevsGrok 4.1 FastmediumHunter AlphamediumvsQwen3.5-Flashnone