Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Google: Gemma 4 26B A4B vs Qwen: Qwen3.5-27B

Last updated at: 2026-04-11

Metric Gemma 4 26B A4B Gemma 4 26B A4B none Release: 2026-04-03 Free Available Qwen3.5-27B Qwen3.5-27B none Release: 2026-02-24
Score 6.2 5.9
Rank #57 #64
Consistency 8.7 9.2
Tests Correct
Attempt pass rate 48.2% 38.9%
Flaky tests 3 2
Total Runs 54 54
Cost per result 0.071 0.265
Total Cost $0.005 $0.016
Input Price $0.120 / 1M $0.195 / 1M
Output Price $0.400 / 1M $1.560 / 1M
Output Tokens 1,783 3,545
Reasoning Tokens 0 0
Response Time (avg) 6.59s 1.74s
Response Time (max) 57.10s 9.39s
Response Time (total) 118.61s 31.32s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 8.3 10.0 75.0% 0 1.28s 230 0
Qwen3.5-27B 4.8 10.0 25.0% 0 788ms 267 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 4.7 1.6 66.7% 1 7.07s 448 0
Qwen3.5-27B 10.0 10.0 100.0% 0 2.51s 381 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.0 10.0 0.0% 0 30.53s 309 0
Qwen3.5-27B 2.8 1.6 33.3% 1 9.39s 1,461 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 1.70s 285 0
Qwen3.5-27B 10.0 10.0 100.0% 0 1.43s 243 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.6 7.2 22.2% 1 2.49s 27 0
Qwen3.5-27B 3.0 10.0 0.0% 0 540ms 15 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 4.0 10.0 0.0% 0 3.54s 85 0
Qwen3.5-27B 5.0 10.0 0.0% 0 2.51s 126 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 4.4 6.9 16.7% 1 1.08s 75 0
Qwen3.5-27B 4.8 10.0 0.0% 0 815ms 69 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 5.7 10.0 33.3% 0 739ms 114 0
Qwen3.5-27B 6.7 7.9 55.6% 1 1.37s 680 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 57.10s 210 0
Qwen3.5-27B 10.0 10.0 100.0% 0 3.54s 303 0

Quick Compare

Switch Comparison Pair

gpt-oss-120bmediumFree AvailablevsQwen3.5-27BnoneGemma 4 26B A4BnoneFree AvailablevsGPT-5 NanomediumMiniMax M2.5mediumFree AvailablevsQwen3.5-27BnoneMistral Small 4mediumvsQwen3.5-27BnoneGemma 4 26B A4BnoneFree AvailablevsMercury 2mediumGemma 4 26B A4BnoneFree Availablevsgpt-oss-120bmediumFree AvailableGPT-5 NanomediumvsQwen3.5-27BnoneGemma 4 26B A4BnoneFree AvailablevsGrok 4.1 FastmediumGemma 4 26B A4BnoneFree AvailablevsMiniMax M2.5mediumFree AvailableGemma 4 26B A4BnoneFree AvailablevsMistral Small 4mediumGemma 4 26B A4BnoneFree AvailablevsNemotron 3 SupermediumFree AvailableMiniMax M2.7mediumvsQwen3.5-27Bnone