Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Google: Gemma 4 26B A4B vs Qwen: Qwen3.5-35B-A3B

Last updated at: 2026-04-14

Metric Gemma 4 26B A4B Gemma 4 26B A4B none Release: 2026-04-03 Free Available Qwen3.5-35B-A3B Qwen3.5-35B-A3B medium Release: 2026-02-24
Score 6.2 7.4
Rank #57 #40
Consistency 8.7 6.7
Tests Correct
Attempt pass rate 48.2% 79.6%
Flaky tests 3 7
Total Runs 54 54
Cost per result 0.071 3.976
Total Cost $0.005 $0.398
Input Price $0.080 / 1M $0.163 / 1M
Output Price $0.350 / 1M $1.300 / 1M
Output Tokens 1,783 10,137
Reasoning Tokens 0 208,761
Response Time (avg) 6.59s 44.51s
Response Time (max) 57.10s 106.00s
Response Time (total) 118.61s 801.21s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 8.3 10.0 75.0% 0 1.28s 230 0
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 21.13s 798 42,652
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 4.7 1.6 66.7% 1 7.07s 448 0
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 79.09s 4,273 33,078
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.0 10.0 0.0% 0 30.53s 309 0
Qwen3.5-35B-A3B 4.7 1.6 66.7% 1 75.34s 775 12,485
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 1.70s 285 0
Qwen3.5-35B-A3B 7.3 5.9 83.3% 1 59.33s 235 19,493
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.6 7.2 22.2% 1 2.49s 27 0
Qwen3.5-35B-A3B 4.1 4.4 44.5% 2 88.34s 41 46,368
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 4.0 10.0 0.0% 0 3.54s 85 0
Qwen3.5-35B-A3B 2.8 1.6 33.3% 1 30.30s 20 3,753
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 4.4 6.9 16.7% 1 1.08s 75 0
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 24.45s 97 17,361
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 5.7 10.0 33.3% 0 739ms 114 0
Qwen3.5-35B-A3B 6.4 4.4 77.8% 2 31.58s 3,589 32,206
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 57.10s 210 0
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 4.65s 309 1,365

Quick Compare

Switch Comparison Pair

Claude Sonnet 4.6nonevsQwen3.5-35B-A3BmediumGemma 4 26B A4BnoneFree AvailablevsGPT-5 NanomediumGPT-5.3 ChatnonevsQwen3.5-35B-A3BmediumGemma 4 26B A4BnoneFree AvailablevsMercury 2mediumGemma 4 26B A4BnoneFree Availablevsgpt-oss-120bmediumFree AvailableGemma 4 26B A4BnoneFree AvailablevsGrok 4.1 FastmediumGemini 3.1 Flash Lite PreviewnonevsQwen3.5-35B-A3BmediumGemma 4 26B A4BnoneFree AvailablevsMiniMax M2.5mediumFree AvailableGPT-5.2 ChatnonevsQwen3.5-35B-A3BmediumGemma 4 31BnoneFree AvailablevsQwen3.5-35B-A3BmediumGemma 4 26B A4BnoneFree AvailablevsMistral Small 4mediumGemma 4 26B A4BnoneFree AvailablevsNemotron 3 SupermediumFree Available