Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Google: Gemma 4 26B A4B vs Qwen: Qwen3.5-35B-A3B

Last updated at: 2026-05-28

Metric Gemma 4 26B A4B Gemma 4 26B A4B none Release: 2026-04-03 Free Available Qwen3.5-35B-A3B Qwen3.5-35B-A3B none Release: 2026-02-24
Score 6.2 5.8
Rank #94 #106
Reliability 10.0 10.0
Consistency 9.2 8.9
Tests Correct
Attempt pass rate 46.7% 45.0%
Flaky tests 2 3
Total Runs 60 60
Cost per result 0.066 0.224
Total Cost $0.003 $0.011
Input Price $0.060 / 1M $0.139 / 1M
Output Price $0.330 / 1M $1.000 / 1M
Output Tokens 1,815 4,334
Reasoning Tokens 0 0
Response Time (avg) 5.96s 3.50s
Response Time (max) 57.10s 47.43s
Response Time (total) 119.22s 70.00s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 8.3 10.0 75.0% 0 1.28s 230 0
Qwen3.5-35B-A3B 3.4 7.9 16.7% 1 1.43s 574 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 4.1 5.8 33.3% 1 3.83s 467 0
Qwen3.5-35B-A3B 6.8 10.0 50.0% 0 1.72s 562 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.0 10.0 0.0% 0 30.53s 309 0
Qwen3.5-35B-A3B 3.0 10.0 0.0% 0 47.43s 1,833 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 1.70s 285 0
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 1.16s 243 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.6 7.2 22.2% 1 2.49s 27 0
Qwen3.5-35B-A3B 7.7 10.0 66.7% 0 485ms 15 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 4.0 10.0 0.0% 0 3.54s 85 0
Qwen3.5-35B-A3B 6.5 3.4 66.7% 1 1.19s 114 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 6.3 10.0 50.0% 0 690ms 75 0
Qwen3.5-35B-A3B 6.3 10.0 50.0% 0 809ms 63 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 6.2 10.0 33.3% 0 744ms 114 0
Qwen3.5-35B-A3B 3.7 7.4 22.2% 1 1.35s 655 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 57.10s 210 0
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 2.30s 264 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.0 10.0 0.0% 0 778ms 13 0
Qwen3.5-35B-A3B 3.0 10.0 0.0% 0 493ms 11 0

Quick Compare

Switch Comparison Pair

Owl AlphamediumvsQwen3.5-35B-A3BnoneCobuddymediumvsQwen3.5-35B-A3BnoneGemma 4 26B A4BnoneFree AvailablevsGPT-5 Nanomediumgpt-oss-120bmediumFree AvailablevsQwen3.5-35B-A3BnoneNemotron 3 SupermediumFree AvailablevsQwen3.5-35B-A3BnoneGemma 4 26B A4BnoneFree AvailablevsNemotron 3 SupermediumFree AvailableGemma 4 26B A4BnoneFree Availablevsgpt-oss-120bmediumFree AvailableGPT-5 NanomediumvsQwen3.5-35B-A3BnoneGemma 4 26B A4BnoneFree AvailablevsOwl AlphamediumGemma 4 26B A4BnoneFree AvailablevsMercury 2mediumMiniMax M2.5mediumFree AvailablevsQwen3.5-35B-A3BnoneDeepSeek V4 ProhighvsGemma 4 26B A4BnoneFree Available