Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

Google: Gemma 4 26B A4B vs Qwen: Qwen3.5-122B-A10B

Last updated at: 2026-05-28

Metric Gemma 4 26B A4B Gemma 4 26B A4B medium Release: 2026-04-03 Free Available Qwen3.5-122B-A10B Qwen3.5-122B-A10B medium Release: 2026-02-24
Score 7.8 7.7
Rank #32 #41
Reliability 10.0 10.0
Consistency 9.2 8.8
Tests Correct
Attempt pass rate 73.3% 71.7%
Flaky tests 2 3
Total Runs 60 60
Cost per result 0.317 5.031
Total Cost $0.038 $0.509
Input Price $0.060 / 1M $0.260 / 1M
Output Price $0.330 / 1M $2.080 / 1M
Output Tokens 28,000 26,166
Reasoning Tokens 82,045 213,524
Response Time (avg) 50.92s 39.40s
Response Time (max) 369.32s 168.16s
Response Time (total) 967.47s 788.00s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 6.20s 1,142 3,045
Qwen3.5-122B-A10B 10.0 10.0 100.0% 0 9.75s 269 16,835
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 2.9 10.0 0.0% 0 258.40s 14,838 26,122
Qwen3.5-122B-A10B 4.1 5.8 33.3% 1 119.57s 8,036 45,074
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 9.6 10.0 100.0% 0 73.55s 5,415 13,112
Qwen3.5-122B-A10B 10.0 10.0 100.0% 0 107.79s 483 11,337
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 16.51s 1,567 2,827
Qwen3.5-122B-A10B 10.0 10.0 100.0% 0 23.41s 270 16,558
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 2.9 4.4 22.2% 2 23.62s 2,469 7,105
Qwen3.5-122B-A10B 2.9 7.2 11.1% 1 63.40s 15,537 64,889
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 29.76s 25 5,075
Qwen3.5-122B-A10B 3.4 2.2 33.3% 1 34.11s 66 7,592
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 17.54s 887 4,470
Qwen3.5-122B-A10B 10.0 10.0 100.0% 0 9.88s 77 7,372
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 5.79s 410 2,128
Qwen3.5-122B-A10B 10.0 10.0 100.0% 0 17.89s 284 27,575
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 9.01s 450 1,256
Qwen3.5-122B-A10B 10.0 10.0 100.0% 0 4.60s 322 1,226
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.0 10.0 0.0% 0 180.87s 797 16,905
Qwen3.5-122B-A10B 3.0 10.0 0.0% 0 52.87s 822 15,066

Quick Compare

Switch Comparison Pair