Navigate
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Gemma 4 26B A4B (medium) vs Qwen3.5-27B

Gemma 4 26B A4B (medium) leads on average score with 7.3 vs 7.2. Gemma 4 26B A4B (medium) has the lower benchmark cost at $0.101 vs $0.116. Qwen3.5-27B is faster at 9.98s vs 105.03s, with pass rates of 71.0% vs 47.8%.

Last updated at: 2026-10-02

Compared models

Rank
#131
Total Output Tokens
269,351
Response Time (avg)
105.03s
Total Cost
$0.101
Rank
#139
Total Output Tokens
36,422
Response Time (avg)
9.98s
Total Cost
$0.116
Recommended model Qwen3.5-27B

Its score stays close to the best score here (7.2 vs 7.3), while responding about 10.5x faster than Gemma 4 26B A4B (medium).

Detailed comparison

Metric Gemma 4 26B A4B Gemma 4 26B A4B medium Release: 2026-04-03 Free Available Qwen3.5-27B Qwen3.5-27B none Release: 2026-02-24
Score 7.3 7.2
Rank #131 #139
Reliability 10.0 10.0
Consistency 9.6 9.4
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 71.0% 47.8%
Flaky tests 1 2
Total Runs 69 69
Cost per result 0.679 1.153
Total Cost $0.101 $0.116
Input Price $0.090 / 1M $0.195 / 1M
Output Price $0.300 / 1M $1.560 / 1M
Cache Read Price $0.050 / 1M N/A
Cache Write Price N/A N/A
Total Input Tokens 224,367 283,977
Output Tokens 27,095 36,422
Reasoning Tokens 242,256 0
Response Time (avg) 105.03s 9.98s
Response Time (max) 912.19s 124.53s
Response Time (total) 2310.63s 229.52s
Parameters 25.2B total (3.8B active) 27B
Availability Open source Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#131 Gemma 4 26B A4B

medium
Reached the allocated time limit (300 seconds) without receiving showcase output.
Cost
$0.000
Time
300.0s
Tokens
0 tok

#139 Qwen3.5-27B

none
Cost
$0.007
Time
42.9s
Tokens
4,273 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 2.9 10.0 0.0% 0 272.54s 5,062 14,838 44,567
Qwen3.5-27B 5.8 10.0 33.3% 0 1.80s 7,913 415 0

Quick Compare

Switch Comparison Pair

Gemma 4 26B A4BmediumFree AvailablevsGLM 5.3 FlashhighDeepSeek V4 Pro 0423nonevsGemma 4 26B A4BmediumFree AvailableGemini 3.5 Flash LitemediumvsQwen3.5-27BnoneGemini 3.8 FlashlowvsQwen3.5-27BnoneLongCat 2.0highvsQwen3.5-27BnoneGemini 2.5 FlashmediumvsQwen3.5-27BnoneClaude Opus 4.8lowvsQwen3.5-27BnoneGemma 4 26B A4BmediumFree AvailablevsInkling SmallhighFree AvailableQwen3.5-27BnonevsGrok 4.7mediumGemma 4 26B A4BmediumFree AvailablevsGrok 4.7lowGemma 4 26B A4BmediumFree AvailablevsGLM 5.3 FlashXhighGemma 4 26B A4BmediumFree AvailablevsLongCat 2.0high