Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Google: Gemma 4 26B A4B vs Qwen: Qwen3.6 27B

Last updated at: 2026-04-27

Metric Gemma 4 26B A4B Gemma 4 26B A4B none Release: 2026-04-03 Free Available Qwen3.6 27B Qwen3.6 27B medium Release: 2026-04-20
Score 6.2 7.0
Rank #77 #60
Reliability N/A 10.0
Consistency 8.7 7.9
Tests Correct
Attempt pass rate 48.2% 64.8%
Flaky tests 3 5
Total Runs 54 54
Cost per result 0.071 2.321
Total Cost $0.005 $0.209
Input Price $0.060 / 1M $0.500 / 1M
Output Price $0.330 / 1M $2.000 / 1M
Output Tokens 1,783 8,279
Reasoning Tokens 0 91,083
Response Time (avg) 6.59s 50.53s
Response Time (max) 57.10s 168.22s
Response Time (total) 118.61s 909.49s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 8.3 10.0 75.0% 0 1.28s 230 0
Qwen3.6 27B 8.3 10.0 75.0% 0 12.62s 582 4,311
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 4.7 1.6 66.7% 1 7.07s 448 0
Qwen3.6 27B 10.0 10.0 100.0% 0 168.22s 433 17,861
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.0 10.0 0.0% 0 30.53s 309 0
Qwen3.6 27B 7.0 3.7 66.7% 1 83.07s 2,088 14,689
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 1.70s 285 0
Qwen3.6 27B 3.5 1.4 50.0% 2 37.30s 568 9,404
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.6 7.2 22.2% 1 2.49s 27 0
Qwen3.6 27B 2.9 7.2 11.1% 1 73.38s 3,510 20,352
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 4.0 10.0 0.0% 0 3.54s 85 0
Qwen3.6 27B 6.5 3.4 66.7% 1 39.53s 81 3,045
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 4.4 6.9 16.7% 1 1.08s 75 0
Qwen3.6 27B 10.0 10.0 100.0% 0 37.96s 346 6,548
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 5.7 10.0 33.3% 0 739ms 114 0
Qwen3.6 27B 7.7 10.0 66.7% 0 60.21s 281 11,919
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 57.10s 210 0
Qwen3.6 27B 10.0 10.0 100.0% 0 16.88s 390 2,954

Quick Compare

Switch Comparison Pair

Gemma 4 26B A4BnoneFree AvailablevsGPT-5 NanomediumGemma 4 31BnoneFree AvailablevsQwen3.6 27BmediumDeepSeek V4 ProhighvsQwen3.6 27BmediumGPT-5.5nonevsQwen3.6 27BmediumGemma 4 26B A4BnoneFree AvailablevsMercury 2mediumDeepSeek V4 PrononevsQwen3.6 27BmediumGemma 4 26B A4BnoneFree Availablevsgpt-oss-120bmediumFree AvailableQwen3.6 27BmediumvsGLM 5noneClaude Sonnet 4.6nonevsQwen3.6 27BmediumGemma 4 26B A4BnoneFree AvailablevsGrok 4.1 FastmediumGemma 4 26B A4BnoneFree AvailablevsMiniMax M2.5mediumFree AvailableGemma 4 26B A4BnoneFree AvailablevsMistral Small 4medium