Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Google: Gemma 4 31B vs Qwen: Qwen3.6 27B

Last updated at: 2026-04-27

Metric Gemma 4 31B Gemma 4 31B none Release: 2026-04-02 Free Available Qwen3.6 27B Qwen3.6 27B medium Release: 2026-04-20
Score 6.9 7.0
Rank #62 #60
Reliability N/A 10.0
Consistency 10.0 7.9
Tests Correct
Attempt pass rate 55.6% 64.8%
Flaky tests 0 5
Total Runs 54 54
Cost per result 0.024 2.321
Total Cost $0.003 $0.209
Input Price $0.130 / 1M $0.500 / 1M
Output Price $0.380 / 1M $2.000 / 1M
Output Tokens 1,359 8,279
Reasoning Tokens 0 91,083
Response Time (avg) 4.02s 50.53s
Response Time (max) 26.13s 168.22s
Response Time (total) 64.33s 909.49s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 6.5 10.0 50.0% 0 1.85s 45 0
Qwen3.6 27B 8.3 10.0 75.0% 0 12.62s 582 4,311
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 26.13s 699 0
Qwen3.6 27B 10.0 10.0 100.0% 0 168.22s 433 17,861
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
Qwen3.6 27B 7.0 3.7 66.7% 1 83.07s 2,088 14,689
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 2.25s 285 0
Qwen3.6 27B 3.5 1.4 50.0% 2 37.30s 568 9,404
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 7.7 10.0 66.7% 0 3.22s 27 0
Qwen3.6 27B 2.9 7.2 11.1% 1 73.38s 3,510 20,352
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 2.09s 117 0
Qwen3.6 27B 6.5 3.4 66.7% 1 39.53s 81 3,045
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 6.5 10.0 50.0% 0 2.84s 78 0
Qwen3.6 27B 10.0 10.0 100.0% 0 37.96s 346 6,548
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 5.5 10.0 33.3% 0 2.95s 108 0
Qwen3.6 27B 7.7 10.0 66.7% 0 60.21s 281 11,919
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
Qwen3.6 27B 10.0 10.0 100.0% 0 16.88s 390 2,954

Quick Compare

Switch Comparison Pair

Gemma 4 31BnoneFree AvailablevsGrok 4.20mediumDeepSeek V4 ProhighvsGemma 4 31BnoneFree AvailableGemma 4 31BnoneFree AvailablevsKimi K2.5mediumGemma 4 31BnoneFree AvailablevsGPT-5 MinimediumGemma 4 31BnoneFree AvailablevsNemotron 3 SupermediumFree AvailableDeepSeek V4 ProhighvsQwen3.6 27BmediumGemma 4 31BnoneFree AvailablevsGrok 4.1 FastmediumGPT-5.5nonevsQwen3.6 27BmediumDeepSeek V4 PrononevsQwen3.6 27BmediumQwen3.6 27BmediumvsGLM 5noneGemma 4 31BnoneFree AvailablevsGPT-5.4 MinimediumGemma 4 31BnoneFree AvailablevsMercury 2medium