Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Google: Gemma 4 31B vs Qwen: Qwen3.5-122B-A10B

Last updated at: 2026-04-02

Metric Gemma 4 31B Gemma 4 31B medium Release: 2026-04-02 Qwen3.5-122B-A10B Qwen3.5-122B-A10B medium Release: 2026-02-24
Score 8.6 8.4
Rank #5 #12
Consistency 9.6 9.0
Tests Correct
Attempt pass rate 80.4% 80.4%
Flaky tests 1 2
Total Runs 51 51
Cost per result 0.109 3.883
Total Cost $0.015 $0.505
Input Price $0.140 / 1M $0.260 / 1M
Output Price $0.400 / 1M $2.080 / 1M
Output Tokens 9,568 17,313
Reasoning Tokens 22,501 151,974
Response Time (avg) 21.81s 29.05s
Response Time (max) 68.92s 119.29s
Response Time (total) 327.16s 493.86s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 12.89s 962 2,046
Qwen3.5-122B-A10B 10.0 10.0 100.0% 0 9.75s 269 16,835
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
Qwen3.5-122B-A10B 10.0 10.0 100.0% 0 107.79s 483 11,337
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 21.11s 1,822 2,951
Qwen3.5-122B-A10B 10.0 10.0 100.0% 0 23.41s 270 16,558
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 7.7 10.0 66.7% 0 38.48s 4,349 8,985
Qwen3.5-122B-A10B 2.9 7.2 11.1% 1 63.40s 15,537 64,889
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 9.57s 105 888
Qwen3.5-122B-A10B 3.4 2.2 33.3% 1 34.11s 66 7,592
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 12.76s 533 2,035
Qwen3.5-122B-A10B 10.0 10.0 100.0% 0 9.88s 77 7,372
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 8.8 7.9 88.9% 1 27.63s 1,797 5,596
Qwen3.5-122B-A10B 10.0 10.0 100.0% 0 17.18s 289 26,165
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
Qwen3.5-122B-A10B 10.0 10.0 100.0% 0 4.60s 322 1,226

Quick Compare

Switch Comparison Pair