Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Google: Gemma 4 31B vs Qwen: Qwen3.5-35B-A3B

Last updated at: 2026-04-29

Metric Gemma 4 31B Gemma 4 31B medium Release: 2026-04-02 Free Available Qwen3.5-35B-A3B Qwen3.5-35B-A3B none Release: 2026-02-24
Score 8.3 6.1
Rank #19 #81
Reliability N/A N/A
Consistency 9.2 8.7
Tests Correct
Attempt pass rate 79.6% 50.0%
Flaky tests 2 3
Total Runs 54 54
Cost per result 0.136 0.215
Total Cost $0.018 $0.016
Input Price $0.130 / 1M $0.163 / 1M
Output Price $0.380 / 1M $1.300 / 1M
Output Tokens 12,734 4,300
Reasoning Tokens 27,950 0
Response Time (avg) 24.88s 3.82s
Response Time (max) 70.97s 47.43s
Response Time (total) 398.13s 68.74s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 12.89s 962 2,046
Qwen3.5-35B-A3B 3.4 7.9 16.7% 1 1.43s 574 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 4.7 1.6 66.7% 1 70.97s 3,166 5,449
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 2.67s 539 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
Qwen3.5-35B-A3B 3.0 10.0 0.0% 0 47.43s 1,833 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 21.11s 1,822 2,951
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 1.16s 243 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 7.7 10.0 66.7% 0 38.48s 4,349 8,985
Qwen3.5-35B-A3B 7.7 10.0 66.7% 0 485ms 15 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 9.57s 105 888
Qwen3.5-35B-A3B 6.5 3.4 66.7% 1 1.19s 114 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 12.76s 533 2,035
Qwen3.5-35B-A3B 6.3 10.0 50.0% 0 809ms 63 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 8.8 7.9 88.9% 1 27.63s 1,797 5,596
Qwen3.5-35B-A3B 3.9 7.4 22.2% 1 1.34s 655 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 2.30s 264 0

Quick Compare

Switch Comparison Pair

Laguna Xs.2mediumFree AvailablevsQwen3.5-35B-A3BnoneGPT-5 NanomediumvsQwen3.5-35B-A3BnoneGemma 4 31BmediumFree AvailablevsHY3 PreviewhighFree AvailableLaguna M.1mediumFree AvailablevsQwen3.5-35B-A3BnoneGemma 4 31BmediumFree AvailablevsHY3 PreviewlowFree Availablegpt-oss-120bmediumFree AvailablevsQwen3.5-35B-A3BnoneMercury 2mediumvsQwen3.5-35B-A3BnoneGemma 4 31BmediumFree AvailablevsGPT-5.2 ChatnoneMiniMax M2.5mediumFree AvailablevsQwen3.5-35B-A3BnoneMistral Small 4mediumvsQwen3.5-35B-A3BnoneDeepSeek V4 FlashhighvsGemma 4 31BmediumFree AvailableQwen3.5-35B-A3BnonevsGrok 4.1 Fastmedium