Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Google: Gemma 4 31B vs Qwen: Qwen3.6 35B A3B

Summary

Gemma 4 31B vs Qwen3.6 35B A3B benchmark comparison: Qwen3.6 35B A3B leads on average score with 6.7 vs 6.3. Gemma 4 31B has the lower benchmark cost at $0.033 vs $0.146. Qwen3.6 35B A3B is faster at 18.08s vs 56.55s, with pass rates of 69.8% vs 63.5%.

Recommended model: Gemma 4 31B - Its score stays close to the best score here (6.3 vs 6.7), while costing about 4.5x less than Qwen3.6 35B A3B.

Last updated at: 2026-06-18

Metric Gemma 4 31B Gemma 4 31B medium Release: 2026-04-02 Free Available Qwen3.6 35B A3B Qwen3.6 35B A3B medium Release: 2026-04-20
Score 6.3 6.7
Rank #88 #75
Reliability 10.0 10.0
Consistency 9.4 9.6
Tests Correct
Attempt pass rate 69.8% 63.5%
Flaky tests 1 1
Total Runs 63 63
Cost per result 0.257 1.094
Total Cost $0.033 $0.146
Input Price $0.120 / 1M $0.140 / 1M
Output Price $0.350 / 1M $1.000 / 1M
Total Input Tokens 17,957 16,385
Output Tokens 22,356 19,632
Reasoning Tokens 65,726 130,219
Response Time (avg) 56.55s 18.08s
Response Time (max) 437.40s 86.11s
Response Time (total) 1074.41s 343.61s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#88 Gemma 4 31B

medium
Cost
$0.002
Time
45.7s
Tokens
2,696 tok

#75 Qwen3.6 35B A3B

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 12.89s 816 962 2,046
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 6.02s 672 1,154 12,385
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 31B 4.3 5.8 22.2% 1 219.76s 5,568 11,098 33,212
Qwen3.6 35B A3B 7.7 10.0 66.7% 0 50.55s 5,051 7,929 37,223
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0 0
Qwen3.6 35B A3B 3.0 10.0 0.0% 0 0ms 0 0 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 21.11s 8,334 1,822 2,951
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 12.99s 7,776 2,591 9,968
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 31B 7.7 10.0 66.7% 0 38.48s 876 4,349 8,985
Qwen3.6 35B A3B 5.3 7.2 44.4% 1 22.50s 771 6,193 39,116
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 9.57s 567 105 888
Qwen3.6 35B A3B 4.4 9.9 0.0% 0 8.66s 516 129 4,569
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 12.76s 777 533 2,035
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 7.50s 699 219 7,404
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 31B 9.9 10.0 100.0% 0 26.91s 801 1,795 5,595
Qwen3.6 35B A3B 8.0 10.0 66.7% 0 5.95s 696 655 9,228
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0 0
Qwen3.6 35B A3B 3.0 10.0 0.0% 0 0ms 0 0 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 90.14s 218 1,692 10,014
Qwen3.6 35B A3B 3.0 10.0 0.0% 0 32.90s 204 762 10,326

Quick Compare

Switch Comparison Pair

Gemma 4 31BmediumFree AvailablevsGPT-5.5noneGemini 3.5 FlashminimalvsQwen3.6 35B A3BmediumSeed-2.0-LitenonevsGemma 4 31BmediumFree AvailableGemini 3 Flash PreviewnonevsQwen3.6 35B A3BmediumGemma 4 31BmediumFree AvailablevsQwen3.5-FlashnoneGemini 3.1 Flash Lite PreviewlowvsQwen3.6 35B A3BmediumGemini 3.5 FlashnonevsQwen3.6 35B A3BmediumGemma 4 31BmediumFree AvailablevsNemotron 3 Ultra 550b A55bnoneFree AvailableGemini 3.1 Flash Lite PreviewnonevsQwen3.6 35B A3BmediumGemini 3.1 Flash LitelowvsQwen3.6 35B A3BmediumGemma 4 31BmediumFree AvailablevsQwen3.6 Max PreviewnoneGemma 4 31BmediumFree AvailablevsGLM 5none