Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Google: Gemma 4 31B vs Qwen: Qwen3.7 Plus

Summary

Gemma 4 31B vs Qwen3.7 Plus benchmark comparison: Qwen3.7 Plus leads on average score with 7.2 vs 6.3. Qwen3.7 Plus has the lower benchmark cost at $0.023 vs $0.033. Qwen3.7 Plus is faster at 2.85s vs 56.55s, with pass rates of 69.8% vs 47.6%.

Recommended model: Qwen3.7 Plus - It has the best score here (7.2), while responding about 19.8x faster than Gemma 4 31B.

Last updated at: 2026-06-18

Metric Gemma 4 31B Gemma 4 31B medium Release: 2026-04-02 Free Available Qwen3.7 Plus Qwen3.7 Plus none Release: 2026-06-03
Score 6.3 7.2
Rank #88 #60
Reliability 10.0 10.0
Consistency 9.4 10.0
Tests Correct
Attempt pass rate 69.8% 47.6%
Flaky tests 1 0
Total Runs 63 63
Cost per result 0.257 0.276
Total Cost $0.033 $0.023
Input Price $0.120 / 1M $0.320 / 1M
Output Price $0.350 / 1M $1.280 / 1M
Total Input Tokens 17,957 42,510
Output Tokens 22,356 6,578
Reasoning Tokens 65,726 0
Response Time (avg) 56.55s 2.85s
Response Time (max) 437.40s 29.38s
Response Time (total) 1074.41s 59.86s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#88 Gemma 4 31B

medium
Cost
$0.002
Time
45.7s
Tokens
2,696 tok

#60 Qwen3.7 Plus

none
Cost
$0.019
Time
213.5s
Tokens
11,960 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 12.89s 816 962 2,046
Qwen3.7 Plus 6.5 10.0 50.0% 0 1.38s 696 349 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 31B 4.3 5.8 22.2% 1 219.76s 5,568 11,098 33,212
Qwen3.7 Plus 5.5 10.0 33.3% 0 2.15s 7,911 639 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0 0
Qwen3.7 Plus 10.0 10.0 100.0% 0 29.38s 14,952 4,505 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 21.11s 8,334 1,822 2,951
Qwen3.7 Plus 10.0 10.0 100.0% 0 1.43s 7,794 243 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 31B 7.7 10.0 66.7% 0 38.48s 876 4,349 8,985
Qwen3.7 Plus 3.0 10.0 0.0% 0 868ms 789 18 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 9.57s 567 105 888
Qwen3.7 Plus 5.3 10.0 0.0% 0 1.33s 522 78 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 12.76s 777 533 2,035
Qwen3.7 Plus 6.3 10.0 50.0% 0 929ms 711 72 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 31B 9.9 10.0 100.0% 0 26.91s 801 1,795 5,595
Qwen3.7 Plus 7.7 10.0 66.7% 0 1.71s 714 443 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0 0
Qwen3.7 Plus 10.0 10.0 100.0% 0 3.54s 8,211 222 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 90.14s 218 1,692 10,014
Qwen3.7 Plus 3.0 10.0 0.0% 0 1.21s 210 9 0

Quick Compare

Switch Comparison Pair

Gemma 4 26B A4BmediumFree AvailablevsQwen3.7 PlusnoneGemma 4 31BmediumFree AvailablevsGPT-5.5noneQwen3.7 PlusnonevsStep 3.7 FlashhighQwen3.7 PlusnonevsGLM 5.1mediumSeed-2.0-LitenonevsGemma 4 31BmediumFree AvailableKimi K2.7 CodemediumvsQwen3.7 PlusnoneQwen3.7 PlusnonevsGrok 4.20mediumGemini 3 Flash PreviewlowvsQwen3.7 PlusnoneGemma 4 31BmediumFree AvailablevsQwen3.5-FlashnoneQwen3.7 PlusnonevsMiMo-V2.5-PromediumSeed-2.0-MinimediumvsQwen3.7 PlusnoneGemma 4 31BmediumFree AvailablevsNemotron 3 Ultra 550b A55bnoneFree Available