Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Google: Gemma 4 26B A4B vs MiniMax: MiniMax M2.5

Last updated at: 2026-04-04

Metric Gemma 4 26B A4B Gemma 4 26B A4B none Release: 2026-04-03 MiniMax M2.5 MiniMax M2.5 medium Release: 2026-02-12 Free Available
Score 6.3 5.9
Rank #53 #62
Consistency 9.1 5.4
Tests Correct
Attempt pass rate 47.1% 60.8%
Flaky tests 2 10
Total Runs 51 51
Cost per result 0.068 4.987
Total Cost $0.005 $0.250
Input Price $0.130 / 1M $0.118 / 1M
Output Price $0.400 / 1M $0.991 / 1M
Output Tokens 1,335 107,044
Reasoning Tokens 0 206,422
Response Time (avg) 6.56s 39.65s
Response Time (max) 57.10s 237.27s
Response Time (total) 111.54s 396.47s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 8.3 10.0 75.0% 0 1.28s 230 0
MiniMax M2.5 7.9 6.3 83.3% 2 20.82s 286 45,344
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.0 10.0 0.0% 0 30.53s 309 0
MiniMax M2.5 4.5 2.1 66.7% 1 60.39s 740 9,713
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 1.70s 285 0
MiniMax M2.5 4.6 1.7 66.7% 2 7.48s 266 3,835
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.6 7.2 22.2% 1 2.49s 27 0
MiniMax M2.5 2.9 4.4 22.2% 2 237.27s 105,047 133,487
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 4.0 10.0 0.0% 0 3.54s 85 0
MiniMax M2.5 3.8 2.5 33.3% 1 6.63s 25 1,686
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 4.4 6.9 16.7% 1 1.08s 75 0
MiniMax M2.5 8.1 6.8 83.3% 1 4.64s 252 1,873
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 5.7 10.0 33.3% 0 739ms 114 0
MiniMax M2.5 5.3 7.2 44.4% 1 11.54s 159 9,547
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 57.10s 210 0
MiniMax M2.5 10.0 10.0 100.0% 0 15.35s 269 937

Quick Compare

Switch Comparison Pair

Gemma 4 26B A4BnonevsGPT-5 NanomediumMiniMax M2.5mediumFree AvailablevsQwen3.5-35B-A3BnoneMiniMax M2.5mediumFree AvailablevsHunter AlphanoneGemma 4 26B A4BnonevsGrok 4.20 Multi Agent BetamediumGemini 2.5 FlashnonevsMiniMax M2.5mediumFree AvailableGemma 4 26B A4BnonevsMercury 2mediumMiniMax M2.5mediumFree AvailablevsQwen3.5-122B-A10BnoneSeed-2.0-LitenonevsMiniMax M2.5mediumFree AvailableMiniMax M2.5mediumFree AvailablevsGLM 5V TurbononeMiniMax M2.5mediumFree AvailablevsMiMo-V2-PrononeMiniMax M2.5mediumFree AvailablevsQwen3.5-FlashnoneMiniMax M2.5mediumFree AvailablevsGPT-5.4none