Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

Google: Gemma 4 26B A4B vs MiniMax: MiniMax M2.5

Summary

Gemma 4 26B A4B vs MiniMax M2.5 benchmark comparison: Gemma 4 26B A4B leads on average score with 5.5 vs 4.7. Gemma 4 26B A4B has the lower benchmark cost at $0.004 vs $0.303. Gemma 4 26B A4B is faster at 5.91s vs 65.37s, with pass rates of 44.4% vs 46.0%.

Recommended model: Gemma 4 26B A4B - It has the best score here (5.5), while costing about 100.7x less than MiniMax M2.5.

Last updated at: 2026-06-12

Metric Gemma 4 26B A4B Gemma 4 26B A4B none Release: 2026-04-03 Free Available MiniMax M2.5 MiniMax M2.5 medium Release: 2026-02-12
Score 5.5 4.7
Rank #125 #151
Reliability 10.0 10.0
Consistency 9.2 6.5
Tests Correct
Attempt pass rate 44.4% 46.0%
Flaky tests 2 9
Total Runs 63 63
Cost per result 0.068 7.900
Total Cost $0.004 $0.303
Input Price $0.060 / 1M $0.150 / 1M
Output Price $0.330 / 1M $0.900 / 1M
Total Input Tokens 40,038 43,706
Output Tokens 1,824 109,495
Reasoning Tokens 0 330,814
Response Time (avg) 5.91s 65.37s
Response Time (max) 57.10s 251.36s
Response Time (total) 124.05s 849.76s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#125 Gemma 4 26B A4B

none
Cost
$0.001
Time
39.5s
Tokens
790 tok

#151 MiniMax M2.5

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 8.3 10.0 75.0% 0 1.28s 852 230 0
MiniMax M2.5 7.9 6.3 83.3% 2 20.82s 612 286 45,344
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.7 7.2 22.2% 1 4.16s 7,736 476 0
MiniMax M2.5 3.4 9.1 0.0% 0 188.58s 6,076 357 106,177
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.0 10.0 0.0% 0 30.53s 13,650 309 0
MiniMax M2.5 4.5 2.1 66.7% 1 60.39s 21,104 740 9,713
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 1.70s 8,352 285 0
MiniMax M2.5 4.6 1.7 66.7% 2 7.48s 6,584 266 3,835
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.6 7.2 22.2% 1 2.49s 903 27 0
MiniMax M2.5 2.9 4.4 22.2% 2 237.27s 308 105,047 133,487
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 4.0 10.0 0.0% 0 3.54s 576 85 0
MiniMax M2.5 3.8 2.5 33.3% 1 6.63s 492 25 1,686
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 6.3 10.0 50.0% 0 690ms 795 75 0
MiniMax M2.5 7.5 10.0 50.0% 0 621ms 699 156 1,495
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 6.2 10.0 33.3% 0 744ms 828 114 0
MiniMax M2.5 5.3 7.2 44.4% 1 11.21s 495 1,069 9,605
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 57.10s 6,123 210 0
MiniMax M2.5 10.0 10.0 100.0% 0 15.35s 7,123 269 937
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.0 10.0 0.0% 0 778ms 223 13 0
MiniMax M2.5 3.0 10.0 0.0% 0 80.79s 213 1,280 18,535

Quick Compare

Switch Comparison Pair

Ling-2.6-1TnonevsMiniMax M2.5mediumMiniMax M2.5mediumvsgpt-oss-120bnoneFree AvailableMiniMax M2.5mediumvsGPT-5.4 NanononeMercury 2nonevsMiniMax M2.5mediumRing-2.6-1TnonevsMiniMax M2.5mediumLing-2.6-flashnonevsMiniMax M2.5mediumMiniMax M2.5mediumvsNemotron 3 SupernoneFree AvailableMiniMax M2.5mediumvsGLM 4.7 FlashnoneMiniMax M2.5mediumvsGPT-4o-mininoneTrinity Large PreviewnonevsMiniMax M2.5mediumGemma 4 26B A4BnoneFree AvailablevsMiniMax M2.7mediumGemma 4 26B A4BnoneFree AvailablevsMistral Small 4medium