Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

Google: Gemma 4 26B A4B vs Xiaomi: MiMo-V2.5-Pro

Summary

Gemma 4 26B A4B vs MiMo-V2.5-Pro benchmark comparison: Gemma 4 26B A4B leads on average score with 7.6 vs 7.5. Gemma 4 26B A4B has the lower benchmark cost at $0.045 vs $0.106. MiMo-V2.5-Pro is faster at 26.13s vs 63.41s, with pass rates of 69.8% vs 68.3%.

Recommended model: Gemma 4 26B A4B - It has the best score here (7.6), while costing about 2.4x less than MiMo-V2.5-Pro.

Last updated at: 2026-06-04

Metric Gemma 4 26B A4B Gemma 4 26B A4B medium Release: 2026-04-03 Free Available MiMo-V2.5-Pro MiMo-V2.5-Pro medium Release: 2026-04-22
Score 7.6 7.5
Rank #37 #43
Reliability 10.0 10.0
Consistency 9.2 8.5
Tests Correct
Attempt pass rate 69.8% 68.3%
Flaky tests 2 4
Total Runs 63 63
Cost per result 0.361 2.541
Total Cost $0.045 $0.106
Input Price $0.060 / 1M $0.435 / 1M
Output Price $0.330 / 1M $0.870 / 1M
Total Input Tokens 40,252 40,854
Output Tokens 28,000 5,015
Reasoning Tokens 100,490 97,742
Response Time (avg) 63.41s 26.13s
Response Time (max) 369.32s 130.77s
Response Time (total) 1268.28s 548.65s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#37 Gemma 4 26B A4B

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

#43 MiMo-V2.5-Pro

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 6.20s 816 1,142 3,045
MiMo-V2.5-Pro 10.0 10.0 100.0% 0 3.26s 621 323 1,179
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 2.9 10.0 0.0% 0 272.54s 5,062 14,838 44,567
MiMo-V2.5-Pro 6.2 4.7 66.7% 2 92.07s 6,543 780 51,218
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 9.6 10.0 100.0% 0 73.55s 17,092 5,415 13,112
MiMo-V2.5-Pro 10.0 10.0 100.0% 0 53.36s 15,060 348 11,870
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 16.51s 8,334 1,567 2,827
MiMo-V2.5-Pro 7.3 5.8 83.3% 1 18.81s 7,746 260 8,383
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 2.9 4.4 22.2% 2 23.62s 516 2,469 7,105
MiMo-V2.5-Pro 5.3 10.0 33.3% 0 37.87s 630 275 17,023
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 29.76s 567 25 5,075
MiMo-V2.5-Pro 5.5 10.0 0.0% 0 4.02s 492 155 163
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 17.54s 777 887 4,470
MiMo-V2.5-Pro 9.9 10.0 100.0% 0 2.77s 672 82 803
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 5.79s 801 410 2,128
MiMo-V2.5-Pro 6.7 7.9 55.6% 1 5.31s 660 540 2,181
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 9.01s 6,096 450 1,256
MiMo-V2.5-Pro 10.0 10.0 100.0% 0 16.87s 8,220 311 2,908
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.0 10.0 0.0% 0 180.87s 191 797 16,905
MiMo-V2.5-Pro 3.0 10.0 0.0% 0 12.46s 210 1,941 2,014

Quick Compare

Switch Comparison Pair

Gemini 3 Flash PreviewnonevsMiMo-V2.5-PromediumGemma 4 26B A4BmediumFree AvailablevsQwen3.7 MaxnoneGemini 3.1 Flash Lite PreviewlowvsMiMo-V2.5-PromediumDeepSeek V4 FlashhighvsGemma 4 26B A4BmediumFree AvailableQwen3.7 MaxnonevsMiMo-V2.5-PromediumStep 3.7 FlashlowvsMiMo-V2.5-PromediumGemini 3.5 FlashminimalvsMiMo-V2.5-PromediumGemini 3.1 Flash Lite PreviewnonevsMiMo-V2.5-PromediumGemini 3.1 Flash LitelowvsMiMo-V2.5-PromediumDeepSeek V4 FlashhighvsMiMo-V2.5-PromediumGPT-5.3 ChatnonevsMiMo-V2.5-PromediumGemma 4 26B A4BmediumFree AvailablevsStep 3.7 Flashlow