Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

IBM: Granite 4.1 8B vs MiniMax: MiniMax M2.5

Last updated at: 2026-05-01

Metric Granite 4.1 8B Granite 4.1 8B none Release: 2026-05-01 MiniMax M2.5 MiniMax M2.5 medium Release: 2026-02-12 Free Available
Score 4.3 5.6
Rank #135 #100
Reliability 10.0 N/A
Consistency 10.0 5.6
Tests Correct
Attempt pass rate 11.1% 55.6%
Flaky tests 0 10
Total Runs 54 54
Cost per result 0.110 4.987
Total Cost $0.003 $0.250
Input Price $0.050 / 1M $0.150 / 1M
Output Price $0.100 / 1M $1.150 / 1M
Output Tokens 2,712 107,044
Reasoning Tokens 0 206,422
Response Time (avg) 767ms 39.65s
Response Time (max) 2.17s 237.27s
Response Time (total) 13.81s 396.47s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 4.9 10.0 25.0% 0 844ms 903 0
MiniMax M2.5 7.9 6.3 83.3% 2 20.82s 286 45,344
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 6.9 10.0 0.0% 0 1.07s 339 0
MiniMax M2.5 3.0 10.0 0.0% 0 0ms 0 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 3.0 10.0 0.0% 0 1.88s 396 0
MiniMax M2.5 4.5 2.1 66.7% 1 60.39s 740 9,713
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 3.0 10.0 0.0% 0 575ms 195 0
MiniMax M2.5 4.6 1.7 66.7% 2 7.48s 266 3,835
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 3.0 10.0 0.0% 0 357ms 24 0
MiniMax M2.5 2.9 4.4 22.2% 2 237.27s 105,047 133,487
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 4.0 10.0 0.0% 0 499ms 115 0
MiniMax M2.5 3.8 2.5 33.3% 1 6.63s 25 1,686
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 3.6 9.9 0.0% 0 344ms 66 0
MiniMax M2.5 7.5 6.7 66.7% 1 4.64s 252 1,873
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 3.7 10.0 0.0% 0 635ms 431 0
MiniMax M2.5 5.3 7.2 44.4% 1 11.54s 159 9,547
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 10.0 10.0 100.0% 0 2.17s 243 0
MiniMax M2.5 10.0 10.0 100.0% 0 15.35s 269 937

Quick Compare

Switch Comparison Pair

MiniMax M2.5mediumFree AvailablevsGLM 4.7 FlashnoneMiniMax M2.5mediumFree AvailablevsKimi K2.5noneGranite 4.1 8BnonevsQwen3.5-9BmediumMiniMax M2.5mediumFree AvailablevsGLM 5 TurbononeMiniMax M2.5mediumFree AvailablevsGLM 5.1noneMiniMax M2.5mediumFree AvailablevsQwen3.6 FlashnoneMiniMax M2.5mediumFree AvailablevsMiMo-V2.5-PrononeMiniMax M2.5mediumFree AvailablevsQwen3.5 Plus 2026-04-20noneMiniMax M2.5mediumFree AvailablevsKimi K2.6noneMiniMax M2.5mediumFree AvailablevsGrok 4.20noneMiniMax M2.5mediumFree AvailablevsGPT-5.4noneMiniMax M2.5mediumFree AvailablevsQwen3.5-122B-A10Bnone