Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Granite 4.2 8B (high) vs MiniMax M2.5 (medium)

The average score is effectively tied at 4.6 vs 4.6. Granite 4.2 8B (high) has the lower benchmark cost at $0.084 vs $0.327. MiniMax M2.5 (medium) is faster at 69.08s vs 235.89s, with pass rates of 39.4% vs 43.9%.

Last updated at: 2026-09-02

Rank
#276
Total Output Tokens
612,215
Response Time (avg)
235.89s
Total Cost
$0.084
Rank
#278
Total Output Tokens
272,229
Response Time (avg)
69.08s
Total Cost
$0.327
Recommended model Granite 4.2 8B (high)

It has the best score here (4.6), while costing about 3.9x less than MiniMax M2.5 (medium).

Detailed comparison

Metric Granite 4.2 8B Granite 4.2 8B high Release: 2026-09-02 MiniMax M2.5 MiniMax M2.5 medium Release: 2026-02-12
Score 4.6 4.6
Rank #276 #278
Reliability 7.6 10.0
Consistency 6.3 6.6
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 39.4% 43.9%
Flaky tests 10 9
Total Runs 66 66
Cost per result 2.085 6.463
Total Cost $0.084 $0.327
Input Price $0.100 / 1M $0.270 / 1M
Output Price $0.150 / 1M $1.080 / 1M
Total Input Tokens 43,278 142,621
Output Tokens 181,083 20,409
Reasoning Tokens 431,132 251,820
Response Time (avg) 235.89s 69.08s
Response Time (max) 685.87s 251.36s
Response Time (total) 5189.64s 1036.24s
Parameters 8B 230B total (10B active)
Availability Open source Weights available

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#276 IBM: Granite 4.2 8B

high
Provider returned error
Cost
$0.000
Time
0.2s
Tokens
0 tok

#278 MiniMax M2.5

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.2 8B 3.8 4.3 33.3% 2 515.34s 7,047 42,438 154,749
MiniMax M2.5 3.4 9.1 0.0% 0 188.58s 6,076 357 106,177

Quick Compare

Switch Comparison Pair