Navigate
AI BENCHY
Advertise here

Granite 4.2 8B vs MiniMax M2.5 (medium)

MiniMax M2.5 (medium) leads on average score with 4.6 vs 4.3. Granite 4.2 8B has the lower benchmark cost at $0.026 vs $0.327. MiniMax M2.5 (medium) is faster at 69.08s vs 86.27s, with pass rates of 16.7% vs 43.9%.

Last updated at: 2026-09-02

Rank
#285
Total Output Tokens
130,805
Response Time (avg)
86.27s
Total Cost
$0.026
Rank
#278
Total Output Tokens
272,229
Response Time (avg)
69.08s
Total Cost
$0.327
Recommended model Granite 4.2 8B

Its score stays close to the best score here (4.3 vs 4.6), while costing about 12.9x less than MiniMax M2.5 (medium).

Detailed comparison

Metric Granite 4.2 8B Granite 4.2 8B none Release: 2026-09-02 MiniMax M2.5 MiniMax M2.5 medium Release: 2026-02-12
Score 4.3 4.6
Rank #285 #278
Reliability 8.6 10.0
Consistency 9.3 6.6
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 16.7% 43.9%
Flaky tests 2 9
Total Runs 66 66
Cost per result 0.847 6.463
Total Cost $0.026 $0.327
Input Price $0.100 / 1M $0.270 / 1M
Output Price $0.150 / 1M $1.080 / 1M
Total Input Tokens 57,786 142,621
Output Tokens 130,805 20,409
Reasoning Tokens 0 251,820
Response Time (avg) 86.27s 69.08s
Response Time (max) 747.17s 251.36s
Response Time (total) 1897.96s 1036.24s
Parameters 8B 230B total (10B active)
Availability Open source Weights available

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#285 IBM: Granite 4.2 8B

none
Provider returned error
Cost
$0.000
Time
0.2s
Tokens
0 tok

#278 MiniMax M2.5

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.2 8B 5.5 10.0 33.3% 0 105.60s 8,358 47,944 0
MiniMax M2.5 3.4 9.1 0.0% 0 188.58s 6,076 357 106,177

Quick Compare

Switch Comparison Pair