Navigate
AI BENCHY
Advertise here

Granite 4.2 8B (low) vs MiniMax M2.7 (medium)

Granite 4.2 8B (low) leads on average score with 5.1 vs 5.0. Granite 4.2 8B (low) has the lower benchmark cost at $0.012 vs $0.208. MiniMax M2.7 (medium) is faster at 43.25s vs 54.36s, with pass rates of 31.8% vs 45.5%.

Last updated at: 2026-09-02

Rank
#247
Total Output Tokens
27,928
Response Time (avg)
54.36s
Total Cost
$0.012
Rank
#253
Total Output Tokens
147,704
Response Time (avg)
43.25s
Total Cost
$0.208
Recommended model Granite 4.2 8B (low)

It has the best score here (5.1), while costing about 17.8x less than MiniMax M2.7 (medium).

Detailed comparison

Metric Granite 4.2 8B Granite 4.2 8B low Release: 2026-09-02 MiniMax M2.7 MiniMax M2.7 medium Release: 2026-03-18
Score 5.1 5.0
Rank #247 #253
Reliability 9.0 10.0
Consistency 10.0 6.6
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 31.8% 45.5%
Flaky tests 0 9
Total Runs 66 66
Cost per result 0.167 4.149
Total Cost $0.012 $0.208
Input Price $0.100 / 1M $0.300 / 1M
Output Price $0.150 / 1M $1.200 / 1M
Total Input Tokens 74,721 114,527
Output Tokens 9,205 18,558
Reasoning Tokens 18,723 129,146
Response Time (avg) 54.36s 43.25s
Response Time (max) 566.80s 196.21s
Response Time (total) 1195.97s 908.21s
Parameters 8B 230B total (10B active)
Availability Open source Weights available

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#247 IBM: Granite 4.2 8B

low
Provider returned error
Cost
$0.000
Time
0.2s
Tokens
0 tok

#253 MiniMax M2.7

medium
Cost
$0.022
Time
22.8s
Tokens
9,250 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.2 8B 5.5 10.0 33.3% 0 13.01s 8,439 2,469 2,984
MiniMax M2.7 5.7 9.1 33.3% 0 101.89s 2,961 1,231 38,841

Quick Compare

Switch Comparison Pair