Navigate
AI BENCHY
Advertise here

Granite 4.2 8B (low) vs GPT-4o-mini

Granite 4.2 8B (low) leads on average score with 5.1 vs 5.0. GPT-4o-mini has the lower benchmark cost at $0.010 vs $0.012. GPT-4o-mini is faster at 1.92s vs 54.36s, with pass rates of 31.8% vs 22.7%.

Last updated at: 2026-09-02

Rank
#247
Total Output Tokens
27,928
Response Time (avg)
54.36s
Total Cost
$0.012
Rank
#257
Total Output Tokens
2,913
Response Time (avg)
1.92s
Total Cost
$0.010
Recommended model GPT-4o-mini

Its score stays close to the best score here (5.0 vs 5.1), while responding about 28.3x faster than Granite 4.2 8B (low).

Detailed comparison

Metric Granite 4.2 8B Granite 4.2 8B low Release: 2026-09-02 GPT-4o-mini GPT-4o-mini none Release: 2024-07-18
Score 5.1 5.0
Rank #247 #257
Reliability 9.0 10.0
Consistency 10.0 9.9
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 31.8% 22.7%
Flaky tests 0 0
Total Runs 66 66
Cost per result 0.167 0.195
Total Cost $0.012 $0.010
Input Price $0.100 / 1M $0.150 / 1M
Output Price $0.150 / 1M $0.600 / 1M
Total Input Tokens 74,721 53,145
Output Tokens 9,205 2,913
Reasoning Tokens 18,723 0
Response Time (avg) 54.36s 1.92s
Response Time (max) 566.80s 7.58s
Response Time (total) 1195.97s 30.71s
Parameters 8B ~8B
Availability Open source Closed

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#247 IBM: Granite 4.2 8B

low
Provider returned error
Cost
$0.000
Time
0.2s
Tokens
0 tok

#257 GPT-4o-mini

none
Cost
$0.001
Time
6.6s
Tokens
742 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.2 8B 5.5 10.0 33.3% 0 13.01s 8,439 2,469 2,984
GPT-4o-mini 3.2 9.6 0.0% 0 1.63s 7,314 367 0

Quick Compare

Switch Comparison Pair

Granite 4.2 8BlowvsMistral Small 4mediumGranite 4.2 8BlowvsMistral Small 4noneGranite 4.2 8BlowvsNemotron 3.5 LightningmediumFree AvailableGranite 4.2 8BlowvsQwen3 Coder NextnoneGranite 4.2 8BlowvsMiMo-V2.5noneGPT-4o-mininonevsLaguna S 2.1lowFree AvailableGranite 4.2 8BlowvsQwen3.5-9BnoneNorth Mini CodenoneFree AvailablevsGranite 4.2 8BlowMercury 2.5 PreviewlowvsGPT-4o-mininoneGranite 4.2 8BlowvsInklingnoneDots 3 Note PreviewnoneFree AvailablevsGranite 4.2 8BlowMiniMax M2.7mediumvsGPT-4o-mininone