#135

Granite 4.1 8B

IBM Granite Release: 2026-05-01 Tested on: 2026-05-01 00:31 ibm-granite/granite-4.1-8b::none

4.3

Consistency

10.0

10.0

$0.003

Total Output Tokens

2,712

Input Price

$0.050 / 1M

Output Price

$0.100 / 1M

Wrong Tests: 16

Attempt pass rate: 11.1%

Flaky tests

0

Flaky tests had mixed outcomes across runs (at least one pass and one fail).

Response Time (avg)

767ms

Response Time (max): 2.17s

Response Time (total): 13.81s

Wrong answer: 11 Did not follow instructions: 4 Invalid tool call: 1

Charts

Choose the first model, then click a second model to open a side-by-side page.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Quick Compare

Granite 4.1 8BnonevsGPT-5.4 Nanonone Granite 4.1 8BnonevsMiMo-V2-Flashnone Granite 4.1 8BnonevsHY3 PreviewnoneFree Available Granite 4.1 8BnonevsGrok 4.1 Fastnone Granite 4.1 8BnonevsMercury 2none Granite 4.1 8BnonevsLing 2.6 1tnoneFree Available Granite 4.1 8BnonevsGemini 3 Flash Previewmedium Granite 4.1 8BnonevsGemini 3.1 Pro Previewmedium Granite 4.1 8BnonevsHY3 PreviewhighFree Available

Category Breakdown

Category	Score	Consistency	Tests Correct
Anti-AI Tricks	4.9	10.0
Coding	6.9	10.0
Combined	3.0	10.0
Data parsing and extraction	3.0	10.0
Domain specific	3.0	10.0
General Intelligence	4.0	10.0
Instructions following	3.6	9.9
Puzzle Solving	3.7	10.0
Tool Calling	10.0	10.0

Compared models