North Mini Code (medium) vs Granite 4.2 8B (low)

Compared models

Recommended model Granite 4.2 8B (low)

Its score stays close to the best score here (5.3 vs 5.4), while responding about 2.4x faster than North Mini Code (medium).

Metric	North Mini Code North Mini Code medium Release: 2026-06-18 Free Available	Granite 4.2 8B Granite 4.2 8B low Release: 2026-09-02

Metric	North Mini Code North Mini Code medium Release: 2026-06-18 Free Available	Granite 4.2 8B Granite 4.2 8B low Release: 2026-09-02
Score	5.4	5.3
Rank	#273	#280
Reliability	8.9	9.2
Consistency	8.6	9.7
Attempts	61/69	69/69
Tests Correct
Attempt pass rate	42.0%	33.3%
Flaky tests	4	1
Total Runs	61	69
Cost per result	0.000	0.508
Total Cost	$0.000	$0.036
Input Price	$0.000 / 1M	$0.060 / 1M
Output Price	$0.000 / 1M	$0.250 / 1M
Total Input Tokens	166,347	332,917
Output Tokens	423,884	18,989
Reasoning Tokens	1,394,387	42,362
Response Time (avg)	140.39s	58.20s
Response Time (max)	786.72s	566.80s
Response Time (total)	3229.07s	1338.65s
Parameters	30B total (3B active)	8B
Availability	Open source	Open source

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

medium

low

Provider returned error

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
North Mini Code	3.9	9.6	0.0%	0		105.20s	84,605	0	53,480
Granite 4.2 8B	6.1	3.1	66.7%	1		142.68s	258,196	9,784	23,639

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
North Mini Code	8.4	10.0	75.0%	0		64.79s	324	64,441	68,535
Granite 4.2 8B	8.3	10.0	75.0%	0		11.68s	777	1,463	898

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
North Mini Code	4.5	4.9	33.3%	2		320.43s	7,119	219,891	561,569
Granite 4.2 8B	5.5	10.0	33.3%	0		13.01s	8,439	2,469	2,984

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
North Mini Code	2.9	5.8	16.7%	1		554.89s	63,682	0	472,040
Granite 4.2 8B	3.0	10.0	0.0%	0		298.21s	46,805	4,085	13,637

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
North Mini Code	10.0	10.0	100.0%	0		24.06s	6,819	240	2,659
Granite 4.2 8B	6.5	10.0	50.0%	0		1.39s	7,683	270	75

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
North Mini Code	2.9	7.2	11.1%	1		107.19s	550	7,595	102,957
Granite 4.2 8B	5.3	10.0	33.3%	0		26.16s	876	154	290

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
North Mini Code	5.1	10.0	0.0%	0		25.08s	444	1,546	1,635
Granite 4.2 8B	4.0	10.0	0.0%	0		659ms	561	108	24

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
North Mini Code	9.8	10.0	100.0%	0		15.43s	379	909	1,339
Granite 4.2 8B	3.0	10.0	0.0%	0		75.80s	402	84	378

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
North Mini Code	3.3	10.0	0.0%	0		19.70s	543	2,215	2,485
Granite 4.2 8B	3.0	10.0	0.0%	0		90.84s	517	181	82

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
North Mini Code	10.0	10.0	100.0%	0		3.93s	1,776	41	563
Granite 4.2 8B	10.0	10.0	100.0%	0		2.23s	8,412	358	265

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
North Mini Code	3.0	10.0	0.0%	0		305.02s	106	127,006	127,125
Granite 4.2 8B	3.0	10.0	0.0%	0		5.53s	249	33	90

Switch Comparison Pair