Granite 4.2 8B (low) vs GPT-5.6 Luna

Compared models

Recommended model GPT-5.6 Luna

It has the best score here (5.3), while responding about 15.4x faster than Granite 4.2 8B (low).

Metric	Granite 4.2 8B Granite 4.2 8B low Release: 2026-09-02	GPT-5.6 Luna GPT-5.6 Luna none Release: 2026-07-09

Metric	Granite 4.2 8B Granite 4.2 8B low Release: 2026-09-02	GPT-5.6 Luna GPT-5.6 Luna none Release: 2026-07-09
Score	5.3	5.3
Rank	#280	#279
Reliability	9.2	10.0
Consistency	9.7	8.8
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	33.3%	34.8%
Flaky tests	1	3
Total Runs	69	69
Cost per result	0.508	2.814
Total Cost	$0.036	$0.056
Input Price	$0.060 / 1M	$0.200 / 1M
Output Price	$0.250 / 1M	$1.200 / 1M
Total Input Tokens	332,917	230,744
Output Tokens	18,989	8,000
Reasoning Tokens	42,362	0
Response Time (avg)	58.20s	3.78s
Response Time (max)	566.80s	53.77s
Response Time (total)	1338.65s	86.83s
Parameters	8B	~400B total (~17B active)
Availability	Open source	Closed

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

low

Provider returned error

none

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	6.1	3.1	66.7%	1		142.68s	258,196	9,784	23,639
GPT-5.6 Luna	5.0	10.0	0.0%	0		53.77s	129,412	1,291	0

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	8.3	10.0	75.0%	0		11.68s	777	1,463	898
GPT-5.6 Luna	4.8	10.0	25.0%	0		901ms	606	266	0

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	5.5	10.0	33.3%	0		13.01s	8,439	2,469	2,984
GPT-5.6 Luna	3.8	7.2	22.2%	1		980ms	7,302	459	0

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	3.0	10.0	0.0%	0		298.21s	46,805	4,085	13,637
GPT-5.6 Luna	3.2	9.1	0.0%	0		6.68s	78,124	5,022	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	6.5	10.0	50.0%	0		1.39s	7,683	270	75
GPT-5.6 Luna	10.0	10.0	100.0%	0		758ms	7,140	222	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	5.3	10.0	33.3%	0		26.16s	876	154	290
GPT-5.6 Luna	3.6	7.2	22.2%	1		784ms	732	54	0

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	4.0	10.0	0.0%	0		659ms	561	108	24
GPT-5.6 Luna	5.0	10.0	0.0%	0		1.00s	477	150	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	3.0	10.0	0.0%	0		75.80s	402	84	378
GPT-5.6 Luna	7.1	5.8	83.3%	1		1.23s	660	86	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	3.0	10.0	0.0%	0		90.84s	517	181	82
GPT-5.6 Luna	5.3	10.0	33.3%	0		790ms	642	202	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	10.0	10.0	100.0%	0		2.23s	8,412	358	265
GPT-5.6 Luna	10.0	10.0	100.0%	0		2.80s	5,454	222	0

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	3.0	10.0	0.0%	0		5.53s	249	33	90
GPT-5.6 Luna	3.0	10.0	0.0%	0		651ms	195	26	0

Switch Comparison Pair