Navigate
Advertise here

Granite 4.2 8B (low) vs GPT-6 Luna

GPT-6 Luna leads on average score with 5.5 vs 5.3. GPT-6 Luna has the lower benchmark cost at $0.026 vs $0.036. GPT-6 Luna is faster at 20.48s vs 58.20s, with pass rates of 33.3% vs 40.6%.

Last updated at: 2026-10-03

Compared models

Rank
#287
Total Output Tokens
61,351
Response Time (avg)
58.20s
Total Cost
$0.036
Rank
#274
Total Output Tokens
6,855
Response Time (avg)
20.48s
Total Cost
$0.026
Recommended model GPT-6 Luna

It has the best score here (5.5), while responding about 2.8x faster than Granite 4.2 8B (low).

Detailed comparison

Metric Granite 4.2 8B Granite 4.2 8B low Release: 2026-09-02 GPT-6 Luna GPT-6 Luna none Release: 2026-09-23
Score 5.3 5.5
Rank #287 #274
Reliability 9.2 9.9
Consistency 9.7 8.2
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 33.3% 40.6%
Flaky tests 1 5
Total Runs 69 69
Cost per result 0.508 0.367
Total Cost $0.036 $0.026
Input Price $0.060 / 1M $0.100 / 1M
Output Price $0.250 / 1M $0.500 / 1M
Cache Read Price $0.015 / 1M $0.010 / 1M
Cache Write Price N/A $0.125 / 1M
Total Input Tokens 332,917 222,357
Output Tokens 18,989 6,855
Reasoning Tokens 42,362 0
Response Time (avg) 58.20s 20.48s
Response Time (max) 566.80s 98.62s
Response Time (total) 1338.65s 470.96s
Parameters 8B ~400B total (~17B active)
Availability Open source Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#287 IBM: Granite 4.2 8B

low
Provider returned error
Cost
$0.000
Time
0.2s
Tokens
0 tok

#274 GPT-6 Luna

none
Cost
$0.002
Time
26.0s
Tokens
3,235 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.2 8B 5.5 10.0 33.3% 0 13.01s 8,439 2,469 2,984
GPT-6 Luna 5.5 10.0 33.3% 0 8.04s 7,302 376 0

Quick Compare

Switch Comparison Pair