Navigate
AI BENCHY
Advertise here

Granite 4.2 8B (low) vs Qwen3 Coder Next

The average score is effectively tied at 5.1 vs 5.1. Granite 4.2 8B (low) has the lower benchmark cost at $0.012 vs $0.026. Qwen3 Coder Next is faster at 8.63s vs 54.36s, with pass rates of 31.8% vs 25.8%.

Last updated at: 2026-09-02

Rank
#247
Total Output Tokens
27,928
Response Time (avg)
54.36s
Total Cost
$0.012
Rank
#248
Total Output Tokens
11,808
Response Time (avg)
8.63s
Total Cost
$0.026
Recommended model Qwen3 Coder Next

It has the best score here (5.1), while responding about 6.3x faster than Granite 4.2 8B (low).

Detailed comparison

Metric Granite 4.2 8B Granite 4.2 8B low Release: 2026-09-02 Qwen3 Coder Next Qwen3 Coder Next none Release: 2026-02-03
Score 5.1 5.1
Rank #247 #248
Reliability 9.0 10.0
Consistency 10.0 9.7
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 31.8% 25.8%
Flaky tests 0 1
Total Runs 66 66
Cost per result 0.167 0.488
Total Cost $0.012 $0.026
Input Price $0.100 / 1M $0.120 / 1M
Output Price $0.150 / 1M $0.800 / 1M
Total Input Tokens 74,721 134,227
Output Tokens 9,205 11,808
Reasoning Tokens 18,723 0
Response Time (avg) 54.36s 8.63s
Response Time (max) 566.80s 45.14s
Response Time (total) 1195.97s 146.72s
Parameters 8B 80B total (3B active)
Availability Open source Open source

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#247 IBM: Granite 4.2 8B

low
Provider returned error
Cost
$0.000
Time
0.2s
Tokens
0 tok

#248 Qwen3 Coder Next

none
Invalid SVG
Cost
$0.058
Time
246.3s
Tokens
64,126 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.2 8B 5.5 10.0 33.3% 0 13.01s 8,439 2,469 2,984
Qwen3 Coder Next 4.6 7.9 22.2% 1 2.22s 7,442 621 0

Quick Compare

Switch Comparison Pair