Navigate
AI BENCHY
Advertise here

Granite 4.2 8B (medium) vs Qwen3.5-9B

Granite 4.2 8B (medium) leads on average score with 5.2 vs 5.1. Granite 4.2 8B (medium) has the lower benchmark cost at $0.009 vs $0.021. Qwen3.5-9B is faster at 19.19s vs 45.97s, with pass rates of 34.9% vs 19.7%.

Last updated at: 2026-09-02

Rank
#243
Total Output Tokens
19,330
Response Time (avg)
45.97s
Total Cost
$0.009
Rank
#250
Total Output Tokens
37,484
Response Time (avg)
19.19s
Total Cost
$0.021
Recommended model Qwen3.5-9B

Its score stays close to the best score here (5.1 vs 5.2), while responding about 2.4x faster than Granite 4.2 8B (medium).

Detailed comparison

Metric Granite 4.2 8B Granite 4.2 8B medium Release: 2026-09-02 Qwen3.5-9B Qwen3.5-9B none Release: 2026-03-02
Score 5.2 5.1
Rank #243 #250
Reliability 8.7 10.0
Consistency 9.6 9.7
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 34.9% 19.7%
Flaky tests 1 1
Total Runs 66 66
Cost per result 0.117 0.490
Total Cost $0.009 $0.021
Input Price $0.100 / 1M $0.100 / 1M
Output Price $0.150 / 1M $0.150 / 1M
Total Input Tokens 52,909 144,416
Output Tokens 7,058 37,484
Reasoning Tokens 12,272 0
Response Time (avg) 45.97s 19.19s
Response Time (max) 557.96s 382.06s
Response Time (total) 1011.42s 422.25s
Parameters 8B 9B
Availability Open source Open source

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#243 IBM: Granite 4.2 8B

medium
Provider returned error
Cost
$0.000
Time
0.2s
Tokens
0 tok

#250 Qwen3.5-9B

none
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.2 8B 5.5 10.0 33.3% 0 12.09s 8,439 2,445 3,900
Qwen3.5-9B 3.9 7.8 11.1% 1 5.60s 7,913 1,042 0

Quick Compare

Switch Comparison Pair

Granite 4.2 8BmediumvsInklingnoneDots 3 Note PreviewnoneFree AvailablevsGranite 4.2 8BmediumGranite 4.2 8BmediumvsMistral Small 4noneGranite 4.2 8BlowvsQwen3.5-9BnoneMistral Small 4mediumvsQwen3.5-9BnoneNemotron 3.5 LightningmediumFree AvailablevsQwen3.5-9BnoneMiniMax M2.7mediumvsQwen3.5-9BnoneGranite 4.2 8BmediumvsQwen3 Coder NextnoneMercury 2.5 PreviewlowvsQwen3.5-9BnoneGranite 4.2 8BmediumvsQwen3.6 35B A3BnoneLaguna S 2.1lowFree AvailablevsQwen3.5-9BnoneGranite 4.2 8BmediumvsMiMo-V2.5none