Navigate
AI BENCHY
Advertise here

Granite 4.2 8B (medium) vs Qwen3.6 35B A3B

Qwen3.6 35B A3B leads on average score with 5.3 vs 5.2. Granite 4.2 8B (medium) has the lower benchmark cost at $0.009 vs $0.051. Qwen3.6 35B A3B is faster at 5.57s vs 45.97s, with pass rates of 34.9% vs 28.8%.

Last updated at: 2026-09-02

Rank
#243
Total Output Tokens
19,330
Response Time (avg)
45.97s
Total Cost
$0.009
Rank
#240
Total Output Tokens
45,905
Response Time (avg)
5.57s
Total Cost
$0.051
Recommended model Qwen3.6 35B A3B

It has the best score here (5.3), while responding about 8.3x faster than Granite 4.2 8B (medium).

Detailed comparison

Metric Granite 4.2 8B Granite 4.2 8B medium Release: 2026-09-02 Qwen3.6 35B A3B Qwen3.6 35B A3B none Release: 2026-04-20
Score 5.2 5.3
Rank #243 #240
Reliability 8.7 10.0
Consistency 9.6 8.1
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 34.9% 28.8%
Flaky tests 1 5
Total Runs 66 66
Cost per result 0.117 1.470
Total Cost $0.009 $0.051
Input Price $0.100 / 1M $0.100 / 1M
Output Price $0.150 / 1M $0.900 / 1M
Total Input Tokens 52,909 93,990
Output Tokens 7,058 45,905
Reasoning Tokens 12,272 0
Response Time (avg) 45.97s 5.57s
Response Time (max) 557.96s 39.54s
Response Time (total) 1011.42s 111.32s
Parameters 8B 35B total (3B active)
Availability Open source Open source

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#243 IBM: Granite 4.2 8B

medium
Provider returned error
Cost
$0.000
Time
0.2s
Tokens
0 tok

#240 Qwen3.6 35B A3B

none
Cost
$0.008
Time
30.1s
Tokens
6,317 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.2 8B 5.5 10.0 33.3% 0 12.09s 8,439 2,445 3,900
Qwen3.6 35B A3B 5.5 10.0 33.3% 0 8.77s 7,911 11,161 0

Quick Compare

Switch Comparison Pair

Granite 4.2 8BmediumvsInklingnoneDots 3 Note PreviewnoneFree AvailablevsGranite 4.2 8BmediumGranite 4.2 8BmediumvsMistral Small 4noneGranite 4.2 8BmediumvsQwen3 Coder NextnoneLaguna S 2.1highFree AvailablevsQwen3.6 35B A3BnoneGranite 4.2 8BmediumvsMiMo-V2.5noneGranite 4.2 8BmediumvsLing-2.6-1TnoneGranite 4.2 8BmediumvsQwen3.5-9BnoneSeed-2.0-CodenonevsGranite 4.2 8BmediumKAT-Coder-Air V2.5lowvsQwen3.6 35B A3BnoneNorth Mini CodenoneFree AvailablevsGranite 4.2 8BmediumLaguna S 2.1mediumFree AvailablevsQwen3.6 35B A3Bnone