Navigate
AI BENCHY
Advertise here

Granite 4.2 8B (high) vs GLM 4.7 Flash (medium)

Granite 4.2 8B (high) leads on average score with 4.6 vs 4.3. Granite 4.2 8B (high) has the lower benchmark cost at $0.084 vs $0.168. GLM 4.7 Flash (medium) is faster at 134.34s vs 235.89s, with pass rates of 39.4% vs 31.8%.

Last updated at: 2026-09-02

Rank
#276
Total Output Tokens
612,215
Response Time (avg)
235.89s
Total Cost
$0.084
Rank
#283
Total Output Tokens
419,534
Response Time (avg)
134.34s
Total Cost
$0.168
Recommended model Granite 4.2 8B (high)

It has the best score here (4.6), while costing about 2.0x less than GLM 4.7 Flash (medium).

Detailed comparison

Metric Granite 4.2 8B Granite 4.2 8B high Release: 2026-09-02 GLM 4.7 Flash GLM 4.7 Flash medium Release: 2026-01-19
Score 4.6 4.3
Rank #276 #283
Reliability 7.6 8.6
Consistency 6.3 7.0
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 39.4% 31.8%
Flaky tests 10 8
Total Runs 66 66
Cost per result 2.085 4.180
Total Cost $0.084 $0.168
Input Price $0.100 / 1M $0.060 / 1M
Output Price $0.150 / 1M $0.400 / 1M
Total Input Tokens 43,278 79,104
Output Tokens 181,083 42,254
Reasoning Tokens 431,132 377,280
Response Time (avg) 235.89s 134.34s
Response Time (max) 685.87s 1539.97s
Response Time (total) 5189.64s 2015.13s
Parameters 8B 30B total (3B active)
Availability Open source Open source

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#276 IBM: Granite 4.2 8B

high
Provider returned error
Cost
$0.000
Time
0.2s
Tokens
0 tok

#283 GLM 4.7 Flash

medium
Invalid SVG
Cost
$0.000
Time
186.2s
Tokens
12,112 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.2 8B 3.8 4.3 33.3% 2 515.34s 7,047 42,438 154,749
GLM 4.7 Flash 3.2 7.4 11.1% 1 55.33s 3,106 4,981 22,387

Quick Compare

Switch Comparison Pair