Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

IBM: Granite 4.1 8B vs Z.ai: GLM 5 Turbo

Summary

Granite 4.1 8B vs GLM 5 Turbo benchmark comparison: GLM 5 Turbo leads on average score with 5.3 vs 4.0. Granite 4.1 8B has the lower benchmark cost at $0.003 vs $0.047. Granite 4.1 8B is faster at 728ms vs 2.82s, with pass rates of 9.5% vs 31.8%.

Recommended model: Granite 4.1 8B - It offers the best overall trade-off: a competitive score (4.0), lower cost than GLM 5 Turbo, and balanced response time.

Last updated at: 2026-06-12

Metric Granite 4.1 8B Granite 4.1 8B none Release: 2026-05-01 GLM 5 Turbo GLM 5 Turbo none Release: 2026-03-15
Score 4.0 5.3
Rank #163 #128
Reliability 10.0 10.0
Consistency 10.0 9.3
Tests Correct
Attempt pass rate 9.5% 31.8%
Flaky tests 0 2
Total Runs 63 63
Cost per result 0.131 0.655
Total Cost $0.003 $0.047
Input Price $0.050 / 1M $1.200 / 1M
Output Price $0.100 / 1M $4.000 / 1M
Total Input Tokens 46,285 32,525
Output Tokens 2,911 1,815
Reasoning Tokens 0 0
Response Time (avg) 728ms 2.82s
Response Time (max) 2.17s 8.21s
Response Time (total) 15.29s 59.29s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#163 IBM: Granite 4.1 8B

none
Cost
$0.001
Time
3.2s
Tokens
491 tok

#128 GLM 5 Turbo

none
Cost
$0.047
Time
129.2s
Tokens
11,775 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.1 8B 4.9 10.0 25.0% 0 844ms 645 903 0
GLM 5 Turbo 3.0 10.0 0.0% 0 2.84s 555 382 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.1 8B 4.5 10.0 0.0% 0 775ms 8,344 525 0
GLM 5 Turbo 3.9 7.8 11.1% 1 2.41s 7,256 529 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.1 8B 3.0 10.0 0.0% 0 1.88s 19,089 396 0
GLM 5 Turbo 3.0 10.0 0.0% 0 4.89s 8,133 144 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.1 8B 3.0 10.0 0.0% 0 575ms 7,617 195 0
GLM 5 Turbo 10.0 10.0 100.0% 0 2.47s 7,107 204 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.1 8B 3.0 10.0 0.0% 0 357ms 768 24 0
GLM 5 Turbo 5.3 10.0 33.3% 0 1.97s 687 25 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.1 8B 4.0 10.0 0.0% 0 499ms 528 115 0
GLM 5 Turbo 4.2 9.9 0.0% 0 2.18s 477 48 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.1 8B 3.6 9.9 0.0% 0 344ms 687 66 0
GLM 5 Turbo 6.5 10.0 50.0% 0 2.13s 636 65 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.1 8B 3.2 10.0 0.0% 0 608ms 672 432 0
GLM 5 Turbo 5.5 7.4 44.4% 1 2.65s 609 180 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.1 8B 10.0 10.0 100.0% 0 2.17s 7,719 243 0
GLM 5 Turbo 10.0 10.0 100.0% 0 8.21s 6,879 222 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.1 8B 3.0 10.0 0.0% 0 306ms 216 12 0
GLM 5 Turbo 3.0 10.0 0.0% 0 2.37s 186 16 0

Quick Compare

Switch Comparison Pair

MiniMax M2.7mediumvsGLM 5 TurbononeGranite 4.1 8BnonevsQwen3.5-9BmediumMistral Small 4mediumvsGLM 5 TurbononeGranite 4.1 8BnonevsGLM 4.7 FlashmediumCobuddymediumvsGLM 5 TurbononeMiniMax M2.5mediumvsGLM 5 TurbononeQwen3 Coder NextmediumvsGLM 5 TurbononeGranite 4.1 8BnonevsQwen3 Coder NextmediumGranite 4.1 8BnonevsMiniMax M2.5mediumGemini 3.1 Flash LiteminimalvsGLM 5 TurbononeCobuddymediumvsGranite 4.1 8BnoneDeepSeek V4 ProhighvsGLM 5 Turbonone