Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

IBM: Granite 4.1 8B vs Z.ai: GLM 4.7 Flash

Last updated at: 2026-05-01

Metric Granite 4.1 8B Granite 4.1 8B none Release: 2026-05-01 GLM 4.7 Flash GLM 4.7 Flash medium Release: 2026-01-19
Score 4.3 4.6
Rank #135 #128
Reliability 10.0 N/A
Consistency 10.0 6.3
Tests Correct
Attempt pass rate 11.1% 38.9%
Flaky tests 0 8
Total Runs 54 54
Cost per result 0.110 1.126
Total Cost $0.003 $0.046
Input Price $0.050 / 1M $0.060 / 1M
Output Price $0.100 / 1M $0.400 / 1M
Output Tokens 2,712 39,688
Reasoning Tokens 0 72,401
Response Time (avg) 767ms 32.33s
Response Time (max) 2.17s 174.55s
Response Time (total) 13.81s 355.65s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 4.9 10.0 25.0% 0 844ms 903 0
GLM 4.7 Flash 4.7 5.9 41.7% 2 14.95s 1,122 6,110
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 6.9 10.0 0.0% 0 1.07s 339 0
GLM 4.7 Flash 3.6 2.1 33.3% 1 21.26s 969 6,936
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 3.0 10.0 0.0% 0 1.88s 396 0
GLM 4.7 Flash 2.8 2.1 33.3% 1 65.57s 2,585 20,648
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 3.0 10.0 0.0% 0 575ms 195 0
GLM 4.7 Flash 6.3 10.0 50.0% 0 1.51s 584 2,755
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 3.0 10.0 0.0% 0 357ms 24 0
GLM 4.7 Flash 3.5 4.4 33.3% 2 174.55s 33,000 25,394
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 4.0 10.0 0.0% 0 499ms 115 0
GLM 4.7 Flash 3.6 9.7 0.0% 0 18.14s 18 2,138
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 3.6 9.9 0.0% 0 344ms 66 0
GLM 4.7 Flash 6.2 5.8 66.7% 1 2.97s 388 2,181
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 3.7 10.0 0.0% 0 635ms 431 0
GLM 4.7 Flash 2.9 7.2 11.1% 1 12.90s 798 5,225
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 10.0 10.0 100.0% 0 2.17s 243 0
GLM 4.7 Flash 10.0 10.0 100.0% 0 15.95s 224 1,014

Quick Compare

Switch Comparison Pair

GPT-5.4 NanononevsGLM 4.7 FlashmediumMiMo-V2-FlashnonevsGLM 4.7 FlashmediumGrok 4.1 FastnonevsGLM 4.7 FlashmediumHY3 PreviewnoneFree AvailablevsGLM 4.7 FlashmediumGranite 4.1 8BnonevsQwen3.5-9BmediumLing 2.6 1tnoneFree AvailablevsGLM 4.7 FlashmediumMercury 2nonevsGLM 4.7 FlashmediumQwen3.5-9BnonevsGLM 4.7 FlashmediumNemotron 3 Nano Omni 30b A3b ReasoningnoneFree AvailablevsGLM 4.7 FlashmediumLaguna Xs.2noneFree AvailablevsGLM 4.7 FlashmediumLaguna M.1noneFree AvailablevsGLM 4.7 FlashmediumGPT-4o-mininonevsGLM 4.7 Flashmedium