Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

IBM: Granite 4.1 8B vs Qwen: Qwen3.5-122B-A10B

Summary

Granite 4.1 8B vs Qwen3.5-122B-A10B benchmark comparison: Qwen3.5-122B-A10B leads on average score with 5.3 vs 4.0. Granite 4.1 8B has the lower benchmark cost at $0.003 vs $0.020. Granite 4.1 8B is faster at 728ms vs 3.41s, with pass rates of 9.5% vs 31.8%.

Recommended model: Granite 4.1 8B - It offers the best overall trade-off: a competitive score (4.0), lower cost than Qwen3.5-122B-A10B, and balanced response time.

Last updated at: 2026-06-12

Metric Granite 4.1 8B Granite 4.1 8B none Release: 2026-05-01 Qwen3.5-122B-A10B Qwen3.5-122B-A10B none Release: 2026-02-24
Score 4.0 5.3
Rank #163 #132
Reliability 10.0 10.0
Consistency 10.0 9.6
Tests Correct
Attempt pass rate 9.5% 31.8%
Flaky tests 0 1
Total Runs 63 63
Cost per result 0.131 0.393
Total Cost $0.003 $0.020
Input Price $0.050 / 1M $0.260 / 1M
Output Price $0.100 / 1M $2.080 / 1M
Total Input Tokens 46,285 47,735
Output Tokens 2,911 3,383
Reasoning Tokens 0 0
Response Time (avg) 728ms 3.41s
Response Time (max) 2.17s 46.00s
Response Time (total) 15.29s 71.59s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#163 IBM: Granite 4.1 8B

none
Cost
$0.001
Time
3.2s
Tokens
491 tok

#132 Qwen3.5-122B-A10B

none
Cost
$0.016
Time
44.5s
Tokens
6,431 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.1 8B 4.9 10.0 25.0% 0 844ms 645 903 0
Qwen3.5-122B-A10B 4.8 10.0 25.0% 0 1.59s 696 312 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.1 8B 4.5 10.0 0.0% 0 775ms 8,344 525 0
Qwen3.5-122B-A10B 3.7 7.0 22.2% 1 2.77s 7,913 693 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.1 8B 3.0 10.0 0.0% 0 1.88s 19,089 396 0
Qwen3.5-122B-A10B 3.0 10.0 0.0% 0 46.00s 20,175 1,137 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.1 8B 3.0 10.0 0.0% 0 575ms 7,617 195 0
Qwen3.5-122B-A10B 10.0 10.0 100.0% 0 1.01s 7,794 243 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.1 8B 3.0 10.0 0.0% 0 357ms 768 24 0
Qwen3.5-122B-A10B 5.3 10.0 33.3% 0 465ms 789 15 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.1 8B 4.0 10.0 0.0% 0 499ms 528 115 0
Qwen3.5-122B-A10B 5.0 10.0 0.0% 0 1.12s 522 66 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.1 8B 3.6 9.9 0.0% 0 344ms 687 66 0
Qwen3.5-122B-A10B 6.3 10.0 50.0% 0 513ms 711 69 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.1 8B 3.2 10.0 0.0% 0 608ms 672 432 0
Qwen3.5-122B-A10B 3.8 10.0 0.0% 0 1.00s 714 575 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.1 8B 10.0 10.0 100.0% 0 2.17s 7,719 243 0
Qwen3.5-122B-A10B 10.0 10.0 100.0% 0 2.04s 8,211 264 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.1 8B 3.0 10.0 0.0% 0 306ms 216 12 0
Qwen3.5-122B-A10B 3.0 10.0 0.0% 0 295ms 210 9 0

Quick Compare

Switch Comparison Pair

MiniMax M2.7mediumvsQwen3.5-122B-A10BnoneMistral Small 4mediumvsQwen3.5-122B-A10BnoneGranite 4.1 8BnonevsQwen3.5-9BmediumGranite 4.1 8BnonevsGLM 4.7 FlashmediumCobuddymediumvsQwen3.5-122B-A10BnoneMiniMax M2.5mediumvsQwen3.5-122B-A10BnoneGranite 4.1 8BnonevsQwen3 Coder NextmediumGranite 4.1 8BnonevsMiniMax M2.5mediumGemini 3.1 Flash LiteminimalvsQwen3.5-122B-A10BnoneCobuddymediumvsGranite 4.1 8BnoneDeepSeek V4 ProhighvsQwen3.5-122B-A10BnoneQwen3.5-122B-A10BnonevsGLM 4.7 Flashmedium