Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

IBM: Granite 4.1 8B vs inclusionAI: Ring-2.6-1T

Last updated at: 2026-05-29

Metric Granite 4.1 8B Granite 4.1 8B none Release: 2026-05-01 Ring-2.6-1T Ring-2.6-1T medium Release: 2026-05-10
Score 4.1 7.2
Rank #158 #69
Reliability 10.0 10.0
Consistency 10.0 8.7
Tests Correct
Attempt pass rate 10.0% 66.7%
Flaky tests 0 3
Total Runs 60 60
Cost per result 0.122 0.000
Total Cost $0.003 $0.000
Input Price $0.050 / 1M $0.075 / 1M
Output Price $0.100 / 1M $0.625 / 1M
Output Tokens 2,743 21,752
Reasoning Tokens 0 42,754
Response Time (avg) 719ms 61.29s
Response Time (max) 2.17s 304.19s
Response Time (total) 14.37s 1164.50s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 4.9 10.0 25.0% 0 844ms 903 0
Ring-2.6-1T 10.0 10.0 100.0% 0 42.21s 3,833 4,891
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 5.2 10.0 0.0% 0 706ms 357 0
Ring-2.6-1T 10.0 10.0 100.0% 0 59.65s 1,369 3,985
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 3.0 10.0 0.0% 0 1.88s 396 0
Ring-2.6-1T 10.0 10.0 100.0% 0 304.19s 324 6,088
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 3.0 10.0 0.0% 0 575ms 195 0
Ring-2.6-1T 6.5 10.0 50.0% 0 37.36s 840 1,937
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 3.0 10.0 0.0% 0 357ms 24 0
Ring-2.6-1T 3.5 4.4 33.3% 2 64.92s 9,744 15,013
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 4.0 10.0 0.0% 0 499ms 115 0
Ring-2.6-1T 4.1 10.0 0.0% 0 58.26s 150 583
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 3.6 9.9 0.0% 0 344ms 66 0
Ring-2.6-1T 9.8 10.0 100.0% 0 11.78s 266 1,831
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 3.2 10.0 0.0% 0 608ms 432 0
Ring-2.6-1T 5.9 7.2 55.6% 1 20.73s 697 2,479
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 10.0 10.0 100.0% 0 2.17s 243 0
Ring-2.6-1T 10.0 10.0 100.0% 0 104.44s 234 1,531
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 3.0 10.0 0.0% 0 306ms 12 0
Ring-2.6-1T 3.0 10.0 0.0% 0 113.91s 4,295 4,416

Quick Compare

Switch Comparison Pair