Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

IBM: Granite 4.1 8B vs Nemotron 3 Nano Omni 30b A3b Reasoning

Last updated at: 2026-05-01

Metric Granite 4.1 8B Granite 4.1 8B none Release: 2026-05-01 Nemotron 3 Nano Omni 30b A3b Reasoning Nemotron 3 Nano Omni 30b A3b Reasoning medium Release: 2026-04-28 Free Available
Score 4.3 5.2
Rank #135 #114
Reliability 10.0 10.0
Consistency 10.0 5.9
Tests Correct
Attempt pass rate 11.1% 47.9%
Flaky tests 0 8
Total Runs 54 54
Cost per result 0.110 0.000
Total Cost $0.003 $0.000
Input Price $0.050 / 1M $0.000 / 1M
Output Price $0.100 / 1M $0.000 / 1M
Output Tokens 2,712 50,628
Reasoning Tokens 0 184,655
Response Time (avg) 767ms 14.46s
Response Time (max) 2.17s 147.45s
Response Time (total) 13.81s 231.37s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 4.9 10.0 25.0% 0 844ms 903 0
Nemotron 3 Nano Omni 30b A3b Reasoning 7.0 5.9 75.0% 2 2.17s 2,490 3,481
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 6.9 10.0 0.0% 0 1.07s 339 0
Nemotron 3 Nano Omni 30b A3b Reasoning 3.3 1.7 33.3% 1 38.09s 6,097 30,508
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 3.0 10.0 0.0% 0 1.88s 396 0
Nemotron 3 Nano Omni 30b A3b Reasoning 0.0 0.0 0.0% 0 0ms 0 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 3.0 10.0 0.0% 0 575ms 195 0
Nemotron 3 Nano Omni 30b A3b Reasoning 7.3 5.9 83.3% 1 2.72s 890 2,811
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 3.0 10.0 0.0% 0 357ms 24 0
Nemotron 3 Nano Omni 30b A3b Reasoning 2.9 7.2 11.1% 1 56.67s 40,404 142,623
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 4.0 10.0 0.0% 0 499ms 115 0
Nemotron 3 Nano Omni 30b A3b Reasoning 4.8 9.9 0.0% 0 1.43s 41 850
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 3.6 9.9 0.0% 0 344ms 66 0
Nemotron 3 Nano Omni 30b A3b Reasoning 7.1 6.6 66.7% 1 1.53s 192 1,728
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 3.7 10.0 0.0% 0 635ms 431 0
Nemotron 3 Nano Omni 30b A3b Reasoning 3.5 4.4 33.3% 2 1.56s 514 2,654
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Granite 4.1 8B 10.0 10.0 100.0% 0 2.17s 243 0
Nemotron 3 Nano Omni 30b A3b Reasoning 0.0 0.0 0.0% 0 0ms 0 0

Quick Compare

Switch Comparison Pair

Mistral Small 4nonevsNemotron 3 Nano Omni 30b A3b ReasoningmediumFree AvailableTrinity Large PreviewnonevsNemotron 3 Nano Omni 30b A3b ReasoningmediumFree AvailableNemotron 3 Nano Omni 30b A3b ReasoningmediumFree AvailablevsElephant AlphanoneDeepSeek V4 FlashnonevsNemotron 3 Nano Omni 30b A3b ReasoningmediumFree AvailableNemotron 3 Nano Omni 30b A3b ReasoningmediumFree AvailablevsQwen3 Coder NextnoneNemotron 3 Nano Omni 30b A3b ReasoningmediumFree AvailablevsGPT-5.4 MininoneGranite 4.1 8BnonevsQwen3.5-9BmediumNemotron 3 Nano Omni 30b A3b ReasoningmediumFree AvailablevsMiMo-V2.5noneLing-2.6-flashnonevsNemotron 3 Nano Omni 30b A3b ReasoningmediumFree AvailableNemotron 3 Nano Omni 30b A3b ReasoningmediumFree AvailablevsQwen3.6 35B A3BnoneNemotron 3 Nano Omni 30b A3b ReasoningmediumFree Availablevsgpt-oss-120bnoneFree AvailableNemotron 3 Nano Omni 30b A3b ReasoningmediumFree AvailablevsGPT-4o-mininone