Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Mistral: Mistral Small 4 vs Nemotron 3 Nano Omni 30b A3b Reasoning

Last updated at: 2026-04-29

Metric Mistral Small 4 Mistral Small 4 none Release: 2026-03-16 Nemotron 3 Nano Omni 30b A3b Reasoning Nemotron 3 Nano Omni 30b A3b Reasoning medium Release: 2026-04-28 Free Available
Score 5.2 5.2
Rank #109 #107
Reliability N/A 10.0
Consistency 9.5 5.9
Tests Correct
Attempt pass rate 31.5% 47.9%
Flaky tests 1 8
Total Runs 54 54
Cost per result 0.118 0.000
Total Cost $0.006 $0.000
Input Price $0.150 / 1M $0.000 / 1M
Output Price $0.600 / 1M $0.000 / 1M
Output Tokens 2,207 50,628
Reasoning Tokens 0 184,655
Response Time (avg) 665ms 14.46s
Response Time (max) 1.72s 147.45s
Response Time (total) 11.97s 231.37s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 3.4 7.9 16.7% 1 395ms 182 0
Nemotron 3 Nano Omni 30b A3b Reasoning 7.0 5.9 75.0% 2 2.17s 2,490 3,481
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 4.5 9.0 0.0% 0 1.28s 583 0
Nemotron 3 Nano Omni 30b A3b Reasoning 3.3 1.7 33.3% 1 38.09s 6,097 30,508
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 3.0 10.0 0.0% 0 1.72s 496 0
Nemotron 3 Nano Omni 30b A3b Reasoning 0.0 0.0 0.0% 0 0ms 0 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 10.0 10.0 100.0% 0 822ms 261 0
Nemotron 3 Nano Omni 30b A3b Reasoning 7.3 5.9 83.3% 1 2.72s 890 2,811
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 5.3 10.0 33.3% 0 367ms 28 0
Nemotron 3 Nano Omni 30b A3b Reasoning 2.9 7.2 11.1% 1 56.67s 40,404 142,623
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 4.0 10.0 0.0% 0 729ms 205 0
Nemotron 3 Nano Omni 30b A3b Reasoning 4.8 9.9 0.0% 0 1.43s 41 850
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 6.5 10.0 50.0% 0 380ms 69 0
Nemotron 3 Nano Omni 30b A3b Reasoning 6.9 6.3 66.7% 1 1.53s 192 1,728
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 3.1 9.9 0.0% 0 589ms 170 0
Nemotron 3 Nano Omni 30b A3b Reasoning 3.5 4.4 33.3% 2 1.56s 514 2,654
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mistral Small 4 10.0 10.0 100.0% 0 1.40s 213 0
Nemotron 3 Nano Omni 30b A3b Reasoning 0.0 0.0 0.0% 0 0ms 0 0

Quick Compare

Switch Comparison Pair

Nemotron 3 Nano Omni 30b A3b ReasoningmediumFree AvailablevsGrok 4.20noneNemotron 3 Nano Omni 30b A3b ReasoningmediumFree Availablevsgpt-oss-120bnoneFree AvailableMistral Small 4nonevsElephant AlphamediumNemotron 3 Nano Omni 30b A3b ReasoningmediumFree AvailablevsElephant AlphanoneMiniMax M2.7mediumvsMistral Small 4noneDeepSeek V4 FlashnonevsNemotron 3 Nano Omni 30b A3b ReasoningmediumFree AvailableNemotron 3 Nano Omni 30b A3b ReasoningmediumFree AvailablevsGPT-5.4 MininoneNemotron 3 Nano Omni 30b A3b ReasoningmediumFree AvailablevsQwen3 Coder NextnoneTrinity Large PreviewnonevsNemotron 3 Nano Omni 30b A3b ReasoningmediumFree AvailableNemotron 3 Nano Omni 30b A3b ReasoningmediumFree AvailablevsMiMo-V2.5noneLing-2.6-flashnoneFree AvailablevsNemotron 3 Nano Omni 30b A3b ReasoningmediumFree AvailableNemotron 3 Nano Omni 30b A3b ReasoningmediumFree AvailablevsQwen3.6 35B A3Bnone