Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

Nemotron 3 Ultra 550b A55b vs Xiaomi: MiMo-V2.5-Pro

Summary

Nemotron 3 Ultra 550b A55b vs MiMo-V2.5-Pro benchmark comparison: The average score is effectively tied at 7.5 vs 7.5. MiMo-V2.5-Pro has the lower benchmark cost at $0.106 vs $0.177. Nemotron 3 Ultra 550b A55b is faster at 15.05s vs 26.13s, with pass rates of 69.8% vs 68.3%.

Recommended model: MiMo-V2.5-Pro - It has the best score here (7.5), while costing about 1.7x less than Nemotron 3 Ultra 550b A55b.

Last updated at: 2026-06-04

Metric Nemotron 3 Ultra 550b A55b Nemotron 3 Ultra 550b A55b medium Release: 2026-06-04 Free Available MiMo-V2.5-Pro MiMo-V2.5-Pro medium Release: 2026-04-22
Score 7.5 7.5
Rank #41 #43
Reliability 9.7 10.0
Consistency 8.8 8.5
Tests Correct
Attempt pass rate 69.8% 68.3%
Flaky tests 3 4
Total Runs 63 63
Cost per result 0.000 2.541
Total Cost $0.177 $0.106
Input Price $0.500 / 1M $0.435 / 1M
Output Price $2.500 / 1M $0.870 / 1M
Total Input Tokens 46,813 40,854
Output Tokens 18,002 5,015
Reasoning Tokens 53,091 97,742
Response Time (avg) 15.05s 26.13s
Response Time (max) 43.93s 130.77s
Response Time (total) 316.09s 548.65s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#41 Nemotron 3 Ultra 550b A55b

medium
No showcase result has been generated for this model yet.
Cost
$0.000
Time
-
Tokens
0 tok

#43 MiMo-V2.5-Pro

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 8.62s 780 835 1,485
MiMo-V2.5-Pro 10.0 10.0 100.0% 0 3.26s 621 323 1,179
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 8.4 7.4 88.9% 1 26.53s 7,686 2,854 17,725
MiMo-V2.5-Pro 6.2 4.7 66.7% 2 92.07s 6,543 780 51,218
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 9.8 10.0 100.0% 0 43.93s 17,574 1,040 3,590
MiMo-V2.5-Pro 10.0 10.0 100.0% 0 53.36s 15,060 348 11,870
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 5.68s 7,989 473 1,285
MiMo-V2.5-Pro 7.3 5.8 83.3% 1 18.81s 7,746 260 8,383
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 3.5 4.4 33.3% 2 24.90s 858 11,169 16,249
MiMo-V2.5-Pro 5.3 10.0 33.3% 0 37.87s 630 275 17,023
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 3.7 9.5 0.0% 0 2.52s 360 70 235
MiMo-V2.5-Pro 5.5 10.0 0.0% 0 4.02s 492 155 163
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 9.8 10.0 100.0% 0 6.35s 765 182 1,243
MiMo-V2.5-Pro 9.9 10.0 100.0% 0 2.77s 672 82 803
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 5.5 9.9 33.3% 0 3.54s 792 771 2,055
MiMo-V2.5-Pro 6.7 7.9 55.6% 1 5.31s 660 540 2,181
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 7.72s 9,781 304 984
MiMo-V2.5-Pro 10.0 10.0 100.0% 0 16.87s 8,220 311 2,908
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 3.0 10.0 0.0% 0 38.47s 228 304 8,240
MiMo-V2.5-Pro 3.0 10.0 0.0% 0 12.46s 210 1,941 2,014

Quick Compare

Switch Comparison Pair

Gemini 3 Flash PreviewnonevsMiMo-V2.5-PromediumGemini 3 Flash PreviewnonevsNemotron 3 Ultra 550b A55bmediumFree AvailableGemini 3.1 Flash Lite PreviewlowvsMiMo-V2.5-PromediumGemini 3.1 Flash Lite PreviewlowvsNemotron 3 Ultra 550b A55bmediumFree AvailableNemotron 3 Ultra 550b A55bmediumFree AvailablevsQwen3.7 MaxnoneQwen3.7 MaxnonevsMiMo-V2.5-PromediumGemini 3.5 FlashminimalvsNemotron 3 Ultra 550b A55bmediumFree AvailableStep 3.7 FlashlowvsMiMo-V2.5-PromediumGemini 3.5 FlashminimalvsMiMo-V2.5-PromediumNemotron 3 Ultra 550b A55bmediumFree AvailablevsStep 3.7 FlashlowDeepSeek V4 FlashhighvsNemotron 3 Ultra 550b A55bmediumFree AvailableGemini 3.1 Flash Lite PreviewnonevsMiMo-V2.5-Promedium