Navigate
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Mistral Small 4 vs Nemotron 3.5 Lightning (high)

Nemotron 3.5 Lightning (high) leads on average score with 5.2 vs 5.1. Mistral Small 4 has the lower benchmark cost at $0.047 vs $0.168. Mistral Small 4 is faster at 3.12s vs 77.08s, with pass rates of 24.6% vs 47.8%.

Last updated at: 2026-11-13

Compared models

Rank
#390
Total Output Tokens
10,913
Response Time (avg)
3.12s
Total Cost
$0.047
Rank
#385
Total Output Tokens
626,081
Response Time (avg)
77.08s
Total Cost
$0.168
Recommended model Mistral Small 4

Its score stays close to the best score here (5.1 vs 5.2), while costing about 3.6x less than Nemotron 3.5 Lightning (high).

Detailed comparison

Metric Mistral Small 4 Mistral Small 4 none Release: 2026-03-16 Nemotron 3.5 Lightning Nemotron 3.5 Lightning high Release: 2026-08-11 Free Available
Score 5.1 5.2
Rank #390 #385
Reliability 10.0 9.6
Consistency 9.6 5.7
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 24.6% 47.8%
Flaky tests 1 12
Total Runs 69 69
Cost per result 0.928 0.000
Total Cost $0.047 $0.168
Input Price $0.150 / 1M $0.060 / 1M
Output Price $0.600 / 1M $0.160 / 1M
Cache Read Price $0.015 / 1M $0.030 / 1M
Cache Write Price N/A N/A
Total Input Tokens 265,602 170,517
Output Tokens 10,913 149,968
Reasoning Tokens 0 509,725
Response Time (avg) 3.12s 77.08s
Response Time (max) 45.46s 490.99s
Response Time (total) 71.87s 1772.78s
Parameters 119B total (6B active) 30B total (3B active)
Availability Open source Weights available

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#390 Mistral Small 4

none
Cost
$0.002
Time
10.4s
Tokens
2,370 tok

#385 Nemotron 3.5 Lightning

high
Cost
$0.000
Time
92.8s
Tokens
11,343 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mistral Small 4 3.7 9.7 0.0% 0 901ms 7,636 619 0
Nemotron 3.5 Lightning 4.4 5.1 33.3% 2 168.41s 7,623 68,533 242,319

Switch Comparison Pair