Navigate
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

North Mini Code (default) vs Nemotron 3.5 Lightning (medium)

The average score is effectively tied at 4.7 vs 4.7. North Mini Code (default) has the lower benchmark cost at $0.000 vs $0.195. North Mini Code (default) is faster at 29.47s vs 81.93s, with pass rates of 17.4% vs 47.8%.

Last updated at: 2026-11-16

Compared models

Rank
#421
Total Output Tokens
26,954
Response Time (avg)
29.47s
Total Cost
$0.000
Rank
#420
Total Output Tokens
732,696
Response Time (avg)
81.93s
Total Cost
$0.195
Recommended model Nemotron 3.5 Lightning (medium)

It has the strongest score in this comparison (4.7) and the best overall balance of cost and response time across 2 models.

Detailed comparison

Metric North Mini Code North Mini Code default Release: 2026-06-18 Free Available Nemotron 3.5 Lightning Nemotron 3.5 Lightning medium Release: 2026-08-11 Free Available
Score 4.7 4.7
Rank #421 #420
Reliability 8.9 9.8
Consistency 9.9 5.8
Attempts 63/69 69/69
Tests Correct
Attempt pass rate 17.4% 47.8%
Flaky tests 0 12
Total Runs 63 69
Cost per result 0.000 0.000
Total Cost $0.000 $0.195
Input Price $0.000 / 1M $0.060 / 1M
Output Price $0.000 / 1M $0.160 / 1M
Cache Read Price N/A $0.030 / 1M
Cache Write Price N/A N/A
Total Input Tokens 177,989 195,780
Output Tokens 26,954 167,746
Reasoning Tokens 0 598,384
Response Time (avg) 29.47s 81.93s
Response Time (max) 159.85s 437.11s
Response Time (total) 677.70s 1884.31s
Parameters 30B total (3B active) 30B total (3B active)
Availability Open source Weights available

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#421 North Mini Code

default
Cost
$0.000
Time
266.1s
Tokens
63,551 tok

#420 Nemotron 3.5 Lightning

medium
Cost
$0.000
Time
130.5s
Tokens
6,750 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
North Mini Code 3.9 10.0 0.0% 0 21.96s 7,119 504 0
Nemotron 3.5 Lightning 4.4 5.1 33.3% 2 285.47s 7,623 78,065 297,359

Switch Comparison Pair