Navigate
AI BENCHY
Advertise here

North Mini Code vs Nemotron 3.5 Lightning (low)

North Mini Code leads on average score with 5.1 vs 4.8. North Mini Code has the lower benchmark cost at $0.000 vs $0.140. North Mini Code is faster at 29.95s vs 59.81s, with pass rates of 18.2% vs 42.4%.

Last updated at: 2026-08-20

Rank
#241
Total Output Tokens
26,786
Response Time (avg)
29.95s
Total Cost
$0.000
Rank
#250
Total Output Tokens
665,174
Response Time (avg)
59.81s
Total Cost
$0.140
Recommended model North Mini Code

It has the best score here (5.1), while responding about 2.0x faster than Nemotron 3.5 Lightning (low).

Detailed comparison

Metric North Mini Code North Mini Code none Release: 2026-06-18 Free Available Nemotron 3.5 Lightning Nemotron 3.5 Lightning low Release: 2026-08-11 Free Available
Score 5.1 4.8
Rank #241 #250
Reliability 8.7 9.8
Consistency 9.9 6.8
Attempts 60/66 66/66
Tests Correct
Attempt pass rate 18.2% 42.4%
Flaky tests 0 9
Total Runs 60 66
Cost per result 0.000 0.000
Total Cost $0.000 $0.140
Input Price $0.000 / 1M $0.080 / 1M
Output Price $0.000 / 1M $0.200 / 1M
Total Input Tokens 130,501 138,792
Output Tokens 26,786 142,972
Reasoning Tokens 0 522,202
Response Time (avg) 29.95s 59.81s
Response Time (max) 159.85s 312.21s
Response Time (total) 658.83s 1315.80s
Parameters 30B total (3B active) 30B total (3B active)
Availability Open source Weights available

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#241 North Mini Code

none
Cost
$0.000
Time
266.1s
Tokens
63,551 tok

#250 Nemotron 3.5 Lightning

low
Cost
$0.000
Time
32.2s
Tokens
6,089 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
North Mini Code 3.9 10.0 0.0% 0 21.96s 7,119 504 0
Nemotron 3.5 Lightning 4.0 7.8 11.1% 1 224.42s 7,522 72,614 262,558

Quick Compare

Switch Comparison Pair

Ring-2.6-1TnonevsNemotron 3.5 LightninglowFree AvailableNemotron 3.5 LightninglowFree AvailablevsGPT-5.4 NanononeTrinity Large ThinkinghighvsNemotron 3.5 LightninglowFree AvailableNorth Mini CodenoneFree AvailablevsMiniMax M2.7mediumLing-2.6-flashnonevsNemotron 3.5 LightninglowFree AvailableKAT-Coder-Air V2.5nonevsNemotron 3.5 LightninglowFree AvailableNemotron 3.5 LightninglowFree AvailablevsGLM 4.7 FlashnoneTrinity Large PreviewnonevsNemotron 3.5 LightninglowFree AvailableNorth Mini CodenoneFree AvailablevsMistral Small 4mediumNorth Mini CodenoneFree AvailablevsNemotron 3.5 LightningmediumFree AvailableNorth Mini CodenoneFree AvailablevsLaguna S 2.1lowFree AvailableNemotron 3.5 LightninglowFree AvailablevsGPT-4o-mininone