Navigate
Advertise here

Nemotron 3.5 Lightning (low) vs Qwen3 Coder Next (medium)

Nemotron 3.5 Lightning (low) leads on average score with 4.8 vs 4.6. Qwen3 Coder Next (medium) has the lower benchmark cost at $0.034 vs $0.112. Qwen3 Coder Next (medium) is faster at 9.07s vs 59.81s, with pass rates of 42.4% vs 25.8%.

Last updated at: 2026-09-29

Compared models

Rank
#330
Total Output Tokens
665,174
Response Time (avg)
59.81s
Total Cost
$0.112
Rank
#343
Total Output Tokens
19,069
Response Time (avg)
9.07s
Total Cost
$0.034
Recommended model Qwen3 Coder Next (medium)

Its score stays close to the best score here (4.6 vs 4.8), while costing about 3.4x less than Nemotron 3.5 Lightning (low).

Detailed comparison

Metric Nemotron 3.5 Lightning Nemotron 3.5 Lightning low Release: 2026-08-11 Free Available Qwen3 Coder Next Qwen3 Coder Next medium Release: 2026-02-03
Score 4.8 4.6
Rank #330 #343
Reliability 9.8 10.0
Consistency 6.8 8.6
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 42.4% 25.8%
Flaky tests 9 4
Total Runs 66 66
Cost per result 0.000 1.058
Total Cost $0.112 $0.034
Input Price $0.060 / 1M $0.120 / 1M
Output Price $0.160 / 1M $0.800 / 1M
Total Input Tokens 138,792 148,203
Output Tokens 142,972 19,069
Reasoning Tokens 522,202 0
Response Time (avg) 59.81s 9.07s
Response Time (max) 312.21s 81.80s
Response Time (total) 1315.80s 154.19s
Parameters 30B total (3B active) 80B total (3B active)
Availability Weights available Open source

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#330 Nemotron 3.5 Lightning

low
Cost
$0.000
Time
32.2s
Tokens
6,089 tok

#343 Qwen3 Coder Next

medium
Reached the allocated time limit (300 seconds) without receiving showcase output.
Cost
$0.000
Time
300.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3.5 Lightning 4.0 7.8 11.1% 1 224.42s 7,522 72,614 262,558
Qwen3 Coder Next 3.7 7.2 22.2% 1 924ms 7,185 336 0

Quick Compare

Switch Comparison Pair

Ring-2.6-1TnonevsNemotron 3.5 LightninglowFree AvailableNemotron 3.5 LightninglowFree AvailablevsHy4 previewnoneNemotron 3.5 LightninglowFree AvailablevsGPT-5.4 NanononeTrinity Large ThinkinghighvsNemotron 3.5 LightninglowFree AvailableGranite 4.2 8BhighvsQwen3 Coder NextmediumLing-2.6-flashnonevsNemotron 3.5 LightninglowFree AvailableLaguna S 2.1noneFree AvailablevsQwen3 Coder NextmediumKAT-Coder-Air V2.5nonevsNemotron 3.5 LightninglowFree AvailableNemotron 3.5 LightninglowFree AvailablevsGLM 4.7 FlashnoneTrinity Large PreviewnonevsNemotron 3.5 LightninglowFree AvailableMercury 2nonevsQwen3 Coder NextmediumMercury 2.5 PreviewnonevsNemotron 3.5 LightninglowFree Available