Navigate
Advertise here

Nemotron 3.5 Lightning (low) vs Qwen3 Coder Next (medium)

Qwen3 Coder Next (medium) leads on average score with 4.7 vs 4.6. Qwen3 Coder Next (medium) has the lower benchmark cost at $0.071 vs $0.175. Qwen3 Coder Next (medium) is faster at 16.97s vs 83.19s, with pass rates of 40.6% vs 24.6%.

Last updated at: 2026-11-16

Compared models

Rank
#430
Total Output Tokens
647,336
Response Time (avg)
83.19s
Total Cost
$0.175
Rank
#424
Total Output Tokens
40,395
Response Time (avg)
16.97s
Total Cost
$0.071
Recommended model Qwen3 Coder Next (medium)

It has the best score here (4.7), while costing about 2.5x less than Nemotron 3.5 Lightning (low).

Detailed comparison

Metric Nemotron 3.5 Lightning Nemotron 3.5 Lightning low Release: 2026-08-11 Free Available Qwen3 Coder Next Qwen3 Coder Next medium Release: 2026-02-03
Score 4.6 4.7
Rank #430 #424
Reliability 9.5 10.0
Consistency 6.8 8.7
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 40.6% 24.6%
Flaky tests 9 4
Total Runs 69 69
Cost per result 0.000 2.280
Total Cost $0.175 $0.071
Input Price $0.060 / 1M $0.120 / 1M
Output Price $0.160 / 1M $0.800 / 1M
Cache Read Price $0.030 / 1M $0.070 / 1M
Cache Write Price N/A N/A
Total Input Tokens 207,883 311,647
Output Tokens 144,718 40,395
Reasoning Tokens 525,897 0
Response Time (avg) 83.19s 16.97s
Response Time (max) 597.61s 151.35s
Response Time (total) 1913.41s 305.55s
Parameters 30B total (3B active) 80B total (3B active)
Availability Weights available Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#430 Nemotron 3.5 Lightning

low
Cost
$0.000
Time
32.2s
Tokens
6,089 tok

#424 Qwen3 Coder Next

medium
Reached the allocated time limit (300 seconds) without receiving showcase output.
Cost
$0.000
Time
300.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3.5 Lightning 4.0 7.8 11.1% 1 224.42s 7,522 72,614 262,558
Qwen3 Coder Next 3.7 7.2 22.2% 1 924ms 7,185 336 0

Switch Comparison Pair