Navigate
Advertise here

Kimi K2.5 vs Nemotron 3.5 Lightning (high)

Kimi K2.5 leads on average score with 5.3 vs 5.2. Nemotron 3.5 Lightning (high) has the lower benchmark cost at $0.168 vs $0.262. Kimi K2.5 is faster at 35.86s vs 77.08s, with pass rates of 29.0% vs 47.8%.

Last updated at: 2026-11-13

Compared models

Rank
#379
Total Output Tokens
49,389
Response Time (avg)
35.86s
Total Cost
$0.262
Rank
#385
Total Output Tokens
626,081
Response Time (avg)
77.08s
Total Cost
$0.168
Recommended model Kimi K2.5

It has the best score here (5.3), while responding about 2.1x faster than Nemotron 3.5 Lightning (high).

Detailed comparison

Metric Kimi K2.5 Kimi K2.5 none Release: 2026-01-27 Nemotron 3.5 Lightning Nemotron 3.5 Lightning high Release: 2026-08-11 Free Available
Score 5.3 5.2
Rank #379 #385
Reliability 10.0 9.6
Consistency 8.6 5.7
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 29.0% 47.8%
Flaky tests 4 12
Total Runs 69 69
Cost per result 4.976 0.000
Total Cost $0.262 $0.168
Input Price $0.450 / 1M $0.060 / 1M
Output Price $2.250 / 1M $0.160 / 1M
Cache Read Price $0.070 / 1M $0.030 / 1M
Cache Write Price N/A N/A
Total Input Tokens 275,349 170,517
Output Tokens 49,377 149,968
Reasoning Tokens 12 509,725
Response Time (avg) 35.86s 77.08s
Response Time (max) 321.19s 490.99s
Response Time (total) 609.61s 1772.78s
Parameters 1T total (32B active) 30B total (3B active)
Availability Weights available Weights available

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#379 MoonshotAI: Kimi K2.5

none
Cost
$0.015
Time
89.1s
Tokens
5,421 tok

#385 Nemotron 3.5 Lightning

high
Cost
$0.000
Time
92.8s
Tokens
11,343 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Kimi K2.5 5.5 10.0 33.3% 0 24.56s 7,311 4,708 0
Nemotron 3.5 Lightning 4.4 5.1 33.3% 2 168.41s 7,623 68,533 242,319

Switch Comparison Pair