Navigate
Advertise here

Nemotron 3.5 Lightning (medium) vs GLM 4.7 Flash

GLM 4.7 Flash leads on average score with 4.8 vs 4.7. GLM 4.7 Flash has the lower benchmark cost at $0.027 vs $0.195. GLM 4.7 Flash is faster at 13.04s vs 81.93s, with pass rates of 47.8% vs 29.0%.

Last updated at: 2026-11-16

Compared models

Rank
#420
Total Output Tokens
732,696
Response Time (avg)
81.93s
Total Cost
$0.195
Rank
#418
Total Output Tokens
27,395
Response Time (avg)
13.04s
Total Cost
$0.027
Recommended model GLM 4.7 Flash

It has the best score here (4.8), while costing about 7.4x less than Nemotron 3.5 Lightning (medium).

Detailed comparison

Metric Nemotron 3.5 Lightning Nemotron 3.5 Lightning medium Release: 2026-08-11 Free Available GLM 4.7 Flash GLM 4.7 Flash none Release: 2026-01-19
Score 4.7 4.8
Rank #420 #418
Reliability 9.8 10.0
Consistency 5.8 8.9
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 47.8% 29.0%
Flaky tests 12 3
Total Runs 69 69
Cost per result 0.000 0.528
Total Cost $0.195 $0.027
Input Price $0.060 / 1M $0.061 / 1M
Output Price $0.160 / 1M $0.400 / 1M
Cache Read Price $0.030 / 1M N/A
Cache Write Price N/A N/A
Total Input Tokens 195,780 255,363
Output Tokens 167,746 27,395
Reasoning Tokens 598,384 0
Response Time (avg) 81.93s 13.04s
Response Time (max) 437.11s 97.15s
Response Time (total) 1884.31s 221.61s
Parameters 30B total (3B active) 30B total (3B active)
Availability Weights available Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#420 Nemotron 3.5 Lightning

medium
Cost
$0.000
Time
130.5s
Tokens
6,750 tok

#418 GLM 4.7 Flash

none
Reached the allocated time limit (300 seconds) without receiving showcase output.
Cost
$0.000
Time
300.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3.5 Lightning 4.4 5.1 33.3% 2 285.47s 7,623 78,065 297,359
GLM 4.7 Flash 4.3 10.0 0.0% 0 2.54s 7,256 650 0

Switch Comparison Pair