- Rank
- #397
- Total Output Tokens
- 4,779
- Response Time (avg)
- 15.92s
- Total Cost
- $0.009
Nemotron 3.5 Lightning vs Xing4.0 29b A4b (medium)
Nemotron 3.5 Lightning leads on average score with 3.8 vs 3.7. Xing4.0 29b A4b (medium) has the lower benchmark cost at $0.000 vs $0.009. Nemotron 3.5 Lightning is faster at 15.92s vs 371.69s, with pass rates of 15.9% vs 26.1%.
Compared models
- Rank
- #398
- Total Output Tokens
- 107,980
- Response Time (avg)
- 371.69s
- Total Cost
- $0.000
Recommended model
Nemotron 3.5 Lightning
It has the best score here (3.8), while responding about 23.3x faster than Xing4.0 29b A4b (medium).
Detailed comparison
| Metric | Nemotron 3.5 Lightning Nemotron 3.5 Lightning none Free Available | Xing4.0 29b A4b Xing4.0 29b A4b medium Free Available |
|---|---|---|
| Score | 3.8 | 3.7 |
| Rank | #397 | #398 |
| Reliability | 9.8 | 7.3 |
| Consistency | 9.3 | 6.2 |
| Attempts | 69/69 | 69/69 |
| Tests Correct | ||
| Attempt pass rate | 15.9% | 26.1% |
| Flaky tests | 2 | 11 |
| Total Runs | 69 | 69 |
| Cost per result | 0.000 | 0.000 |
| Total Cost | $0.009 | $0.000 |
| Input Price | $0.060 / 1M | $0.000 / 1M |
| Output Price | $0.160 / 1M | $0.000 / 1M |
| Cache Read Price | $0.030 / 1M | N/A |
| Cache Write Price | N/A | N/A |
| Total Input Tokens | 97,418 | 98,467 |
| Output Tokens | 4,779 | 3,385 |
| Reasoning Tokens | 0 | 104,595 |
| Response Time (avg) | 15.92s | 371.69s |
| Response Time (max) | 339.57s | 971.85s |
| Response Time (total) | 366.20s | 8548.88s |
| Parameters | 30B total (3B active) | 29B total (4B active) |
| Availability | Weights available | Open source |
Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.
Model generation showcase
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#397 Nemotron 3.5 Lightning
none- Cost
- $0.000
- Time
- 101.6s
- Tokens
- 6,775 tok
#398 Xing4.0 29b A4b
medium
Reached the allocated time limit (600 seconds) without receiving showcase output.
- Cost
- $0.000
- Time
- 600.0s
- Tokens
- 0 tok
Category Breakdown
| Agentic | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 3.0 | 10.0 | 0.0% | 0 | 339.57s | 23,344 | 2,048 | 0 | |
| Xing4.0 29b A4b | 3.0 | 10.0 | 0.0% | 0 | 579.54s | 54,965 | 405 | 5,479 |
| Anti-AI Tricks | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 4.8 | 10.0 | 25.0% | 0 | 2.12s | 696 | 665 | 0 | |
| Xing4.0 29b A4b | 3.8 | 1.6 | 50.0% | 4 | 145.43s | 487 | 582 | 14,049 |
| Coding | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 3.1 | 7.2 | 11.1% | 1 | 1.55s | 7,623 | 589 | 0 | |
| Xing4.0 29b A4b | 4.2 | 5.1 | 33.3% | 2 | 798.00s | 1,889 | 502 | 27,115 |
| Combined | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 3.0 | 10.0 | 0.0% | 0 | 2.02s | 46,425 | 579 | 0 | |
| Xing4.0 29b A4b | 3.0 | 10.0 | 0.0% | 0 | 898.87s | 20,856 | 736 | 25,295 |
| Data parsing and extraction | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 6.5 | 10.0 | 50.0% | 0 | 633ms | 7,944 | 243 | 0 | |
| Xing4.0 29b A4b | 2.9 | 5.9 | 16.7% | 1 | 147.51s | 8,397 | 283 | 7,766 |
| Domain specific | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 3.0 | 10.0 | 0.0% | 0 | 683ms | 798 | 24 | 0 | |
| Xing4.0 29b A4b | 3.6 | 7.2 | 22.2% | 1 | 381.86s | 264 | 6 | 4,373 |
| General Intelligence | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 4.4 | 9.9 | 0.0% | 0 | 586ms | 516 | 83 | 0 | |
| Xing4.0 29b A4b | 3.2 | 9.9 | 0.0% | 0 | 121.15s | 528 | 87 | 2,517 |
| Instructions following | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 6.5 | 10.0 | 50.0% | 0 | 511ms | 723 | 63 | 0 | |
| Xing4.0 29b A4b | 4.3 | 6.8 | 16.7% | 1 | 25.45s | 300 | 56 | 1,280 |
| Puzzle Solving | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 3.1 | 10.0 | 0.0% | 0 | 750ms | 726 | 227 | 0 | |
| Xing4.0 29b A4b | 2.9 | 4.4 | 22.2% | 2 | 257.08s | 537 | 222 | 13,616 |
| Tool Calling | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 2.8 | 1.6 | 33.3% | 1 | 1.70s | 8,416 | 246 | 0 | |
| Xing4.0 29b A4b | 10.0 | 10.0 | 100.0% | 0 | 56.09s | 10,183 | 503 | 866 |
| Trivia | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 3.0 | 10.0 | 0.0% | 0 | 575ms | 207 | 12 | 0 | |
| Xing4.0 29b A4b | 3.0 | 10.0 | 0.0% | 0 | 755.91s | 61 | 3 | 2,239 |
Quick Compare
Switch Comparison Pair
Ling 3.0 TinyhighvsXing4.0 29b A4bmediumFree AvailableGranite 4.1 8bdefaultvsNemotron 3.5 LightningnoneFree AvailableLing 3.0 TinydefaultvsNemotron 3.5 LightningnoneFree AvailableLing 3.0 TinylowvsXing4.0 29b A4bmediumFree AvailableLing 3.0 TinyhighvsNemotron 3.5 LightningnoneFree AvailableGranite 4.1 8bdefaultvsXing4.0 29b A4bmediumFree AvailableLing 3.0 TinydefaultvsXing4.0 29b A4bmediumFree AvailableLing 3.0 TinylowvsNemotron 3.5 LightningnoneFree AvailableLing 3.0 TinymediumvsNemotron 3.5 LightningnoneFree AvailableNemotron 3.5 LightningnoneFree AvailablevsQwen3.5-9BmediumGrok 4.20nonevsXing4.0 29b A4bmediumFree AvailableMercury 2.5nonevsXing4.0 29b A4bmediumFree Available