- Rank
- #81
- Total Output Tokens
- 608,283
- Response Time (avg)
- 49.88s
- Total Cost
- $0.349
Nemotron 3.5 Super VL (high) vs Inkling (high)
The average score is effectively tied at 8.4 vs 8.4. Nemotron 3.5 Super VL (high) has the lower benchmark cost at $0.349 vs $1.238. Nemotron 3.5 Super VL (high) is faster at 49.88s vs 62.72s, with pass rates of 82.6% vs 78.3%.
Compared models
- Rank
- #86
- Total Output Tokens
- 249,242
- Response Time (avg)
- 62.72s
- Total Cost
- $1.238
Recommended model
Nemotron 3.5 Super VL (high)
It has the best score here (8.4), while costing about 3.6x less than Inkling (high).
Detailed comparison
| Metric | Nemotron 3.5 Super VL Nemotron 3.5 Super VL high Free Available | Inkling Inkling high Free Available |
|---|---|---|
| Score | 8.4 | 8.4 |
| Rank | #81 | #86 |
| Reliability | 9.9 | 10.0 |
| Consistency | 8.0 | 9.0 |
| Attempts | 69/69 | 69/69 |
| Tests Correct | ||
| Attempt pass rate | 82.6% | 78.3% |
| Flaky tests | 6 | 3 |
| Total Runs | 69 | 69 |
| Cost per result | 2.324 | 7.812 |
| Total Cost | $0.349 | $1.238 |
| Input Price | $0.150 / 1M | $0.950 / 1M |
| Output Price | $0.500 / 1M | $4.050 / 1M |
| Cache Read Price | $0.020 / 1M | $0.160 / 1M |
| Cache Write Price | N/A | N/A |
| Total Input Tokens | 296,001 | 240,395 |
| Output Tokens | 8,105 | 7,169 |
| Reasoning Tokens | 600,178 | 242,073 |
| Response Time (avg) | 49.88s | 62.72s |
| Response Time (max) | 310.51s | 327.51s |
| Response Time (total) | 1147.24s | 1442.48s |
| Parameters | 120B total (12B active) | 975B total (41B active) |
| Availability | Open source | Open source |
Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.
Model generation showcase
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#81 Nemotron 3.5 Super VL
high- Cost
- $0.005
- Time
- 25.6s
- Tokens
- 9,076 tok
#86 Thinking Machines: Inkling
high- Cost
- $0.005
- Time
- 32.2s
- Tokens
- 1,275 tok
Category Breakdown
| Agentic | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Super VL | 10.0 | 10.0 | 100.0% | 0 | 112.72s | 181,991 | 1,564 | 9,403 | |
| Inkling | 10.0 | 10.0 | 100.0% | 0 | 66.01s | 153,640 | 1,112 | 11,503 |
| Anti-AI Tricks | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Super VL | 10.0 | 10.0 | 100.0% | 0 | 6.75s | 696 | 178 | 3,733 | |
| Inkling | 10.0 | 10.0 | 100.0% | 0 | 12.68s | 702 | 455 | 7,204 |
| Coding | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Super VL | 8.4 | 7.4 | 88.9% | 1 | 59.18s | 7,623 | 352 | 133,374 | |
| Inkling | 8.5 | 10.0 | 66.7% | 0 | 148.36s | 7,374 | 430 | 78,982 |
| Combined | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Super VL | 7.3 | 5.8 | 83.3% | 1 | 183.49s | 86,115 | 5,038 | 61,085 | |
| Inkling | 7.3 | 5.8 | 83.3% | 1 | 63.78s | 61,296 | 3,854 | 19,895 |
| Data parsing and extraction | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Super VL | 10.0 | 10.0 | 100.0% | 0 | 3.65s | 7,944 | 250 | 5,488 | |
| Inkling | 10.0 | 10.0 | 100.0% | 0 | 8.19s | 7,068 | 216 | 2,349 |
| Domain specific | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Super VL | 4.1 | 4.4 | 44.5% | 2 | 113.75s | 790 | 22 | 362,061 | |
| Inkling | 7.7 | 10.0 | 66.7% | 0 | 174.68s | 692 | 61 | 86,556 |
| General Intelligence | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Super VL | 6.5 | 3.4 | 66.7% | 1 | 14.34s | 516 | 75 | 2,621 | |
| Inkling | 10.0 | 10.0 | 100.0% | 0 | 6.53s | 501 | 182 | 1,151 |
| Instructions following | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Super VL | 8.5 | 6.8 | 83.3% | 1 | 6.10s | 723 | 75 | 2,466 | |
| Inkling | 9.8 | 10.0 | 100.0% | 0 | 7.00s | 708 | 93 | 2,098 |
| Puzzle Solving | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Super VL | 10.0 | 10.0 | 100.0% | 0 | 4.32s | 726 | 225 | 6,843 | |
| Inkling | 6.9 | 4.9 | 77.8% | 2 | 10.69s | 714 | 429 | 4,623 |
| Tool Calling | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Super VL | 10.0 | 10.0 | 100.0% | 0 | 35.56s | 8,670 | 273 | 996 | |
| Inkling | 3.0 | 10.0 | 0.0% | 0 | 6.52s | 7,481 | 307 | 601 |
| Trivia | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Super VL | 3.0 | 10.0 | 0.0% | 0 | 39.39s | 207 | 53 | 12,108 | |
| Inkling | 3.0 | 10.0 | 0.0% | 0 | 153.57s | 219 | 30 | 27,111 |
Quick Compare
Switch Comparison Pair
Nemotron 3.5 Super VLhighFree AvailablevsQwen3.8 2.4T A95BlowNemotron 3.5 Super VLhighFree AvailablevsGPT-5 MinimediumMuse Glimmer 30BxhighvsNemotron 3.5 Super VLhighFree AvailableGemini 3.1 Pro PreviewmediumvsInklinghighFree AvailableGemini 3.1 Pro PreviewmediumvsNemotron 3.5 Super VLhighFree AvailableMuse Glimmer 30BxhighvsInklinghighFree AvailableGPT-5 MinimediumvsInklinghighFree AvailableQwen3.8 2.4T A95BlowvsInklinghighFree AvailableClaude Haiku 5.5maxvsNemotron 3.5 Super VLhighFree AvailableNemotron 3.5 Super VLhighFree AvailablevsQwen3.7 MaxmediumClaude Sonnet 5mediumvsNemotron 3.5 Super VLhighFree AvailableMuse Spark 1.3lowvsNemotron 3.5 Super VLhighFree Available