- Nafasi
- #287
- Jumla ya tokeni za matokeo
- 659,693
- Muda wa majibu (wastani)
- 77.08s
- Jumla ya gharama
- $0.111
Nemotron 3.5 Lightning (high) vs Inkling Small (low)
average score iko karibu sawa: 5.2 vs 5.2. Inkling Small (low) ina gharama ya chini ya benchmark: $0.059 vs $0.111. Inkling Small (low) ni ya haraka zaidi: 1.99s vs 77.08s, na pass rates 47.8% vs 47.8%.
Modeli zilizolinganishwa
- Nafasi
- #285
- Jumla ya tokeni za matokeo
- 14,686
- Muda wa majibu (wastani)
- 1.99s
- Jumla ya gharama
- $0.059
Muundo unaopendekezwa
Inkling Small (low)
It has the best score here (5.2), while costing about 1.9x less than Nemotron 3.5 Lightning (high).
Ulinganisho wa kina
| Kipimo | Nemotron 3.5 Lightning Nemotron 3.5 Lightning high Inapatikana bure | Inkling Small Inkling Small low Inapatikana bure |
|---|---|---|
| Alama | 5.2 | 5.2 |
| Nafasi | #287 | #285 |
| Uaminifu | 9.6 | 10.0 |
| Uthabiti | 5.7 | 8.7 |
| Majaribio | 69/69 | 69/69 |
| Majaribio sahihi | ||
| Kiwango cha kupita kwa kila jaribio | 47.8% | 47.8% |
| Majaribio yasiyo thabiti | 12 | 4 |
| Jumla ya uendeshaji | 69 | 69 |
| Gharama kwa matokeo | 0.000 | 0.649 |
| Jumla ya gharama | $0.111 | $0.059 |
| Bei ya ingizo | $0.060 / 1M | $0.450 / 1M |
| Bei ya toleo | $0.160 / 1M | $1.200 / 1M |
| Jumla ya tokeni za ingizo | 170,517 | 81,447 |
| Tokeni za matokeo | 149,968 | 2,715 |
| Tokeni za hoja | 509,725 | 11,971 |
| Muda wa majibu (wastani) | 77.08s | 1.99s |
| Muda wa majibu (upeo) | 490.99s | 5.82s |
| Muda wa majibu (jumla) | 1772.78s | 45.67s |
| Vigezo | 30B jumla (3B vinavyotumika) | 276B jumla (12B vinavyotumika) |
| Upatikanaji | Uzani unapatikana | Imefungwa |
Onyesho la kizazi cha modeli
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#287 Nemotron 3.5 Lightning
high- Gharama
- $0.000
- Muda
- 92.8s
- Tokeni
- 11,343 tok
#285 Thinking Machines: Inkling Small
low- Gharama
- $0.001
- Muda
- 5.9s
- Tokeni
- 759 tok
Modeli bora kwa alama
Alama dhidi ya gharama ya jumla
Muda wa majibu (wastani)
Alama vs Muda wa majibu (wastani)
Jumla ya tokeni za matokeo
Alama vs Jumla ya tokeni za matokeo
Mgawanyo wa kategoria
| Kazi za mawakala | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 3.5 | 8.3 | 0.0% | 0 | 490.99s | 52,501 | 1,624 | 3,472 | |
| Inkling Small | 3.0 | 10.0 | 0.0% | 0 | 24ms | 0 | 0 | 0 |
| Mbinu za kupinga AI | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 5.5 | 3.7 | 66.7% | 3 | 10.29s | 696 | 2,432 | 15,948 | |
| Inkling Small | 9.2 | 8.4 | 91.7% | 1 | 1.81s | 702 | 240 | 1,831 |
| Uandishi wa msimbo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 4.4 | 5.1 | 33.3% | 2 | 168.41s | 7,623 | 68,533 | 242,319 | |
| Inkling Small | 4.6 | 5.0 | 33.3% | 2 | 3.70s | 7,374 | 375 | 4,332 |
| Mchanganyiko | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 6.4 | 10.0 | 50.0% | 0 | 160.45s | 90,257 | 17,550 | 119,725 | |
| Inkling Small | 3.0 | 10.0 | 0.0% | 0 | 4.08s | 55,293 | 893 | 1,420 |
| Uchanganuzi na uchimbaji wa data | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 7.3 | 5.9 | 83.3% | 1 | 13.99s | 7,944 | 3,210 | 16,835 | |
| Inkling Small | 10.0 | 10.0 | 100.0% | 0 | 1.25s | 7,068 | 216 | 372 |
| Mahususi kwa domeni | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 2.9 | 4.4 | 22.2% | 2 | 88.61s | 798 | 45,616 | 72,496 | |
| Inkling Small | 5.3 | 10.0 | 33.3% | 0 | 852ms | 804 | 68 | 602 |
| Akili ya jumla | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 3.7 | 9.5 | 0.0% | 0 | 7.58s | 516 | 4,331 | 4,408 | |
| Inkling Small | 5.3 | 10.0 | 0.0% | 0 | 1.42s | 501 | 141 | 389 |
| Ufuataji wa maagizo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 8.5 | 6.8 | 83.3% | 1 | 4.98s | 723 | 502 | 3,779 | |
| Inkling Small | 9.9 | 10.0 | 100.0% | 0 | 1.89s | 708 | 93 | 902 |
| Utatuzi wa mafumbo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 3.6 | 1.8 | 44.4% | 3 | 6.09s | 726 | 1,236 | 9,851 | |
| Inkling Small | 5.3 | 7.2 | 44.4% | 1 | 1.56s | 714 | 315 | 1,225 |
| Mwito wa zana | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 10.0 | 10.0 | 100.0% | 0 | 6.92s | 8,526 | 3,745 | 3,781 | |
| Inkling Small | 3.0 | 10.0 | 0.0% | 0 | 2.21s | 8,064 | 339 | 84 |
| Maarifa ya jumla | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 3.0 | 10.0 | 0.0% | 0 | 77.98s | 207 | 1,189 | 17,111 | |
| Inkling Small | 3.0 | 10.0 | 0.0% | 0 | 2.00s | 219 | 35 | 814 |
Ulinganisho wa haraka
Badilisha jozi ya ulinganisho
Ling 3.0 FlashnonevsNemotron 3.5 LightninghighInapatikana bureLing 3.0 FlashnonevsInkling SmalllowInapatikana bureKAT Coder AIR V2.5highvsInkling SmalllowInapatikana bureQwen3.6 35B A3BnonevsInkling SmalllowInapatikana bureLaguna XS 2.1noneInapatikana burevsInkling SmalllowInapatikana bureMistral Small 4mediumvsNemotron 3.5 LightninghighInapatikana bureMistral Small 4nonevsNemotron 3.5 LightninghighInapatikana bureNemotron 3.5 LightninghighInapatikana burevsQwen3.6 35B A3BnoneMercury 2.5lowvsNemotron 3.5 LightninghighInapatikana bureNemotron 3.5 LightninghighInapatikana burevsLaguna XS 2.1noneInapatikana bureKAT Coder AIR V2.5mediumvsNemotron 3.5 LightninghighInapatikana bureNemotron 3.5 LightninghighInapatikana burevsMiMo-V2.5-Pronone