- Nafasi
- #291
- Jumla ya tokeni za matokeo
- 136,501
- Muda wa majibu (wastani)
- 12.68s
- Jumla ya gharama
- $0.126
Mistral Small 4 (medium) vs Nemotron 3.5 Lightning (high)
Nemotron 3.5 Lightning (high) inaongoza kwa average score: 5.2 vs 5.1. Nemotron 3.5 Lightning (high) ina gharama ya chini ya benchmark: $0.111 vs $0.126. Mistral Small 4 (medium) ni ya haraka zaidi: 12.68s vs 77.08s, na pass rates 42.0% vs 47.8%.
Modeli zilizolinganishwa
- Nafasi
- #287
- Jumla ya tokeni za matokeo
- 659,693
- Muda wa majibu (wastani)
- 77.08s
- Jumla ya gharama
- $0.111
Muundo unaopendekezwa
Mistral Small 4 (medium)
Its score stays close to the best score here (5.1 vs 5.2), while responding about 6.1x faster than Nemotron 3.5 Lightning (high).
Ulinganisho wa kina
| Kipimo | Mistral Small 4 Mistral Small 4 medium | Nemotron 3.5 Lightning Nemotron 3.5 Lightning high Inapatikana bure |
|---|---|---|
| Alama | 5.1 | 5.2 |
| Nafasi | #291 | #287 |
| Uaminifu | 9.7 | 9.6 |
| Uthabiti | 7.1 | 5.7 |
| Majaribio | 69/69 | 69/69 |
| Majaribio sahihi | ||
| Kiwango cha kupita kwa kila jaribio | 42.0% | 47.8% |
| Majaribio yasiyo thabiti | 8 | 12 |
| Jumla ya uendeshaji | 69 | 69 |
| Gharama kwa matokeo | 2.502 | 0.000 |
| Jumla ya gharama | $0.126 | $0.111 |
| Bei ya ingizo | $0.150 / 1M | $0.060 / 1M |
| Bei ya toleo | $0.600 / 1M | $0.160 / 1M |
| Jumla ya tokeni za ingizo | 321,955 | 170,517 |
| Tokeni za matokeo | 41,555 | 149,968 |
| Tokeni za hoja | 94,946 | 509,725 |
| Muda wa majibu (wastani) | 12.68s | 77.08s |
| Muda wa majibu (upeo) | 59.15s | 490.99s |
| Muda wa majibu (jumla) | 291.66s | 1772.78s |
| Vigezo | 119B jumla (6B vinavyotumika) | 30B jumla (3B vinavyotumika) |
| Upatikanaji | Chanzo huria | Uzani unapatikana |
Onyesho la kizazi cha modeli
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#291 Mistral Small 4
medium- Gharama
- $0.006
- Muda
- 47.9s
- Tokeni
- 9,857 tok
#287 Nemotron 3.5 Lightning
high- Gharama
- $0.000
- Muda
- 92.8s
- Tokeni
- 11,343 tok
Modeli bora kwa alama
Alama dhidi ya gharama ya jumla
Muda wa majibu (wastani)
Alama vs Muda wa majibu (wastani)
Jumla ya tokeni za matokeo
Alama vs Jumla ya tokeni za matokeo
Mgawanyo wa kategoria
| Kazi za mawakala | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 5.0 | 10.0 | 0.0% | 0 | 54.05s | 181,396 | 1,287 | 1,617 | |
| Nemotron 3.5 Lightning | 3.5 | 8.3 | 0.0% | 0 | 490.99s | 52,501 | 1,624 | 3,472 |
| Mbinu za kupinga AI | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 5.6 | 3.8 | 66.7% | 3 | 2.67s | 708 | 4,055 | 4,778 | |
| Nemotron 3.5 Lightning | 5.5 | 3.7 | 66.7% | 3 | 10.29s | 696 | 2,432 | 15,948 |
| Uandishi wa msimbo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 4.4 | 5.1 | 33.3% | 2 | 39.98s | 7,636 | 11,635 | 54,715 | |
| Nemotron 3.5 Lightning | 4.4 | 5.1 | 33.3% | 2 | 168.41s | 7,623 | 68,533 | 242,319 |
| Mchanganyiko | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 3.0 | 10.0 | 0.0% | 0 | 32.40s | 116,624 | 17,890 | 18,384 | |
| Nemotron 3.5 Lightning | 6.4 | 10.0 | 50.0% | 0 | 160.45s | 90,257 | 17,550 | 119,725 |
| Uchanganuzi na uchimbaji wa data | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 7.3 | 5.9 | 83.3% | 1 | 1.23s | 6,171 | 335 | 723 | |
| Nemotron 3.5 Lightning | 7.3 | 5.9 | 83.3% | 1 | 13.99s | 7,944 | 3,210 | 16,835 |
| Mahususi kwa domeni | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 5.9 | 7.2 | 55.6% | 1 | 6.33s | 807 | 3,427 | 7,871 | |
| Nemotron 3.5 Lightning | 2.9 | 4.4 | 22.2% | 2 | 88.61s | 798 | 45,616 | 72,496 |
| Akili ya jumla | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 4.8 | 10.0 | 0.0% | 0 | 2.05s | 519 | 821 | 828 | |
| Nemotron 3.5 Lightning | 3.7 | 9.5 | 0.0% | 0 | 7.58s | 516 | 4,331 | 4,408 |
| Ufuataji wa maagizo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 7.3 | 5.8 | 83.3% | 1 | 1.38s | 729 | 540 | 1,031 | |
| Nemotron 3.5 Lightning | 8.5 | 6.8 | 83.3% | 1 | 4.98s | 723 | 502 | 3,779 |
| Utatuzi wa mafumbo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 3.4 | 9.7 | 0.0% | 0 | 2.17s | 735 | 1,226 | 2,632 | |
| Nemotron 3.5 Lightning | 3.6 | 1.8 | 44.4% | 3 | 6.09s | 726 | 1,236 | 9,851 |
| Mwito wa zana | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 10.0 | 10.0 | 100.0% | 0 | 3.50s | 6,420 | 321 | 810 | |
| Nemotron 3.5 Lightning | 10.0 | 10.0 | 100.0% | 0 | 6.92s | 8,526 | 3,745 | 3,781 |
| Maarifa ya jumla | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 3.0 | 10.0 | 0.0% | 0 | 5.92s | 210 | 18 | 1,557 | |
| Nemotron 3.5 Lightning | 3.0 | 10.0 | 0.0% | 0 | 77.98s | 207 | 1,189 | 17,111 |
Ulinganisho wa haraka
Badilisha jozi ya ulinganisho
Ling 3.0 FlashnonevsNemotron 3.5 LightninghighInapatikana bureMercury 2.5lowvsMistral Small 4mediumMistral Small 4mediumvsMiMo-V2.5-PrononeNemotron 3.5 LightninghighInapatikana burevsInkling SmalllowInapatikana bureKAT Coder AIR V2.5highvsMistral Small 4mediumMistral Small 4nonevsNemotron 3.5 LightninghighInapatikana bureLing 3.0 FlashnonevsMistral Small 4mediumNemotron 3.5 LightninghighInapatikana burevsQwen3.6 35B A3BnoneMercury 2.5lowvsNemotron 3.5 LightninghighInapatikana bureNemotron 3.5 LightninghighInapatikana burevsLaguna XS 2.1noneInapatikana bureKAT Coder AIR V2.5mediumvsNemotron 3.5 LightninghighInapatikana bureNemotron 3.5 LightninghighInapatikana burevsMiMo-V2.5-Pronone