- Peringkat
- #291
- Total token output
- 136,501
- Waktu respons (rata-rata)
- 12.68s
- Total Biaya
- $0.126
Mistral Small 4 (medium) vs Nemotron 3.5 Lightning (high)
Nemotron 3.5 Lightning (high) unggul dalam skor rata-rata dengan 5.2 vs 5.1. Nemotron 3.5 Lightning (high) memiliki biaya benchmark lebih rendah di $0.111 vs $0.126. Mistral Small 4 (medium) lebih cepat di 12.68s vs 77.08s, dengan tingkat keberhasilan 42.0% vs 47.8%.
Model yang Dibandingkan
- Peringkat
- #287
- Total token output
- 659,693
- Waktu respons (rata-rata)
- 77.08s
- Total Biaya
- $0.111
Model yang direkomendasikan
Mistral Small 4 (medium)
Its score stays close to the best score here (5.1 vs 5.2), while responding about 6.1x faster than Nemotron 3.5 Lightning (high).
Perbandingan terperinci
| Metrik | Mistral Small 4 Mistral Small 4 medium | Nemotron 3.5 Lightning Nemotron 3.5 Lightning high Tersedia gratis |
|---|---|---|
| Skor | 5.1 | 5.2 |
| Peringkat | #291 | #287 |
| Keandalan | 9.7 | 9.6 |
| Konsistensi | 7.1 | 5.7 |
| Percobaan | 69/69 | 69/69 |
| Tes benar | ||
| Tingkat lulus per percobaan | 42.0% | 47.8% |
| Tes tidak stabil | 8 | 12 |
| Total Run | 69 | 69 |
| Biaya per hasil | 2.502 | 0.000 |
| Total Biaya | $0.126 | $0.111 |
| Harga input | $0.150 / 1M | $0.060 / 1M |
| Harga output | $0.600 / 1M | $0.160 / 1M |
| Total token input | 321,955 | 170,517 |
| Token output | 41,555 | 149,968 |
| Token penalaran | 94,946 | 509,725 |
| Waktu respons (rata-rata) | 12.68s | 77.08s |
| Waktu respons (maks) | 59.15s | 490.99s |
| Waktu respons (total) | 291.66s | 1772.78s |
| Parameter | 119B total (6B aktif) | 30B total (3B aktif) |
| Ketersediaan | Sumber terbuka | Bobot tersedia |
Showcase generasi model
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#291 Mistral Small 4
medium- Biaya
- $0.006
- Waktu
- 47.9s
- Token
- 9,857 tok
#287 Nemotron 3.5 Lightning
high- Biaya
- $0.000
- Waktu
- 92.8s
- Token
- 11,343 tok
Model teratas berdasarkan skor
Skor vs Total Biaya
Waktu respons (rata-rata)
Skor vs Waktu respons (rata-rata)
Total token output
Skor vs Total token output
Rincian Kategori
| Tugas agen | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 5.0 | 10.0 | 0.0% | 0 | 54.05s | 181,396 | 1,287 | 1,617 | |
| Nemotron 3.5 Lightning | 3.5 | 8.3 | 0.0% | 0 | 490.99s | 52,501 | 1,624 | 3,472 |
| Trik anti-AI | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 5.6 | 3.8 | 66.7% | 3 | 2.67s | 708 | 4,055 | 4,778 | |
| Nemotron 3.5 Lightning | 5.5 | 3.7 | 66.7% | 3 | 10.29s | 696 | 2,432 | 15,948 |
| Pemrograman | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 4.4 | 5.1 | 33.3% | 2 | 39.98s | 7,636 | 11,635 | 54,715 | |
| Nemotron 3.5 Lightning | 4.4 | 5.1 | 33.3% | 2 | 168.41s | 7,623 | 68,533 | 242,319 |
| Gabungan | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 3.0 | 10.0 | 0.0% | 0 | 32.40s | 116,624 | 17,890 | 18,384 | |
| Nemotron 3.5 Lightning | 6.4 | 10.0 | 50.0% | 0 | 160.45s | 90,257 | 17,550 | 119,725 |
| Parsing dan ekstraksi data | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 7.3 | 5.9 | 83.3% | 1 | 1.23s | 6,171 | 335 | 723 | |
| Nemotron 3.5 Lightning | 7.3 | 5.9 | 83.3% | 1 | 13.99s | 7,944 | 3,210 | 16,835 |
| Spesifik domain | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 5.9 | 7.2 | 55.6% | 1 | 6.33s | 807 | 3,427 | 7,871 | |
| Nemotron 3.5 Lightning | 2.9 | 4.4 | 22.2% | 2 | 88.61s | 798 | 45,616 | 72,496 |
| Kecerdasan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 4.8 | 10.0 | 0.0% | 0 | 2.05s | 519 | 821 | 828 | |
| Nemotron 3.5 Lightning | 3.7 | 9.5 | 0.0% | 0 | 7.58s | 516 | 4,331 | 4,408 |
| Kepatuhan instruksi | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 7.3 | 5.8 | 83.3% | 1 | 1.38s | 729 | 540 | 1,031 | |
| Nemotron 3.5 Lightning | 8.5 | 6.8 | 83.3% | 1 | 4.98s | 723 | 502 | 3,779 |
| Pemecahan teka-teki | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 3.4 | 9.7 | 0.0% | 0 | 2.17s | 735 | 1,226 | 2,632 | |
| Nemotron 3.5 Lightning | 3.6 | 1.8 | 44.4% | 3 | 6.09s | 726 | 1,236 | 9,851 |
| Pemanggilan alat | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 10.0 | 10.0 | 100.0% | 0 | 3.50s | 6,420 | 321 | 810 | |
| Nemotron 3.5 Lightning | 10.0 | 10.0 | 100.0% | 0 | 6.92s | 8,526 | 3,745 | 3,781 |
| Pengetahuan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 3.0 | 10.0 | 0.0% | 0 | 5.92s | 210 | 18 | 1,557 | |
| Nemotron 3.5 Lightning | 3.0 | 10.0 | 0.0% | 0 | 77.98s | 207 | 1,189 | 17,111 |
Perbandingan Cepat
Ganti Pasangan Perbandingan
Ling 3.0 FlashnonevsNemotron 3.5 LightninghighTersedia gratisMercury 2.5lowvsMistral Small 4mediumMistral Small 4mediumvsMiMo-V2.5-PrononeNemotron 3.5 LightninghighTersedia gratisvsInkling SmalllowTersedia gratisKAT Coder AIR V2.5highvsMistral Small 4mediumMistral Small 4nonevsNemotron 3.5 LightninghighTersedia gratisLing 3.0 FlashnonevsMistral Small 4mediumNemotron 3.5 LightninghighTersedia gratisvsQwen3.6 35B A3BnoneMercury 2.5lowvsNemotron 3.5 LightninghighTersedia gratisNemotron 3.5 LightninghighTersedia gratisvsLaguna XS 2.1noneTersedia gratisKAT Coder AIR V2.5mediumvsNemotron 3.5 LightninghighTersedia gratisNemotron 3.5 LightninghighTersedia gratisvsMiMo-V2.5-Pronone