- Peringkat
- #352
- Total token output
- 127,970
- Waktu respons (rata-rata)
- 12.68s
- Total Biaya
- $0.126
Mistral Small 4 — medium vs none
Skor rata-rata hampir imbang di 5.1 vs 5.1. none memiliki biaya benchmark lebih rendah di $0.047 vs $0.126. none lebih cepat di 3.12s vs 12.68s, dengan tingkat keberhasilan 42.0% vs 24.6%.
Model yang Dibandingkan
- Peringkat
- #353
- Total token output
- 10,913
- Waktu respons (rata-rata)
- 3.12s
- Total Biaya
- $0.047
Model yang direkomendasikan
none
It has the best score here (5.1), while costing about 2.7x less than Mistral Small 4 (medium).
Perbandingan terperinci
| Metrik | Mistral Small 4 Mistral Small 4 medium | Mistral Small 4 Mistral Small 4 none |
|---|---|---|
| Skor | 5.1 | 5.1 |
| Peringkat | #352 | #353 |
| Keandalan | 9.7 | 10.0 |
| Konsistensi | 7.1 | 9.6 |
| Percobaan | 69/69 | 69/69 |
| Tes benar | ||
| Tingkat lulus per percobaan | 42.0% | 24.6% |
| Tes tidak stabil | 8 | 1 |
| Total Run | 69 | 69 |
| Biaya per hasil | 2.502 | 0.928 |
| Total Biaya | $0.126 | $0.047 |
| Harga input | $0.150 / 1M | $0.150 / 1M |
| Harga output | $0.600 / 1M | $0.600 / 1M |
| Harga baca cache | $0.015 / 1M | $0.015 / 1M |
| Harga tulis cache | T/A | T/A |
| Total token input | 321,955 | 265,602 |
| Token output | 41,555 | 10,913 |
| Token penalaran | 94,946 | 0 |
| Waktu respons (rata-rata) | 12.68s | 3.12s |
| Waktu respons (maks) | 59.15s | 45.46s |
| Waktu respons (total) | 291.66s | 71.87s |
| Parameter | 119B total (6B aktif) | 119B total (6B aktif) |
| Ketersediaan | Sumber terbuka | Sumber terbuka |
Harga cache berlaku untuk token input. Pembacaan memakai kembali prompt tersimpan; penulisan menyimpannya dan dapat menambah biaya. Token output menggunakan harga output.
Showcase generasi model
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#352 Mistral Small 4
medium- Biaya
- $0.006
- Waktu
- 47.9s
- Token
- 9,857 tok
#353 Mistral Small 4
none- Biaya
- $0.002
- Waktu
- 10.4s
- Token
- 2,370 tok
Rincian Kategori
| Tugas agen | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 5.0 | 10.0 | 0.0% | 0 | 54.05s | 181,396 | 1,287 | 1,617 | |
| Mistral Small 4 | 5.0 | 10.0 | 0.0% | 0 | 45.46s | 160,885 | 1,101 | 0 |
| Trik anti-AI | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 5.6 | 3.8 | 66.7% | 3 | 2.67s | 708 | 4,055 | 4,778 | |
| Mistral Small 4 | 3.4 | 7.9 | 16.7% | 1 | 395ms | 708 | 182 | 0 |
| Pemrograman | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 4.4 | 5.1 | 33.3% | 2 | 39.98s | 7,636 | 11,635 | 54,715 | |
| Mistral Small 4 | 3.7 | 9.7 | 0.0% | 0 | 901ms | 7,636 | 619 | 0 |
| Gabungan | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 3.0 | 10.0 | 0.0% | 0 | 32.40s | 116,624 | 17,890 | 18,384 | |
| Mistral Small 4 | 3.0 | 10.0 | 0.0% | 0 | 7.44s | 79,039 | 8,107 | 0 |
| Parsing dan ekstraksi data | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 7.3 | 5.9 | 83.3% | 1 | 1.23s | 6,171 | 335 | 723 | |
| Mistral Small 4 | 10.0 | 10.0 | 100.0% | 0 | 822ms | 7,914 | 261 | 0 |
| Spesifik domain | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 5.9 | 7.2 | 55.6% | 1 | 6.33s | 807 | 3,427 | 7,871 | |
| Mistral Small 4 | 5.3 | 10.0 | 33.3% | 0 | 377ms | 807 | 28 | 0 |
| Kecerdasan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 4.8 | 10.0 | 0.0% | 0 | 2.05s | 519 | 821 | 828 | |
| Mistral Small 4 | 4.0 | 10.0 | 0.0% | 0 | 729ms | 519 | 205 | 0 |
| Kepatuhan instruksi | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 7.3 | 5.8 | 83.3% | 1 | 1.38s | 729 | 540 | 1,031 | |
| Mistral Small 4 | 6.5 | 10.0 | 50.0% | 0 | 380ms | 729 | 69 | 0 |
| Pemecahan teka-teki | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 3.4 | 9.7 | 0.0% | 0 | 2.17s | 735 | 1,226 | 2,632 | |
| Mistral Small 4 | 3.1 | 9.9 | 0.0% | 0 | 399ms | 735 | 111 | 0 |
| Pemanggilan alat | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 10.0 | 10.0 | 100.0% | 0 | 3.50s | 6,420 | 321 | 810 | |
| Mistral Small 4 | 10.0 | 10.0 | 100.0% | 0 | 1.40s | 6,420 | 213 | 0 |
| Pengetahuan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 3.0 | 10.0 | 0.0% | 0 | 5.92s | 210 | 18 | 1,557 | |
| Mistral Small 4 | 3.0 | 10.0 | 0.0% | 0 | 397ms | 210 | 17 | 0 |
Perbandingan Cepat
Ganti Pasangan Perbandingan
Mercury 2.5lowvsMistral Small 4noneMercury 2.5lowvsMistral Small 4mediumKAT Coder AIR V2.5mediumvsMistral Small 4noneMistral Small 4mediumvsMiMo-V2.5-PrononeKAT Coder AIR V2.5highvsMistral Small 4mediumKAT Coder AIR V2.5highvsMistral Small 4noneApodex 1.1 MinidefaultTersedia gratisvsMistral Small 4noneApodex 1.1 MinidefaultTersedia gratisvsMistral Small 4mediumMistral Small 4mediumvsNemotron 3.5 LightninghighTersedia gratisMistral Small 4nonevsNemotron 3.5 LightninghighTersedia gratisLing 3.0 FlashnonevsMistral Small 4mediumMistral Small 4nonevsLaguna S 2.1mediumTersedia gratis