- Peringkat
- #291
- Total token output
- 136,501
- Waktu respons (rata-rata)
- 12.68s
- Total Biaya
- $0.126
Mistral Small 4 (medium) vs MiMo-V2.5-Pro
Skor rata-rata hampir imbang di 5.1 vs 5.1. Mistral Small 4 (medium) memiliki biaya benchmark lebih rendah di $0.126 vs $0.157. MiMo-V2.5-Pro lebih cepat di 6.21s vs 12.68s, dengan tingkat keberhasilan 42.0% vs 31.9%.
Model yang Dibandingkan
- Peringkat
- #295
- Total token output
- 17,069
- Waktu respons (rata-rata)
- 6.21s
- Total Biaya
- $0.157
Model yang direkomendasikan
MiMo-V2.5-Pro
It has the best score here (5.1), while responding about 2.0x faster than Mistral Small 4 (medium).
Perbandingan terperinci
| Metrik | Mistral Small 4 Mistral Small 4 medium | MiMo-V2.5-Pro MiMo-V2.5-Pro none |
|---|---|---|
| Skor | 5.1 | 5.1 |
| Peringkat | #291 | #295 |
| Keandalan | 9.7 | 10.0 |
| Konsistensi | 7.1 | 8.7 |
| Percobaan | 69/69 | 69/69 |
| Tes benar | ||
| Tingkat lulus per percobaan | 42.0% | 31.9% |
| Tes tidak stabil | 8 | 4 |
| Total Run | 69 | 69 |
| Biaya per hasil | 2.502 | 3.128 |
| Total Biaya | $0.126 | $0.157 |
| Harga input | $0.150 / 1M | $0.435 / 1M |
| Harga output | $0.600 / 1M | $0.870 / 1M |
| Total token input | 321,955 | 273,075 |
| Token output | 41,555 | 17,069 |
| Token penalaran | 94,946 | 0 |
| Waktu respons (rata-rata) | 12.68s | 6.21s |
| Waktu respons (maks) | 59.15s | 53.13s |
| Waktu respons (total) | 291.66s | 142.89s |
| Parameter | 119B total (6B aktif) | 1.02T total (42B aktif) |
| Ketersediaan | Sumber terbuka | Sumber terbuka |
Showcase generasi model
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#291 Mistral Small 4
medium- Biaya
- $0.006
- Waktu
- 47.9s
- Token
- 9,857 tok
#295 MiMo-V2.5-Pro
none- Biaya
- $0.004
- Waktu
- 46.4s
- Token
- 4,025 tok
Model teratas berdasarkan skor
Skor vs Total Biaya
Waktu respons (rata-rata)
Skor vs Waktu respons (rata-rata)
Total token output
Skor vs Total token output
Rincian Kategori
| Tugas agen | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 5.0 | 10.0 | 0.0% | 0 | 54.05s | 181,396 | 1,287 | 1,617 | |
| MiMo-V2.5-Pro | 3.9 | 9.6 | 0.0% | 0 | 49.61s | 148,267 | 1,707 | 0 |
| Trik anti-AI | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 5.6 | 3.8 | 66.7% | 3 | 2.67s | 708 | 4,055 | 4,778 | |
| MiMo-V2.5-Pro | 3.3 | 8.1 | 8.3% | 1 | 2.67s | 645 | 994 | 0 |
| Pemrograman | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 4.4 | 5.1 | 33.3% | 2 | 39.98s | 7,636 | 11,635 | 54,715 | |
| MiMo-V2.5-Pro | 4.3 | 7.8 | 22.2% | 1 | 1.41s | 6,559 | 485 | 0 |
| Gabungan | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 3.0 | 10.0 | 0.0% | 0 | 32.40s | 116,624 | 17,890 | 18,384 | |
| MiMo-V2.5-Pro | 3.0 | 10.0 | 0.0% | 0 | 28.33s | 98,770 | 12,915 | 0 |
| Parsing dan ekstraksi data | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 7.3 | 5.9 | 83.3% | 1 | 1.23s | 6,171 | 335 | 723 | |
| MiMo-V2.5-Pro | 10.0 | 10.0 | 100.0% | 0 | 1.32s | 7,758 | 249 | 0 |
| Spesifik domain | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 5.9 | 7.2 | 55.6% | 1 | 6.33s | 807 | 3,427 | 7,871 | |
| MiMo-V2.5-Pro | 3.0 | 10.0 | 0.0% | 0 | 1.79s | 762 | 27 | 0 |
| Kecerdasan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 4.8 | 10.0 | 0.0% | 0 | 2.05s | 519 | 821 | 828 | |
| MiMo-V2.5-Pro | 4.0 | 10.0 | 0.0% | 0 | 2.58s | 498 | 87 | 0 |
| Kepatuhan instruksi | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 7.3 | 5.8 | 83.3% | 1 | 1.38s | 729 | 540 | 1,031 | |
| MiMo-V2.5-Pro | 6.4 | 10.0 | 50.0% | 0 | 1.03s | 684 | 66 | 0 |
| Pemecahan teka-teki | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 3.4 | 9.7 | 0.0% | 0 | 2.17s | 735 | 1,226 | 2,632 | |
| MiMo-V2.5-Pro | 6.7 | 4.7 | 77.8% | 2 | 1.30s | 678 | 267 | 0 |
| Pemanggilan alat | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 10.0 | 10.0 | 100.0% | 0 | 3.50s | 6,420 | 321 | 810 | |
| MiMo-V2.5-Pro | 10.0 | 10.0 | 100.0% | 0 | 3.30s | 8,238 | 258 | 0 |
| Pengetahuan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mistral Small 4 | 3.0 | 10.0 | 0.0% | 0 | 5.92s | 210 | 18 | 1,557 | |
| MiMo-V2.5-Pro | 3.0 | 10.0 | 0.0% | 0 | 1.89s | 216 | 14 | 0 |
Perbandingan Cepat
Ganti Pasangan Perbandingan
KAT Coder AIR V2.5mediumvsMiMo-V2.5-PrononeMercury 2.5lowvsMiMo-V2.5-PrononeMercury 2.5lowvsMistral Small 4mediumKAT Coder AIR V2.5highvsMistral Small 4mediumLaguna S 2.1mediumTersedia gratisvsMiMo-V2.5-PrononeMistral Small 4mediumvsNemotron 3.5 LightninghighTersedia gratisKAT Coder AIR V2.5highvsMiMo-V2.5-PrononeLing 3.0 FlashnonevsMistral Small 4mediumMercury 2.5 PreviewlowvsMiMo-V2.5-PrononeNemotron 3.5 LightninghighTersedia gratisvsMiMo-V2.5-PrononeMistral Small 4mediumvsInkling SmalllowTersedia gratisMercury 2.5 PreviewlowvsMistral Small 4medium