- Peringkat
- #297
- Total token output
- 36,870
- Waktu respons (rata-rata)
- 4.92s
- Total Biaya
- $0.015
Mercury 2.5 Preview (low) vs KAT Coder AIR V2.5 (medium)
KAT Coder AIR V2.5 (medium) unggul dalam skor rata-rata dengan 5.1 vs 5.0. Mercury 2.5 Preview (low) memiliki biaya benchmark lebih rendah di $0.015 vs $0.048. Mercury 2.5 Preview (low) lebih cepat di 4.92s vs 8.32s, dengan tingkat keberhasilan 44.9% vs 43.5%.
Model yang Dibandingkan
- Peringkat
- #294
- Total token output
- 66,576
- Waktu respons (rata-rata)
- 8.32s
- Total Biaya
- $0.048
Model yang direkomendasikan
Mercury 2.5 Preview (low)
Its score stays close to the best score here (5.0 vs 5.1), while costing about 3.3x less than KAT Coder AIR V2.5 (medium).
Perbandingan terperinci
| Metrik | Mercury 2.5 Preview Mercury 2.5 Preview low | KAT Coder AIR V2.5 KAT Coder AIR V2.5 medium |
|---|---|---|
| Skor | 5.0 | 5.1 |
| Peringkat | #297 | #294 |
| Keandalan | 9.9 | 9.6 |
| Konsistensi | 7.1 | 8.9 |
| Percobaan | 69/69 | 69/69 |
| Tes benar | ||
| Tingkat lulus per percobaan | 44.9% | 43.5% |
| Tes tidak stabil | 8 | 3 |
| Total Run | 69 | 69 |
| Biaya per hasil | 0.244 | 0.596 |
| Total Biaya | $0.015 | $0.048 |
| Harga input | $0.000 / 1M | $0.000 / 1M |
| Harga output | $0.000 / 1M | $0.000 / 1M |
| Total token input | 235,438 | 51,369 |
| Token output | 8,136 | 8,008 |
| Token penalaran | 28,734 | 58,568 |
| Waktu respons (rata-rata) | 4.92s | 8.32s |
| Waktu respons (maks) | 84.47s | 48.19s |
| Waktu respons (total) | 113.24s | 191.40s |
| Parameter | ~100B | ~35B total (~3B aktif) |
| Ketersediaan | Tertutup | Tertutup |
Showcase generasi model
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#297 Mercury 2.5 Preview
low- Biaya
- $0.001
- Waktu
- 1.5s
- Token
- 1,169 tok
#294 KAT Coder AIR V2.5
medium- Biaya
- $0.003
- Waktu
- 23.7s
- Token
- 4,924 tok
Model teratas berdasarkan skor
Skor vs Total Biaya
Waktu respons (rata-rata)
Skor vs Waktu respons (rata-rata)
Total token output
Skor vs Total token output
Rincian Kategori
| Tugas agen | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 5.0 | 10.0 | 0.0% | 0 | 84.47s | 101,913 | 877 | 4,018 | |
| KAT Coder AIR V2.5 | 3.0 | 10.0 | 0.0% | 0 | 1.05s | 0 | 0 | 0 |
| Trik anti-AI | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 5.6 | 3.8 | 66.7% | 3 | 759ms | 786 | 290 | 3,019 | |
| KAT Coder AIR V2.5 | 8.7 | 8.0 | 91.7% | 1 | 3.79s | 672 | 549 | 4,194 |
| Pemrograman | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 5.5 | 10.0 | 33.3% | 0 | 972ms | 7,794 | 695 | 2,263 | |
| KAT Coder AIR V2.5 | 3.6 | 7.0 | 22.2% | 1 | 23.37s | 7,893 | 5,199 | 29,973 |
| Gabungan | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 3.0 | 10.0 | 0.0% | 0 | 4.77s | 110,517 | 5,013 | 9,661 | |
| KAT Coder AIR V2.5 | 6.5 | 10.0 | 50.0% | 0 | 19.56s | 23,854 | 435 | 6,811 |
| Parsing dan ekstraksi data | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 6.3 | 5.8 | 66.7% | 1 | 1.12s | 8,309 | 611 | 1,521 | |
| KAT Coder AIR V2.5 | 6.5 | 10.0 | 50.0% | 0 | 3.65s | 7,776 | 268 | 1,881 |
| Spesifik domain | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 4.1 | 4.4 | 44.5% | 2 | 836ms | 849 | 45 | 2,247 | |
| KAT Coder AIR V2.5 | 3.0 | 10.0 | 0.0% | 0 | 6.58s | 668 | 673 | 4,670 |
| Kecerdasan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 5.0 | 10.0 | 0.0% | 0 | 1.05s | 540 | 105 | 749 | |
| KAT Coder AIR V2.5 | 5.0 | 10.0 | 0.0% | 0 | 9.81s | 516 | 189 | 557 |
| Kepatuhan instruksi | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 6.3 | 10.0 | 50.0% | 0 | 1.60s | 745 | 99 | 1,492 | |
| KAT Coder AIR V2.5 | 10.0 | 10.0 | 100.0% | 0 | 1.50s | 699 | 93 | 730 |
| Pemecahan teka-teki | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 8.2 | 7.2 | 88.9% | 1 | 710ms | 777 | 312 | 2,271 | |
| KAT Coder AIR V2.5 | 3.6 | 7.2 | 22.2% | 1 | 1.87s | 696 | 265 | 1,184 |
| Pemanggilan alat | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 2.8 | 1.6 | 33.3% | 1 | 1.57s | 2,983 | 76 | 739 | |
| KAT Coder AIR V2.5 | 10.0 | 10.0 | 100.0% | 0 | 4.77s | 8,391 | 317 | 906 |
| Pengetahuan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 3.0 | 10.0 | 0.0% | 0 | 591ms | 225 | 13 | 754 | |
| KAT Coder AIR V2.5 | 3.0 | 10.0 | 0.0% | 0 | 15.74s | 204 | 20 | 7,662 |
Perbandingan Cepat
Ganti Pasangan Perbandingan
Mercury 2.5lowvsKAT Coder AIR V2.5mediumKAT Coder AIR V2.5mediumvsMiMo-V2.5-PrononeKAT Coder AIR V2.5mediumvsMistral Small 4noneMercury 2.5 PreviewlowvsLaguna S 2.1mediumTersedia gratisMercury 2.5 PreviewlowvsMiniMax M2.7mediumDots 3 Note PreviewnoneTersedia gratisvsMercury 2.5 PreviewlowMercury 2.5 PreviewlowvsGPT-4o-mininoneMercury 2.5 PreviewlowvsMiMo-V2.5-PrononeKAT Coder AIR V2.5mediumvsNemotron 3.5 LightninghighTersedia gratisLing 3.0 FlashnonevsKAT Coder AIR V2.5mediumMercury 2.5 PreviewlowvsMistral Small 4noneMercury 2.5 PreviewlowvsMistral Small 4medium