- Peringkat
- #224
- Total token output
- 180,597
- Waktu respons (rata-rata)
- 7.61s
- Total Biaya
- $0.040
Mercury 2.5 Preview (high) vs Beam 1.0 501B A23B (medium)
Beam 1.0 501B A23B (medium) unggul dalam skor rata-rata dengan 6.6 vs 6.5. Mercury 2.5 Preview (high) memiliki biaya benchmark lebih rendah di $0.040 vs $0.499. Beam 1.0 501B A23B (medium) lebih cepat di 6.27s vs 7.61s, dengan tingkat keberhasilan 65.2% vs 65.2%.
Model yang Dibandingkan
- Peringkat
- #220
- Total token output
- 98,521
- Waktu respons (rata-rata)
- 6.27s
- Total Biaya
- $0.499
Model yang direkomendasikan
Mercury 2.5 Preview (high)
Its score stays close to the best score here (6.5 vs 6.6), while costing about 12.8x less than Beam 1.0 501B A23B (medium).
Perbandingan terperinci
| Metrik | Mercury 2.5 Preview Mercury 2.5 Preview high | Beam 1.0 501B A23B Beam 1.0 501B A23B medium |
|---|---|---|
| Skor | 6.5 | 6.6 |
| Peringkat | #224 | #220 |
| Keandalan | 9.9 | 10.0 |
| Konsistensi | 8.0 | 9.3 |
| Percobaan | 69/69 | 69/69 |
| Tes benar | ||
| Tingkat lulus per percobaan | 65.2% | 65.2% |
| Tes tidak stabil | 6 | 2 |
| Total Run | 69 | 69 |
| Biaya per hasil | 0.319 | 3.561 |
| Total Biaya | $0.040 | $0.499 |
| Harga input | $0.040 / 1M | $1.000 / 1M |
| Harga output | $0.150 / 1M | $3.000 / 1M |
| Harga baca cache | T/A | $0.100 / 1M |
| Harga tulis cache | T/A | T/A |
| Total token input | 298,512 | 202,937 |
| Token output | 3,178 | 4,328 |
| Token penalaran | 177,419 | 94,193 |
| Waktu respons (rata-rata) | 7.61s | 6.27s |
| Waktu respons (maks) | 86.84s | 31.55s |
| Waktu respons (total) | 175.08s | 144.28s |
| Parameter | ~100B | 501B total (23B aktif) |
| Ketersediaan | Tertutup | Sumber terbuka |
Harga cache berlaku untuk token input. Pembacaan memakai kembali prompt tersimpan; penulisan menyimpannya dan dapat menambah biaya. Token output menggunakan harga output.
Showcase generasi model
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#224 Mercury 2.5 Preview
high- Biaya
- $0.001
- Waktu
- 4.5s
- Token
- 3,851 tok
#220 Beam 1.0 501B A23B
medium- Biaya
- $0.005
- Waktu
- 11.8s
- Token
- 4,267 tok
Rincian Kategori
| Tugas agen | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 6.1 | 3.1 | 66.7% | 1 | 86.84s | 182,753 | 616 | 16,476 | |
| Beam 1.0 501B A23B | 3.0 | 10.0 | 0.0% | 0 | 31.55s | 172,837 | 2,588 | 9,026 |
| Trik anti-AI | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 10.0 | 10.0 | 100.0% | 0 | 1.09s | 785 | 181 | 7,008 | |
| Beam 1.0 501B A23B | 10.0 | 10.0 | 100.0% | 0 | 1.62s | 1,113 | 232 | 4,706 |
| Pemrograman | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 6.7 | 7.8 | 55.6% | 1 | 6.13s | 7,751 | 485 | 42,569 | |
| Beam 1.0 501B A23B | 10.0 | 10.0 | 100.0% | 0 | 11.81s | 7,791 | 440 | 27,204 |
| Gabungan | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 3.8 | 1.6 | 50.0% | 2 | 14.36s | 95,789 | 765 | 54,789 | |
| Beam 1.0 501B A23B | 3.0 | 10.0 | 0.0% | 0 | 2.62s | 7,665 | 132 | 2,087 |
| Parsing dan ekstraksi data | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 10.0 | 10.0 | 100.0% | 0 | 2.24s | 8,292 | 560 | 8,522 | |
| Beam 1.0 501B A23B | 10.0 | 10.0 | 100.0% | 0 | 1.24s | 7,993 | 279 | 1,614 |
| Spesifik domain | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 2.9 | 4.4 | 22.2% | 2 | 5.68s | 857 | 67 | 25,958 | |
| Beam 1.0 501B A23B | 2.9 | 7.2 | 11.1% | 1 | 11.66s | 1,113 | 71 | 29,077 |
| Kecerdasan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 5.1 | 10.0 | 0.0% | 0 | 1.88s | 542 | 94 | 3,300 | |
| Beam 1.0 501B A23B | 4.7 | 1.6 | 66.7% | 1 | 1.87s | 615 | 96 | 1,532 |
| Kepatuhan instruksi | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 9.8 | 10.0 | 100.0% | 0 | 1.05s | 741 | 94 | 3,777 | |
| Beam 1.0 501B A23B | 9.8 | 10.0 | 100.0% | 0 | 1.24s | 918 | 102 | 1,834 |
| Pemecahan teka-teki | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 10.0 | 10.0 | 100.0% | 0 | 1.21s | 774 | 292 | 6,066 | |
| Beam 1.0 501B A23B | 10.0 | 10.0 | 100.0% | 0 | 3.91s | 1,029 | 281 | 9,130 |
| Pemanggilan alat | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 3.0 | 10.0 | 0.0% | 0 | 2.25s | 0 | 0 | 0 | |
| Beam 1.0 501B A23B | 3.0 | 10.0 | 0.0% | 0 | 1.95s | 1,530 | 72 | 440 |
| Pengetahuan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 3.0 | 10.0 | 0.0% | 0 | 5.41s | 228 | 24 | 8,954 | |
| Beam 1.0 501B A23B | 3.0 | 10.0 | 0.0% | 0 | 10.13s | 333 | 35 | 7,543 |
Perbandingan Cepat
Ganti Pasangan Perbandingan
KAT-Coder-Pro V2.5lowvsBeam 1.0 501B A23BmediumBeam 1.0 501B A23BmediumvsStep 3.7 FlashhighMercury 2.5 PreviewhighvsQwen3.6 35B A3BmediumMercury 2.5 PreviewhighvsBeam 1.0 501B A23BxhighMercury 2.5 PreviewhighvsGLM 5.3lowClaude Sonnet 5.5mediumvsMercury 2.5 PreviewhighMercury 2.5 PreviewhighvsGLM 5.1noneLongCat 2.0lowvsBeam 1.0 501B A23BmediumMercury 2.5 PreviewhighvsGrok 4.3mediumMercury 2.5 PreviewhighvsLaguna XS 2.1mediumTersedia gratisMercury 2.5 PreviewhighvsKAT-Coder-Pro V2.5lowMercury 2.5 PreviewhighvsQwen3.5-122B-A10Bnone