- Peringkat
- #267
- Total token output
- 37,748
- Waktu respons (rata-rata)
- 8.03s
- Total Biaya
- $1.100
Claude Sonnet 5.5 (medium) vs Mercury 2.5 Preview (high)
Skor rata-rata hampir imbang di 6.5 vs 6.5. Mercury 2.5 Preview (high) memiliki biaya benchmark lebih rendah di $0.040 vs $1.100. Mercury 2.5 Preview (high) lebih cepat di 7.61s vs 8.03s, dengan tingkat keberhasilan 40.6% vs 65.2%.
Model yang Dibandingkan
- Peringkat
- #270
- Total token output
- 180,597
- Waktu respons (rata-rata)
- 7.61s
- Total Biaya
- $0.040
Model yang direkomendasikan
Mercury 2.5 Preview (high)
It has the best score here (6.5), while costing about 28.2x less than Claude Sonnet 5.5 (medium).
Perbandingan terperinci
| Metrik | Claude Sonnet 5.5 Claude Sonnet 5.5 medium | Mercury 2.5 Preview Mercury 2.5 Preview high |
|---|---|---|
| Skor | 6.5 | 6.5 |
| Peringkat | #267 | #270 |
| Keandalan | 10.0 | 9.9 |
| Konsistensi | 9.7 | 8.0 |
| Percobaan | 69/69 | 69/69 |
| Tes benar | ||
| Tingkat lulus per percobaan | 40.6% | 65.2% |
| Tes tidak stabil | 1 | 6 |
| Total Run | 69 | 69 |
| Biaya per hasil | 12.221 | 0.319 |
| Total Biaya | $1.100 | $0.040 |
| Harga input | $2.000 / 1M | $0.040 / 1M |
| Harga output | $10.000 / 1M | $0.150 / 1M |
| Harga baca cache | $0.200 / 1M | T/A |
| Harga tulis cache | $2.500 / 1M | T/A |
| Total token input | 361,183 | 298,512 |
| Token output | 26,609 | 3,178 |
| Token penalaran | 11,139 | 177,419 |
| Waktu respons (rata-rata) | 8.03s | 7.61s |
| Waktu respons (maks) | 51.18s | 86.84s |
| Waktu respons (total) | 184.80s | 175.08s |
| Parameter | ~1T total (~100B aktif) | ~100B |
| Ketersediaan | Tertutup | Tertutup |
Harga cache berlaku untuk token input. Pembacaan memakai kembali prompt tersimpan; penulisan menyimpannya dan dapat menambah biaya. Token output menggunakan harga output.
Showcase generasi model
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#267 Claude Sonnet 5.5
medium- Biaya
- $0.024
- Waktu
- 17.4s
- Token
- 2,525 tok
#270 Mercury 2.5 Preview
high- Biaya
- $0.001
- Waktu
- 4.5s
- Token
- 3,851 tok
Rincian Kategori
| Tugas agen | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 10.0 | 10.0 | 100.0% | 0 | 51.18s | 190,412 | 3,424 | 1,344 | |
| Mercury 2.5 Preview | 6.1 | 3.1 | 66.7% | 1 | 86.84s | 182,753 | 616 | 16,476 |
| Trik anti-AI | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 6.5 | 10.0 | 50.0% | 0 | 2.54s | 858 | 1,697 | 0 | |
| Mercury 2.5 Preview | 10.0 | 10.0 | 100.0% | 0 | 1.09s | 785 | 181 | 7,008 |
| Pemrograman | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 3.4 | 9.7 | 0.0% | 0 | 6.07s | 10,608 | 6,767 | 0 | |
| Mercury 2.5 Preview | 6.7 | 7.8 | 55.6% | 1 | 6.13s | 7,751 | 485 | 42,569 |
| Gabungan | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 8.5 | 10.0 | 50.0% | 0 | 23.58s | 133,232 | 7,780 | 5,241 | |
| Mercury 2.5 Preview | 3.8 | 1.6 | 50.0% | 2 | 14.36s | 95,789 | 765 | 54,789 |
| Parsing dan ekstraksi data | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 6.5 | 10.0 | 50.0% | 0 | 2.56s | 10,515 | 696 | 0 | |
| Mercury 2.5 Preview | 10.0 | 10.0 | 100.0% | 0 | 2.24s | 8,292 | 560 | 8,522 |
| Spesifik domain | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 3.0 | 10.0 | 0.0% | 0 | 8.78s | 990 | 4,137 | 2,729 | |
| Mercury 2.5 Preview | 2.9 | 4.4 | 22.2% | 2 | 5.68s | 857 | 67 | 25,958 |
| Kecerdasan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 5.1 | 3.4 | 33.3% | 1 | 2.27s | 714 | 324 | 0 | |
| Mercury 2.5 Preview | 5.1 | 10.0 | 0.0% | 0 | 1.88s | 542 | 94 | 3,300 |
| Kepatuhan instruksi | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 6.3 | 10.0 | 50.0% | 0 | 1.88s | 921 | 346 | 0 | |
| Mercury 2.5 Preview | 9.8 | 10.0 | 100.0% | 0 | 1.05s | 741 | 94 | 3,777 |
| Pemecahan teka-teki | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 7.7 | 10.0 | 66.7% | 0 | 2.43s | 912 | 876 | 0 | |
| Mercury 2.5 Preview | 10.0 | 10.0 | 100.0% | 0 | 1.21s | 774 | 292 | 6,066 |
| Pemanggilan alat | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 10.0 | 10.0 | 100.0% | 0 | 4.75s | 11,757 | 354 | 0 | |
| Mercury 2.5 Preview | 3.0 | 10.0 | 0.0% | 0 | 2.25s | 0 | 0 | 0 |
| Pengetahuan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 3.0 | 10.0 | 0.0% | 0 | 8.57s | 264 | 208 | 1,825 | |
| Mercury 2.5 Preview | 3.0 | 10.0 | 0.0% | 0 | 5.41s | 228 | 24 | 8,954 |
Perbandingan Cepat
Ganti Pasangan Perbandingan
Claude Sonnet 5.5mediumvsMinimax M3.1 FlashhighTersedia gratisMercury 2.5 PreviewhighvsQwen3.6 35B A3BmediumMercury 2.5 PreviewhighvsBeam 1.0 501B A23BxhighMercury 2.5 PreviewhighvsGLM 5.3lowClaude Sonnet 5.5mediumvsMercury 2.5highMercury 2.5 PreviewhighvsGLM 5.1noneClaude Sonnet 5.5mediumvsBeam 1.0 501B A23BxhighClaude Sonnet 5.5mediumvsKAT-Coder-Pro V2.5lowClaude Sonnet 5.5mediumvsGLM 5.3lowMercury 2.5 PreviewhighvsGrok 4.3mediumMercury 2.5 PreviewhighvsLaguna XS 2.1mediumTersedia gratisClaude Sonnet 5.5mediumvsGLM 5.1none