- Peringkat
- #218
- Total token output
- 96,943
- Waktu respons (rata-rata)
- 4.40s
- Total Biaya
- $0.121
Mercury 2 (medium) vs Qwen3.7 Flash (medium)
Skor rata-rata hampir imbang di 6.6 vs 6.6. Qwen3.7 Flash (medium) memiliki biaya benchmark lebih rendah di $0.076 vs $0.121. Mercury 2 (medium) lebih cepat di 4.40s vs 51.80s, dengan tingkat keberhasilan 53.6% vs 62.3%.
Model yang Dibandingkan
- Peringkat
- #216
- Total token output
- 514,925
- Waktu respons (rata-rata)
- 51.80s
- Total Biaya
- $0.076
Model yang direkomendasikan
Mercury 2 (medium)
It has the best score here (6.6), while responding about 11.8x faster than Qwen3.7 Flash (medium).
Perbandingan terperinci
| Metrik | Mercury 2 Mercury 2 medium | Qwen3.7 Flash Qwen3.7 Flash medium |
|---|---|---|
| Skor | 6.6 | 6.6 |
| Peringkat | #218 | #216 |
| Keandalan | 10.0 | 10.0 |
| Konsistensi | 8.1 | 7.3 |
| Percobaan | 69/69 | 69/69 |
| Tes benar | ||
| Tingkat lulus per percobaan | 53.6% | 62.3% |
| Tes tidak stabil | 5 | 8 |
| Total Run | 69 | 69 |
| Biaya per hasil | 1.201 | 0.760 |
| Total Biaya | $0.121 | $0.076 |
| Harga input | $0.250 / 1M | $0.030 / 1M |
| Harga output | $0.750 / 1M | $0.130 / 1M |
| Harga baca cache | $0.025 / 1M | $0.006 / 1M |
| Harga tulis cache | T/A | $0.039 / 1M |
| Total token input | 189,300 | 300,394 |
| Token output | 10,854 | 14,081 |
| Token penalaran | 86,089 | 500,844 |
| Waktu respons (rata-rata) | 4.40s | 51.80s |
| Waktu respons (maks) | 34.92s | 593.64s |
| Waktu respons (total) | 96.81s | 1191.42s |
| Parameter | ~100B | ~35B total (~3B aktif) |
| Ketersediaan | Tertutup | Tertutup |
Harga cache berlaku untuk token input. Pembacaan memakai kembali prompt tersimpan; penulisan menyimpannya dan dapat menambah biaya. Token output menggunakan harga output.
Showcase generasi model
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#218 Mercury 2
medium- Biaya
- $0.002
- Waktu
- 2.1s
- Token
- 1,702 tok
#216 Qwen3.7 Flash
medium
Reached the allocated time limit (600 seconds) without receiving showcase output.
- Biaya
- $0.000
- Waktu
- 600.0s
- Token
- 0 tok
Rincian Kategori
| Tugas agen | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2 | 4.7 | 1.6 | 66.7% | 1 | 34.92s | 78,785 | 529 | 8,860 | |
| Qwen3.7 Flash | 5.2 | 3.2 | 33.3% | 1 | 148.99s | 185,917 | 1,295 | 43,554 |
| Trik anti-AI | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2 | 6.9 | 9.9 | 50.0% | 0 | 1.12s | 554 | 2,546 | 2,609 | |
| Qwen3.7 Flash | 10.0 | 10.0 | 100.0% | 0 | 9.56s | 672 | 525 | 12,844 |
| Pemrograman | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2 | 8.2 | 7.7 | 77.8% | 1 | 2.04s | 7,065 | 296 | 11,328 | |
| Qwen3.7 Flash | 6.2 | 6.9 | 55.6% | 1 | 46.78s | 7,893 | 563 | 61,902 |
| Gabungan | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2 | 6.7 | 9.1 | 50.0% | 0 | 7.84s | 87,365 | 6,533 | 20,474 | |
| Qwen3.7 Flash | 6.4 | 5.8 | 66.7% | 1 | 314.17s | 87,042 | 10,432 | 296,919 |
| Parsing dan ekstraksi data | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2 | 7.3 | 5.9 | 83.3% | 1 | 1.11s | 6,234 | 183 | 1,656 | |
| Qwen3.7 Flash | 10.0 | 10.0 | 100.0% | 0 | 15.42s | 7,782 | 270 | 11,588 |
| Spesifik domain | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2 | 2.9 | 4.4 | 22.2% | 2 | 8.06s | 1,638 | 53 | 31,177 | |
| Qwen3.7 Flash | 2.9 | 7.2 | 11.1% | 1 | 38.02s | 780 | 59 | 38,977 |
| Kecerdasan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2 | 4.8 | 10.0 | 0.0% | 0 | 821ms | 456 | 137 | 542 | |
| Qwen3.7 Flash | 5.5 | 10.0 | 0.0% | 0 | 10.18s | 516 | 143 | 3,647 |
| Kepatuhan instruksi | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2 | 10.0 | 10.0 | 100.0% | 0 | 1.07s | 340 | 14 | 958 | |
| Qwen3.7 Flash | 5.8 | 2.7 | 66.7% | 2 | 9.27s | 699 | 100 | 7,457 |
| Pemecahan teka-teki | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2 | 5.4 | 10.0 | 33.3% | 0 | 949ms | 601 | 361 | 2,781 | |
| Qwen3.7 Flash | 7.1 | 5.1 | 77.8% | 2 | 8.30s | 696 | 355 | 9,138 |
| Pemanggilan alat | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2 | 10.0 | 10.0 | 100.0% | 0 | 1.89s | 6,080 | 180 | 1,956 | |
| Qwen3.7 Flash | 10.0 | 10.0 | 100.0% | 0 | 7.80s | 8,193 | 309 | 2,171 |
| Pengetahuan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2 | 3.0 | 10.0 | 0.0% | 0 | 2.58s | 182 | 22 | 3,748 | |
| Qwen3.7 Flash | 3.0 | 10.0 | 0.0% | 0 | 29.17s | 204 | 30 | 12,647 |
Perbandingan Cepat
Ganti Pasangan Perbandingan
Mercury 2mediumvsStep 3.7 FlashhighLongCat 2.0lowvsQwen3.7 FlashmediumQwen3.7 FlashmediumvsGLM 5.2noneMercury 2mediumvsLongCat 2.0lowMercury 2mediumvsKAT-Coder-Pro V2.5lowGPT-5.5nonevsQwen3.7 FlashmediumQwen3.7 FlashmediumvsGLM 5.3 FlashlowQwen3.7 FlashmediumvsStep 3.7 FlashhighMercury 2mediumvsGLM 5.2noneKAT-Coder-Pro V2.5lowvsQwen3.7 FlashmediumApodex 1.1 MinihighTersedia gratisvsQwen3.7 FlashmediumMercury 2mediumvsGPT-5.5none