- Peringkat
- #254
- Total token output
- 31,975
- Waktu respons (rata-rata)
- 1.31s
- Total Biaya
- $0.011
Mercury 2.5 Preview (low) vs Qwen3 Coder Next
Qwen3 Coder Next unggul dalam skor rata-rata dengan 5.1 vs 5.0. Mercury 2.5 Preview (low) memiliki biaya benchmark lebih rendah di $0.011 vs $0.026. Mercury 2.5 Preview (low) lebih cepat di 1.31s vs 8.63s, dengan tingkat keberhasilan 47.0% vs 25.8%.
- Peringkat
- #248
- Total token output
- 11,808
- Waktu respons (rata-rata)
- 8.63s
- Total Biaya
- $0.026
Model yang direkomendasikan
Mercury 2.5 Preview (low)
Its score stays close to the best score here (5.0 vs 5.1), while costing about 2.5x less than Qwen3 Coder Next.
Perbandingan terperinci
| Metrik | Mercury 2.5 Preview Mercury 2.5 Preview low | Qwen3 Coder Next Qwen3 Coder Next none |
|---|---|---|
| Skor | 5.0 | 5.1 |
| Peringkat | #254 | #248 |
| Keandalan | 10.0 | 10.0 |
| Konsistensi | 7.0 | 9.7 |
| Percobaan | 66/66 | 66/66 |
| Tes benar | ||
| Tingkat lulus per percobaan | 47.0% | 25.8% |
| Tes tidak stabil | 8 | 1 |
| Total Run | 66 | 66 |
| Biaya per hasil | 0.169 | 0.488 |
| Total Biaya | $0.011 | $0.026 |
| Harga input | $0.040 / 1M | $0.120 / 1M |
| Harga output | $0.150 / 1M | $0.800 / 1M |
| Total token input | 133,525 | 134,227 |
| Token output | 7,259 | 11,808 |
| Token penalaran | 24,716 | 0 |
| Waktu respons (rata-rata) | 1.31s | 8.63s |
| Waktu respons (maks) | 7.29s | 45.14s |
| Waktu respons (total) | 28.77s | 146.72s |
| Parameter | ~100B | 80B total (3B aktif) |
| Ketersediaan | Tertutup | Sumber terbuka |
Showcase generasi model
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#254 Mercury 2.5 Preview
low- Biaya
- $0.001
- Waktu
- 1.5s
- Token
- 1,169 tok
#248 Qwen3 Coder Next
none
SVG tidak valid
- Biaya
- $0.058
- Waktu
- 246.3s
- Token
- 64,126 tok
Model teratas berdasarkan skor
Skor vs Total Biaya
Waktu respons (rata-rata)
Skor vs Waktu respons (rata-rata)
Total token output
Skor vs Total token output
Rincian Kategori
| Trik anti-AI | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 5.6 | 3.8 | 66.7% | 3 | 759ms | 786 | 290 | 3,019 | |
| Qwen3 Coder Next | 3.6 | 10.0 | 0.0% | 0 | 3.31s | 645 | 1,321 | 0 |
| Pemrograman | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 5.5 | 10.0 | 33.3% | 0 | 972ms | 7,794 | 695 | 2,263 | |
| Qwen3 Coder Next | 4.6 | 7.9 | 22.2% | 1 | 2.22s | 7,442 | 621 | 0 |
| Gabungan | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 3.0 | 10.0 | 0.0% | 0 | 4.77s | 110,517 | 5,013 | 9,661 | |
| Qwen3 Coder Next | 3.0 | 10.0 | 0.0% | 0 | 30.86s | 107,180 | 8,541 | 0 |
| Parsing dan ekstraksi data | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 6.3 | 5.8 | 66.7% | 1 | 1.12s | 8,309 | 611 | 1,521 | |
| Qwen3 Coder Next | 6.5 | 10.0 | 50.0% | 0 | 1.32s | 7,758 | 246 | 0 |
| Spesifik domain | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 4.1 | 4.4 | 44.5% | 2 | 836ms | 849 | 45 | 2,247 | |
| Qwen3 Coder Next | 5.3 | 10.0 | 33.3% | 0 | 871ms | 762 | 26 | 0 |
| Kecerdasan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 5.0 | 10.0 | 0.0% | 0 | 1.05s | 540 | 105 | 749 | |
| Qwen3 Coder Next | 10.0 | 10.0 | 100.0% | 0 | 1.34s | 498 | 152 | 0 |
| Kepatuhan instruksi | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 6.3 | 10.0 | 50.0% | 0 | 1.60s | 745 | 99 | 1,492 | |
| Qwen3 Coder Next | 6.3 | 10.0 | 50.0% | 0 | 7.78s | 684 | 63 | 0 |
| Pemecahan teka-teki | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 8.2 | 7.2 | 88.9% | 1 | 710ms | 777 | 312 | 2,271 | |
| Qwen3 Coder Next | 3.0 | 10.0 | 0.0% | 0 | 24.34s | 678 | 571 | 0 |
| Pemanggilan alat | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 2.8 | 1.6 | 33.3% | 1 | 1.57s | 2,983 | 76 | 739 | |
| Qwen3 Coder Next | 10.0 | 10.0 | 100.0% | 0 | 2.47s | 8,364 | 255 | 0 |
| Pengetahuan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 3.0 | 10.0 | 0.0% | 0 | 591ms | 225 | 13 | 754 | |
| Qwen3 Coder Next | 3.0 | 10.0 | 0.0% | 0 | 601ms | 216 | 12 | 0 |
Perbandingan Cepat
Ganti Pasangan Perbandingan
Granite 4.2 8BlowvsQwen3 Coder NextnoneMistral Small 4mediumvsQwen3 Coder NextnoneMercury 2.5 PreviewlowvsMiniMax M2.7mediumNemotron 3.5 LightningmediumTersedia gratisvsQwen3 Coder NextnoneDeepSeek V3.2nonevsMercury 2.5 PreviewlowNorth Mini CodenoneTersedia gratisvsMercury 2.5 PreviewlowGranite 4.2 8BmediumvsQwen3 Coder NextnoneMercury 2.5 PreviewlowvsGPT-4o-mininoneMercury 2.5 PreviewlowvsQwen3.5-9BnoneMercury 2.5 PreviewlowvsMiMo-V2.5noneMiniMax M2.7mediumvsQwen3 Coder NextnoneMercury 2.5 PreviewlowvsMistral Small 4medium