- Peringkat
- #254
- Total token output
- 31,975
- Waktu respons (rata-rata)
- 1.31s
- Total Biaya
- $0.011
Mercury 2.5 Preview (low) vs Nemotron 3.5 Lightning (medium)
Nemotron 3.5 Lightning (medium) unggul dalam skor rata-rata dengan 5.1 vs 5.0. Mercury 2.5 Preview (low) memiliki biaya benchmark lebih rendah di $0.011 vs $0.156. Mercury 2.5 Preview (low) lebih cepat di 1.31s vs 70.11s, dengan tingkat keberhasilan 47.0% vs 48.5%.
- Peringkat
- #244
- Total token output
- 760,441
- Waktu respons (rata-rata)
- 70.11s
- Total Biaya
- $0.156
Model yang direkomendasikan
Mercury 2.5 Preview (low)
Its score stays close to the best score here (5.0 vs 5.1), while costing about 15.3x less than Nemotron 3.5 Lightning (medium).
Perbandingan terperinci
| Metrik | Mercury 2.5 Preview Mercury 2.5 Preview low | Nemotron 3.5 Lightning Nemotron 3.5 Lightning medium Tersedia gratis |
|---|---|---|
| Skor | 5.0 | 5.1 |
| Peringkat | #254 | #244 |
| Keandalan | 10.0 | 9.9 |
| Konsistensi | 7.0 | 6.0 |
| Percobaan | 66/66 | 66/66 |
| Tes benar | ||
| Tingkat lulus per percobaan | 47.0% | 48.5% |
| Tes tidak stabil | 8 | 11 |
| Total Run | 66 | 66 |
| Biaya per hasil | 0.169 | 0.000 |
| Total Biaya | $0.011 | $0.156 |
| Harga input | $0.040 / 1M | $0.080 / 1M |
| Harga output | $0.150 / 1M | $0.200 / 1M |
| Total token input | 133,525 | 126,330 |
| Token output | 7,259 | 165,702 |
| Token penalaran | 24,716 | 594,739 |
| Waktu respons (rata-rata) | 1.31s | 70.11s |
| Waktu respons (maks) | 7.29s | 437.11s |
| Waktu respons (total) | 28.77s | 1542.52s |
| Parameter | ~100B | 30B total (3B aktif) |
| Ketersediaan | Tertutup | Bobot tersedia |
Showcase generasi model
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#254 Mercury 2.5 Preview
low- Biaya
- $0.001
- Waktu
- 1.5s
- Token
- 1,169 tok
#244 Nemotron 3.5 Lightning
medium- Biaya
- $0.000
- Waktu
- 130.5s
- Token
- 6,750 tok
Model teratas berdasarkan skor
Skor vs Total Biaya
Waktu respons (rata-rata)
Skor vs Waktu respons (rata-rata)
Total token output
Skor vs Total token output
Rincian Kategori
| Trik anti-AI | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 5.6 | 3.8 | 66.7% | 3 | 759ms | 786 | 290 | 3,019 | |
| Nemotron 3.5 Lightning | 6.9 | 7.9 | 66.7% | 1 | 12.34s | 696 | 6,904 | 20,862 |
| Pemrograman | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 5.5 | 10.0 | 33.3% | 0 | 972ms | 7,794 | 695 | 2,263 | |
| Nemotron 3.5 Lightning | 4.4 | 5.1 | 33.3% | 2 | 285.47s | 7,623 | 78,065 | 297,359 |
| Gabungan | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 3.0 | 10.0 | 0.0% | 0 | 4.77s | 110,517 | 5,013 | 9,661 | |
| Nemotron 3.5 Lightning | 6.2 | 5.8 | 66.7% | 1 | 136.91s | 98,571 | 15,769 | 112,376 |
| Parsing dan ekstraksi data | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 6.3 | 5.8 | 66.7% | 1 | 1.12s | 8,309 | 611 | 1,521 | |
| Nemotron 3.5 Lightning | 3.7 | 1.7 | 50.0% | 2 | 23.24s | 7,944 | 4,195 | 30,097 |
| Spesifik domain | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 4.1 | 4.4 | 44.5% | 2 | 836ms | 849 | 45 | 2,247 | |
| Nemotron 3.5 Lightning | 2.9 | 4.4 | 22.2% | 2 | 74.73s | 798 | 54,657 | 91,174 |
| Kecerdasan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 5.0 | 10.0 | 0.0% | 0 | 1.05s | 540 | 105 | 749 | |
| Nemotron 3.5 Lightning | 5.5 | 10.0 | 0.0% | 0 | 4.36s | 516 | 3,127 | 3,157 |
| Kepatuhan instruksi | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 6.3 | 10.0 | 50.0% | 0 | 1.60s | 745 | 99 | 1,492 | |
| Nemotron 3.5 Lightning | 8.5 | 6.8 | 83.3% | 1 | 3.75s | 723 | 531 | 4,404 |
| Pemecahan teka-teki | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 8.2 | 7.2 | 88.9% | 1 | 710ms | 777 | 312 | 2,271 | |
| Nemotron 3.5 Lightning | 4.2 | 4.4 | 44.5% | 2 | 10.49s | 726 | 1,170 | 18,195 |
| Pemanggilan alat | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 2.8 | 1.6 | 33.3% | 1 | 1.57s | 2,983 | 76 | 739 | |
| Nemotron 3.5 Lightning | 10.0 | 10.0 | 100.0% | 0 | 4.92s | 8,526 | 154 | 2,518 |
| Pengetahuan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 3.0 | 10.0 | 0.0% | 0 | 591ms | 225 | 13 | 754 | |
| Nemotron 3.5 Lightning | 3.0 | 10.0 | 0.0% | 0 | 44.02s | 207 | 1,130 | 14,597 |
Perbandingan Cepat
Ganti Pasangan Perbandingan
Mistral Small 4nonevsNemotron 3.5 LightningmediumTersedia gratisGranite 4.2 8BlowvsNemotron 3.5 LightningmediumTersedia gratisMercury 2.5 PreviewlowvsMiniMax M2.7mediumNemotron 3.5 LightningmediumTersedia gratisvsQwen3 Coder NextnoneDeepSeek V3.2nonevsMercury 2.5 PreviewlowNemotron 3.5 LightningmediumTersedia gratisvsMiMo-V2.5noneNorth Mini CodenoneTersedia gratisvsMercury 2.5 PreviewlowNemotron 3.5 LightningmediumTersedia gratisvsQwen3.5-9BnoneNemotron 3.5 LightningmediumTersedia gratisvsInklingnoneDots 3 Note PreviewnoneTersedia gratisvsNemotron 3.5 LightningmediumTersedia gratisMercury 2.5 PreviewlowvsGPT-4o-mininoneMercury 2.5 PreviewlowvsQwen3.5-9Bnone