- Peringkat
- #391
- Total token output
- 40,302
- Waktu respons (rata-rata)
- 3.34s
- Total Biaya
- $0.020
Mercury 2.5 (low) vs Nemotron 3.5 Lightning (high)
Nemotron 3.5 Lightning (high) unggul dalam skor rata-rata dengan 5.2 vs 5.1. Mercury 2.5 (low) memiliki biaya benchmark lebih rendah di $0.020 vs $0.168. Mercury 2.5 (low) lebih cepat di 3.34s vs 77.08s, dengan tingkat keberhasilan 37.7% vs 47.8%.
Model yang Dibandingkan
- Peringkat
- #385
- Total token output
- 626,081
- Waktu respons (rata-rata)
- 77.08s
- Total Biaya
- $0.168
Model yang direkomendasikan
Mercury 2.5 (low)
Its score stays close to the best score here (5.1 vs 5.2), while costing about 8.8x less than Nemotron 3.5 Lightning (high).
Perbandingan terperinci
| Metrik | Mercury 2.5 Mercury 2.5 low | Nemotron 3.5 Lightning Nemotron 3.5 Lightning high Tersedia gratis |
|---|---|---|
| Skor | 5.1 | 5.2 |
| Peringkat | #391 | #385 |
| Keandalan | 9.8 | 9.6 |
| Konsistensi | 8.2 | 5.7 |
| Percobaan | 69/69 | 69/69 |
| Tes benar | ||
| Tingkat lulus per percobaan | 37.7% | 47.8% |
| Tes tidak stabil | 5 | 12 |
| Total Run | 69 | 69 |
| Biaya per hasil | 0.319 | 0.000 |
| Total Biaya | $0.020 | $0.168 |
| Harga input | $0.040 / 1M | $0.060 / 1M |
| Harga output | $0.150 / 1M | $0.160 / 1M |
| Harga baca cache | $0.004 / 1M | $0.030 / 1M |
| Harga tulis cache | T/A | T/A |
| Total token input | 326,083 | 170,517 |
| Token output | 7,224 | 149,968 |
| Token penalaran | 33,078 | 509,725 |
| Waktu respons (rata-rata) | 3.34s | 77.08s |
| Waktu respons (maks) | 47.06s | 490.99s |
| Waktu respons (total) | 76.80s | 1772.78s |
| Parameter | ~100B | 30B total (3B aktif) |
| Ketersediaan | Tertutup | Bobot tersedia |
Harga cache berlaku untuk token input. Pembacaan memakai kembali prompt tersimpan; penulisan menyimpannya dan dapat menambah biaya. Token output menggunakan harga output.
Showcase generasi model
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#391 Mercury 2.5
low- Biaya
- $0.001
- Waktu
- 2.4s
- Token
- 1,236 tok
#385 Nemotron 3.5 Lightning
high- Biaya
- $0.000
- Waktu
- 92.8s
- Token
- 11,343 tok
Rincian Kategori
| Tugas agen | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 | 5.0 | 10.0 | 0.0% | 0 | 47.06s | 188,063 | 1,141 | 5,442 | |
| Nemotron 3.5 Lightning | 3.5 | 8.3 | 0.0% | 0 | 490.99s | 52,501 | 1,624 | 3,472 |
| Trik anti-AI | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 | 6.9 | 7.9 | 66.7% | 1 | 799ms | 772 | 209 | 2,969 | |
| Nemotron 3.5 Lightning | 5.5 | 3.7 | 66.7% | 3 | 10.29s | 696 | 2,432 | 15,948 |
| Pemrograman | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 | 5.5 | 10.0 | 33.3% | 0 | 972ms | 7,909 | 521 | 2,269 | |
| Nemotron 3.5 Lightning | 4.4 | 5.1 | 33.3% | 2 | 168.41s | 7,623 | 68,533 | 242,319 |
| Gabungan | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 | 3.0 | 10.0 | 0.0% | 0 | 5.16s | 107,683 | 3,750 | 11,351 | |
| Nemotron 3.5 Lightning | 6.4 | 10.0 | 50.0% | 0 | 160.45s | 90,257 | 17,550 | 119,725 |
| Parsing dan ekstraksi data | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 | 6.5 | 10.0 | 50.0% | 0 | 1.06s | 8,322 | 739 | 1,499 | |
| Nemotron 3.5 Lightning | 7.3 | 5.9 | 83.3% | 1 | 13.99s | 7,944 | 3,210 | 16,835 |
| Spesifik domain | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 | 3.6 | 7.2 | 22.2% | 1 | 846ms | 851 | 57 | 2,265 | |
| Nemotron 3.5 Lightning | 2.9 | 4.4 | 22.2% | 2 | 88.61s | 798 | 45,616 | 72,496 |
| Kecerdasan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 | 4.4 | 9.9 | 0.0% | 0 | 819ms | 525 | 99 | 748 | |
| Nemotron 3.5 Lightning | 3.7 | 9.5 | 0.0% | 0 | 7.58s | 516 | 4,331 | 4,408 |
| Kepatuhan instruksi | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 | 2.9 | 6.0 | 16.7% | 1 | 972ms | 518 | 48 | 1,026 | |
| Nemotron 3.5 Lightning | 8.5 | 6.8 | 83.3% | 1 | 4.98s | 723 | 502 | 3,779 |
| Pemecahan teka-teki | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 | 5.9 | 4.5 | 66.7% | 2 | 792ms | 768 | 249 | 2,214 | |
| Nemotron 3.5 Lightning | 3.6 | 1.8 | 44.4% | 3 | 6.09s | 726 | 1,236 | 9,851 |
| Pemanggilan alat | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 | 9.8 | 10.0 | 100.0% | 0 | 2.72s | 10,440 | 388 | 2,537 | |
| Nemotron 3.5 Lightning | 10.0 | 10.0 | 100.0% | 0 | 6.92s | 8,526 | 3,745 | 3,781 |
| Pengetahuan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 | 3.0 | 10.0 | 0.0% | 0 | 782ms | 232 | 23 | 758 | |
| Nemotron 3.5 Lightning | 3.0 | 10.0 | 0.0% | 0 | 77.98s | 207 | 1,189 | 17,111 |
Perbandingan Cepat
Ganti Pasangan Perbandingan
Mercury 2.5lowvsKAT Coder AIR V2.5mediumMercury 2.5lowvsMiMo-V2.5-PrononeLing 3.0 FlashnonevsNemotron 3.5 LightninghighTersedia gratisMercury 2.5lowvsMistral Small 4noneMercury 2.5lowvsMistral Small 4mediumNemotron 3.5 LightninghighTersedia gratisvsInkling SmalllowTersedia gratisApodex 1.1 MinidefaultTersedia gratisvsMercury 2.5lowMistral Small 4mediumvsNemotron 3.5 LightninghighTersedia gratisMercury 2.5lowvsLaguna S 2.1mediumTersedia gratisMistral Small 4nonevsNemotron 3.5 LightninghighTersedia gratisMercury 2.5lowvsKAT Coder AIR V2.5highNemotron 3.5 LightninghighTersedia gratisvsQwen3.6 35B A3Bnone