- Peringkat
- #182
- Total token output
- 59,534
- Waktu respons (rata-rata)
- 6.78s
- Total Biaya
- $0.158
Gemini 3.1 Flash Lite Preview (medium) vs Mercury 2.5 Preview (medium)
Gemini 3.1 Flash Lite Preview (medium) unggul dalam skor rata-rata dengan 7.0 vs 6.8. Mercury 2.5 Preview (medium) memiliki biaya benchmark lebih rendah di $0.039 vs $0.158. Mercury 2.5 Preview (medium) lebih cepat di 6.66s vs 6.78s, dengan tingkat keberhasilan 60.9% vs 66.7%.
Model yang Dibandingkan
- Peringkat
- #199
- Total token output
- 150,107
- Waktu respons (rata-rata)
- 6.66s
- Total Biaya
- $0.039
Model yang direkomendasikan
Mercury 2.5 Preview (medium)
Its score stays close to the best score here (6.8 vs 7.0), while costing about 4.1x less than Gemini 3.1 Flash Lite Preview (medium).
Perbandingan terperinci
| Metrik | Gemini 3.1 Flash Lite Preview Gemini 3.1 Flash Lite Preview medium | Mercury 2.5 Preview Mercury 2.5 Preview medium |
|---|---|---|
| Skor | 7.0 | 6.8 |
| Peringkat | #182 | #199 |
| Keandalan | 10.0 | 10.0 |
| Konsistensi | 9.9 | 9.6 |
| Percobaan | 69/69 | 69/69 |
| Tes benar | ||
| Tingkat lulus per percobaan | 60.9% | 66.7% |
| Tes tidak stabil | 0 | 1 |
| Total Run | 69 | 69 |
| Biaya per hasil | 1.124 | 0.244 |
| Total Biaya | $0.158 | $0.039 |
| Harga input | $0.250 / 1M | $0.040 / 1M |
| Harga output | $1.500 / 1M | $0.150 / 1M |
| Harga baca cache | $0.025 / 1M | T/A |
| Harga tulis cache | $0.084 / 1M | T/A |
| Total token input | 272,221 | 397,291 |
| Token output | 12,345 | 6,355 |
| Token penalaran | 47,189 | 143,752 |
| Waktu respons (rata-rata) | 6.78s | 6.66s |
| Waktu respons (maks) | 54.91s | 74.63s |
| Waktu respons (total) | 155.96s | 153.29s |
| Parameter | ~150B total (~10B aktif) | ~100B |
| Ketersediaan | Tertutup | Tertutup |
Harga cache berlaku untuk token input. Pembacaan memakai kembali prompt tersimpan; penulisan menyimpannya dan dapat menambah biaya. Token output menggunakan harga output.
Showcase generasi model
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#182 Gemini 3.1 Flash Lite Preview
medium- Biaya
- $0.003
- Waktu
- 5.2s
- Token
- 1,944 tok
#199 Mercury 2.5 Preview
medium- Biaya
- $0.001
- Waktu
- 2.7s
- Token
- 2,241 tok
Rincian Kategori
| Tugas agen | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.1 Flash Lite Preview | 5.0 | 10.0 | 0.0% | 0 | 54.91s | 154,728 | 1,756 | 0 | |
| Mercury 2.5 Preview | 3.9 | 9.6 | 0.0% | 0 | 74.63s | 284,578 | 919 | 22,154 |
| Trik anti-AI | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.1 Flash Lite Preview | 9.1 | 10.0 | 75.0% | 0 | 2.33s | 512 | 570 | 4,305 | |
| Mercury 2.5 Preview | 10.0 | 10.0 | 100.0% | 0 | 1.43s | 781 | 203 | 7,921 |
| Pemrograman | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.1 Flash Lite Preview | 5.5 | 10.0 | 33.3% | 0 | 4.09s | 8,126 | 461 | 8,597 | |
| Mercury 2.5 Preview | 7.8 | 10.0 | 66.7% | 0 | 3.86s | 7,839 | 552 | 22,126 |
| Gabungan | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.1 Flash Lite Preview | 7.2 | 9.1 | 50.0% | 0 | 16.63s | 93,097 | 8,706 | 16,997 | |
| Mercury 2.5 Preview | 6.5 | 10.0 | 50.0% | 0 | 13.86s | 92,663 | 3,607 | 41,588 |
| Parsing dan ekstraksi data | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.1 Flash Lite Preview | 10.0 | 10.0 | 100.0% | 0 | 2.29s | 7,362 | 279 | 2,952 | |
| Mercury 2.5 Preview | 10.0 | 10.0 | 100.0% | 0 | 2.77s | 8,292 | 514 | 11,354 |
| Spesifik domain | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.1 Flash Lite Preview | 5.3 | 10.0 | 33.3% | 0 | 4.09s | 652 | 18 | 6,120 | |
| Mercury 2.5 Preview | 5.3 | 7.2 | 44.4% | 1 | 3.72s | 853 | 62 | 17,120 |
| Kecerdasan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.1 Flash Lite Preview | 10.0 | 10.0 | 100.0% | 0 | 3.16s | 488 | 96 | 1,488 | |
| Mercury 2.5 Preview | 5.0 | 10.0 | 0.0% | 0 | 2.09s | 538 | 99 | 3,375 |
| Kepatuhan instruksi | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.1 Flash Lite Preview | 10.0 | 10.0 | 100.0% | 0 | 1.91s | 621 | 72 | 2,121 | |
| Mercury 2.5 Preview | 9.8 | 10.0 | 100.0% | 0 | 1.35s | 744 | 96 | 3,987 |
| Pemecahan teka-teki | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.1 Flash Lite Preview | 7.7 | 10.0 | 66.7% | 0 | 5.30s | 566 | 141 | 1,896 | |
| Mercury 2.5 Preview | 10.0 | 10.0 | 100.0% | 0 | 1.87s | 771 | 274 | 7,323 |
| Pemanggilan alat | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.1 Flash Lite Preview | 10.0 | 10.0 | 100.0% | 0 | 3.80s | 5,909 | 234 | 912 | |
| Mercury 2.5 Preview | 3.0 | 10.0 | 0.0% | 0 | 2.37s | 0 | 0 | 0 |
| Pengetahuan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.1 Flash Lite Preview | 3.0 | 10.0 | 0.0% | 0 | 2.68s | 160 | 12 | 1,801 | |
| Mercury 2.5 Preview | 3.0 | 10.0 | 0.0% | 0 | 4.13s | 232 | 29 | 6,804 |
Perbandingan Cepat
Ganti Pasangan Perbandingan
Mercury 2.5 PreviewmediumvsInklinglowTersedia gratisMercury 2.5 PreviewmediumvsGPT-6 SolnoneGemini 3.1 Flash Lite PreviewmediumvsGPT-5.2 ChatdefaultEmber-1lowvsGemini 3.1 Flash Lite PreviewmediumGemini 3.1 Flash Lite PreviewmediumvsStep 5 PreviewhighClaude Opus 4.8nonevsMercury 2.5 PreviewmediumClaude Sonnet 5.5lowvsMercury 2.5 PreviewmediumMercury 2.5 PreviewmediumvsGPT-5.6 LunalowGemini 3.1 Flash Lite PreviewmediumvsGrok 4.6lowGemini 3.1 Flash Lite PreviewmediumvsMuse Glimmer 30BlowGemini 3.1 Flash Lite PreviewmediumvsMiMo-V2.6-FlashlowEmber-1highvsMercury 2.5 Previewmedium