- Peringkat
- #101
- Total token output
- 83,041
- Waktu respons (rata-rata)
- 14.98s
- Total Biaya
- $1.516
Claude Sonnet 5.5 (xhigh) vs Gemini 3.7 Flash (low)
Gemini 3.7 Flash (low) unggul dalam skor rata-rata dengan 9.4 vs 8.6. Gemini 3.7 Flash (low) memiliki biaya benchmark lebih rendah di $0.183 vs $1.516. Gemini 3.7 Flash (low) lebih cepat di 6.24s vs 14.98s, dengan tingkat keberhasilan 79.7% vs 95.7%.
Model yang Dibandingkan
- Peringkat
- #30
- Total token output
- 38,453
- Waktu respons (rata-rata)
- 6.24s
- Total Biaya
- $0.183
Model yang direkomendasikan
Gemini 3.7 Flash (low)
It has the best score here (9.4), while costing about 8.3x less than Claude Sonnet 5.5 (xhigh).
Perbandingan terperinci
| Metrik | Claude Sonnet 5.5 Claude Sonnet 5.5 xhigh | Gemini 3.7 Flash Gemini 3.7 Flash low |
|---|---|---|
| Skor | 8.6 | 9.4 |
| Peringkat | #101 | #30 |
| Keandalan | 10.0 | 10.0 |
| Konsistensi | 8.7 | 9.3 |
| Percobaan | 69/69 | 69/69 |
| Tes benar | ||
| Tingkat lulus per percobaan | 79.7% | 95.7% |
| Tes tidak stabil | 4 | 2 |
| Total Run | 69 | 69 |
| Biaya per hasil | 9.473 | 0.868 |
| Total Biaya | $1.516 | $0.183 |
| Harga input | $2.000 / 1M | $0.750 / 1M |
| Harga output | $10.000 / 1M | $3.750 / 1M |
| Harga baca cache | $0.200 / 1M | $0.075 / 1M |
| Harga tulis cache | $2.500 / 1M | $0.042 / 1M |
| Total token input | 342,579 | 188,519 |
| Token output | 12,848 | 7,694 |
| Token penalaran | 70,193 | 30,759 |
| Waktu respons (rata-rata) | 14.98s | 6.24s |
| Waktu respons (maks) | 54.92s | 58.75s |
| Waktu respons (total) | 344.60s | 143.56s |
| Parameter | ~1T total (~100B aktif) | ~500B total (~20B aktif) |
| Ketersediaan | Tertutup | Tertutup |
Harga cache berlaku untuk token input. Pembacaan memakai kembali prompt tersimpan; penulisan menyimpannya dan dapat menambah biaya. Token output menggunakan harga output.
Showcase generasi model
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#101 Claude Sonnet 5.5
xhigh- Biaya
- $0.319
- Waktu
- 258.6s
- Token
- 31,969 tok
#30 Gemini 3.7 Flash
low- Biaya
- $0.010
- Waktu
- 23.5s
- Token
- 5,210 tok
Rincian Kategori
| Tugas agen | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 10.0 | 10.0 | 100.0% | 0 | 54.92s | 193,936 | 3,148 | 2,788 | |
| Gemini 3.7 Flash | 10.0 | 10.0 | 100.0% | 0 | 58.75s | 98,197 | 1,400 | 0 |
| Trik anti-AI | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 10.0 | 10.0 | 100.0% | 0 | 4.21s | 858 | 417 | 1,162 | |
| Gemini 3.7 Flash | 10.0 | 10.0 | 100.0% | 0 | 1.54s | 492 | 99 | 1,398 |
| Pemrograman | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 8.2 | 7.2 | 88.9% | 1 | 11.90s | 10,608 | 555 | 9,501 | |
| Gemini 3.7 Flash | 7.6 | 7.2 | 77.8% | 1 | 6.20s | 8,118 | 461 | 11,508 |
| Gabungan | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 8.7 | 6.9 | 83.3% | 1 | 30.37s | 111,104 | 6,732 | 10,690 | |
| Gemini 3.7 Flash | 10.0 | 10.0 | 100.0% | 0 | 13.00s | 66,250 | 4,873 | 8,108 |
| Parsing dan ekstraksi data | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 10.0 | 10.0 | 100.0% | 0 | 4.96s | 10,515 | 312 | 1,590 | |
| Gemini 3.7 Flash | 10.0 | 10.0 | 100.0% | 0 | 2.15s | 7,548 | 278 | 1,093 |
| Spesifik domain | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 2.9 | 7.2 | 11.1% | 1 | 35.33s | 990 | 56 | 34,319 | |
| Gemini 3.7 Flash | 8.2 | 7.2 | 88.9% | 1 | 3.09s | 642 | 12 | 3,029 |
| Kecerdasan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 6.5 | 3.4 | 66.7% | 1 | 9.10s | 714 | 279 | 2,152 | |
| Gemini 3.7 Flash | 10.0 | 10.0 | 100.0% | 0 | 2.76s | 486 | 81 | 1,043 |
| Kepatuhan instruksi | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 10.0 | 10.0 | 100.0% | 0 | 4.58s | 921 | 98 | 661 | |
| Gemini 3.7 Flash | 10.0 | 10.0 | 100.0% | 0 | 2.47s | 615 | 72 | 1,778 |
| Pemecahan teka-teki | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 10.0 | 10.0 | 100.0% | 0 | 4.88s | 912 | 716 | 1,402 | |
| Gemini 3.7 Flash | 10.0 | 10.0 | 100.0% | 0 | 1.92s | 558 | 166 | 1,580 |
| Pemanggilan alat | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 10.0 | 10.0 | 100.0% | 0 | 10.29s | 11,757 | 354 | 1,112 | |
| Gemini 3.7 Flash | 10.0 | 10.0 | 100.0% | 0 | 4.10s | 5,457 | 241 | 160 |
| Pengetahuan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 3.0 | 10.0 | 0.0% | 0 | 17.31s | 264 | 181 | 4,816 | |
| Gemini 3.7 Flash | 10.0 | 10.0 | 100.0% | 0 | 2.92s | 156 | 11 | 1,062 |
Perbandingan Cepat
Ganti Pasangan Perbandingan
Claude Opus 5highvsGemini 3.7 FlashlowClaude Opus 5mediumvsGemini 3.7 FlashlowGemini 3.7 FlashlowvsGPT-6.1 TerraxhighClaude Opus 5.5highvsGemini 3.7 FlashlowGemini 3.7 FlashlowvsGPT-6.1 TerramaxGemini 3.7 FlashlowvsGPT-5.6 SolhighGemini 3.7 FlashlowvsGPT-6 AstramediumGemini 3.7 FlashlowvsGPT-6.1 TerrahighGemini 3.7 FlashlowvsGPT-5.6 SolmediumGemini 3.7 FlashlowvsGPT-6 SolmediumGemini 3.7 FlashlowvsMuse EmberhighGemini 3.7 FlashlowvsMuse Spark Openhigh