- Peringkat
- #101
- Total token output
- 96,655
- Waktu respons (rata-rata)
- 11.78s
- Total Biaya
- $1.316
Gemini 3.5 Flash (medium) vs Step 3.7 Flash (medium)
Gemini 3.5 Flash (medium) unggul dalam skor rata-rata dengan 7.9 vs 7.8. Step 3.7 Flash (medium) memiliki biaya benchmark lebih rendah di $0.571 vs $1.316. Gemini 3.5 Flash (medium) lebih cepat di 11.78s vs 26.57s, dengan tingkat keberhasilan 81.2% vs 68.1%.
Model yang Dibandingkan
- Peringkat
- #106
- Total token output
- 440,835
- Waktu respons (rata-rata)
- 26.57s
- Total Biaya
- $0.571
Model yang direkomendasikan
Step 3.7 Flash (medium)
Its score stays close to the best score here (7.8 vs 7.9), while costing about 2.3x less than Gemini 3.5 Flash (medium).
Perbandingan terperinci
| Metrik | Gemini 3.5 Flash Gemini 3.5 Flash medium | Step 3.7 Flash Step 3.7 Flash medium |
|---|---|---|
| Skor | 7.9 | 7.8 |
| Peringkat | #101 | #106 |
| Keandalan | 10.0 | 10.0 |
| Konsistensi | 9.3 | 8.7 |
| Percobaan | 69/69 | 69/69 |
| Tes benar | ||
| Tingkat lulus per percobaan | 81.2% | 68.1% |
| Tes tidak stabil | 2 | 4 |
| Total Run | 69 | 69 |
| Biaya per hasil | 7.306 | 4.392 |
| Total Biaya | $1.316 | $0.571 |
| Harga input | $1.500 / 1M | $0.200 / 1M |
| Harga output | $9.000 / 1M | $1.150 / 1M |
| Harga baca cache | $0.150 / 1M | $0.040 / 1M |
| Harga tulis cache | $0.084 / 1M | T/A |
| Total token input | 296,760 | 319,524 |
| Token output | 4,371 | 440,835 |
| Token penalaran | 92,284 | 0 |
| Waktu respons (rata-rata) | 11.78s | 26.57s |
| Waktu respons (maks) | 84.47s | 152.83s |
| Waktu respons (total) | 271.03s | 611.09s |
| Parameter | ~500B total (~20B aktif) | 198B total (11B aktif) |
| Ketersediaan | Tertutup | Sumber terbuka |
Harga cache berlaku untuk token input. Pembacaan memakai kembali prompt tersimpan; penulisan menyimpannya dan dapat menambah biaya. Token output menggunakan harga output.
Showcase generasi model
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#101 Gemini 3.5 Flash
medium- Biaya
- $0.201
- Waktu
- 112.9s
- Token
- 22,371 tok
#106 Step 3.7 Flash
medium- Biaya
- $0.006
- Waktu
- 46.2s
- Token
- 4,466 tok
Model teratas berdasarkan skor
Skor vs Total Biaya
Waktu respons (rata-rata)
Skor vs Waktu respons (rata-rata)
Total token output
Skor vs Total token output
Rincian Kategori
| Tugas agen | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash | 2.8 | 1.6 | 33.3% | 1 | 84.47s | 227,004 | 2,205 | 32,277 | |
| Step 3.7 Flash | 7.4 | 3.8 | 66.7% | 1 | 93.88s | 205,333 | 31,126 | 0 |
| Trik anti-AI | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash | 10.0 | 10.0 | 100.0% | 0 | 2.09s | 492 | 171 | 3,385 | |
| Step 3.7 Flash | 8.7 | 7.9 | 91.7% | 1 | 9.65s | 756 | 32,185 | 0 |
| Pemrograman | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash | 7.9 | 7.5 | 77.8% | 1 | 12.63s | 8,118 | 461 | 24,939 | |
| Step 3.7 Flash | 8.8 | 7.8 | 88.9% | 1 | 27.42s | 7,437 | 44,797 | 0 |
| Gabungan | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash | 10.0 | 10.0 | 100.0% | 0 | 44.36s | 45,684 | 516 | 8,835 | |
| Step 3.7 Flash | 7.3 | 5.8 | 83.3% | 1 | 80.94s | 87,764 | 114,720 | 0 |
| Parsing dan ekstraksi data | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash | 10.0 | 10.0 | 100.0% | 0 | 4.07s | 7,548 | 279 | 3,784 | |
| Step 3.7 Flash | 10.0 | 10.0 | 100.0% | 0 | 2.75s | 7,398 | 3,020 | 0 |
| Spesifik domain | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash | 5.3 | 10.0 | 33.3% | 0 | 7.28s | 642 | 12 | 10,618 | |
| Step 3.7 Flash | 5.3 | 10.0 | 33.3% | 0 | 27.26s | 837 | 52,484 | 0 |
| Kecerdasan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash | 10.0 | 10.0 | 100.0% | 0 | 2.52s | 486 | 115 | 1,144 | |
| Step 3.7 Flash | 4.0 | 10.0 | 0.0% | 0 | 6.85s | 525 | 3,987 | 0 |
| Kepatuhan instruksi | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash | 9.9 | 10.0 | 100.0% | 0 | 2.70s | 615 | 71 | 2,855 | |
| Step 3.7 Flash | 9.8 | 10.0 | 100.0% | 0 | 1.83s | 735 | 2,166 | 0 |
| Pemecahan teka-teki | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash | 7.7 | 10.0 | 66.7% | 0 | 2.38s | 558 | 295 | 2,747 | |
| Step 3.7 Flash | 5.7 | 9.9 | 33.3% | 0 | 6.19s | 756 | 15,071 | 0 |
| Pemanggilan alat | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash | 10.0 | 10.0 | 100.0% | 0 | 3.81s | 5,457 | 234 | 455 | |
| Step 3.7 Flash | 10.0 | 10.0 | 100.0% | 0 | 4.16s | 7,746 | 2,115 | 0 |
| Pengetahuan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash | 10.0 | 10.0 | 100.0% | 0 | 2.75s | 156 | 12 | 1,245 | |
| Step 3.7 Flash | 3.0 | 10.0 | 0.0% | 0 | 113.98s | 237 | 139,164 | 0 |
Perbandingan Cepat
Ganti Pasangan Perbandingan
Gemini 3.5 FlashmediumvsQwen3.8 2.4T A95BhighStep 3.7 FlashmediumvsGLM 5.3highQwen3.7 PlusnonevsStep 3.7 FlashmediumGemini 3.5 FlashmediumvsQwen3.7 MaxnoneStep 3.7 FlashmediumvsGrok 4.5lowGemini 3.5 FlashmediumvsGLM 5.3highClaude Fable 5.1highvsGemini 3.5 FlashmediumQwen3.8 2.4T A95BhighvsStep 3.7 FlashmediumGemini 3.5 FlashmediumvsGLM 5.3 FlashXmaxGemini 3.5 FlashmediumvsGPT-5.6 TerralowGemini 3.5 FlashmediumvsQwen3.7 PlusnoneQwen3.7 MaxnonevsStep 3.7 Flashmedium