- Peringkat
- #65
- Total token output
- 96,235
- Waktu respons (rata-rata)
- 5.12s
- Total Biaya
- $0.272
Gemini 3.5 Flash Lite (medium) vs Step 3.7 Flash (medium)
Step 3.7 Flash (medium) unggul dalam skor rata-rata dengan 7.9 vs 7.8. Gemini 3.5 Flash Lite (medium) memiliki biaya benchmark lebih rendah di $0.272 vs $0.495. Gemini 3.5 Flash Lite (medium) lebih cepat di 5.12s vs 23.51s, dengan tingkat keberhasilan 78.8% vs 68.2%.
- Peringkat
- #61
- Total token output
- 409,709
- Waktu respons (rata-rata)
- 23.51s
- Total Biaya
- $0.495
Model yang direkomendasikan
Gemini 3.5 Flash Lite (medium)
Its score stays close to the best score here (7.8 vs 7.9), while costing about 1.8x less than Step 3.7 Flash (medium).
Perbandingan terperinci
| Metrik | Gemini 3.5 Flash Lite Gemini 3.5 Flash Lite medium | Step 3.7 Flash Step 3.7 Flash medium |
|---|---|---|
| Skor | 7.8 | 7.9 |
| Peringkat | #65 | #61 |
| Keandalan | 10.0 | 10.0 |
| Konsistensi | 7.8 | 8.9 |
| Percobaan | 66/66 | 66/66 |
| Tes benar | ||
| Tingkat lulus per percobaan | 78.8% | 68.2% |
| Tes tidak stabil | 6 | 3 |
| Total Run | 66 | 66 |
| Biaya per hasil | 1.942 | 3.801 |
| Total Biaya | $0.272 | $0.495 |
| Harga input | $0.300 / 1M | $0.200 / 1M |
| Harga output | $2.500 / 1M | $1.150 / 1M |
| Total token input | 103,916 | 114,191 |
| Token output | 8,892 | 409,709 |
| Token penalaran | 87,343 | 0 |
| Waktu respons (rata-rata) | 5.12s | 23.51s |
| Waktu respons (maks) | 26.41s | 152.83s |
| Waktu respons (total) | 112.73s | 517.21s |
| Parameter | ~150B total (~10B aktif) | 198B total (11B aktif) |
| Ketersediaan | Tertutup | Sumber terbuka |
Showcase generasi model
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#65 Gemini 3.5 Flash Lite
medium- Biaya
- $0.010
- Waktu
- 17.8s
- Token
- 4,000 tok
#61 Step 3.7 Flash
medium- Biaya
- $0.006
- Waktu
- 46.2s
- Token
- 4,466 tok
Model teratas berdasarkan skor
Skor vs Total Biaya
Waktu respons (rata-rata)
Skor vs Waktu respons (rata-rata)
Total token output
Skor vs Total token output
Rincian Kategori
| Trik anti-AI | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash Lite | 10.0 | 10.0 | 100.0% | 0 | 2.11s | 504 | 150 | 5,265 | |
| Step 3.7 Flash | 8.7 | 7.9 | 91.7% | 1 | 9.65s | 756 | 32,185 | 0 |
| Pemrograman | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash Lite | 7.9 | 9.9 | 66.7% | 0 | 9.96s | 8,122 | 471 | 28,930 | |
| Step 3.7 Flash | 8.8 | 7.8 | 88.9% | 1 | 27.42s | 7,437 | 44,797 | 0 |
| Gabungan | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash Lite | 7.3 | 5.8 | 83.3% | 1 | 17.87s | 79,299 | 7,303 | 29,209 | |
| Step 3.7 Flash | 7.3 | 5.8 | 83.3% | 1 | 80.94s | 87,764 | 114,720 | 0 |
| Parsing dan ekstraksi data | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash Lite | 10.0 | 10.0 | 100.0% | 0 | 2.11s | 7,362 | 287 | 2,226 | |
| Step 3.7 Flash | 10.0 | 10.0 | 100.0% | 0 | 2.75s | 7,398 | 3,020 | 0 |
| Spesifik domain | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash Lite | 4.1 | 4.4 | 44.5% | 2 | 5.34s | 656 | 17 | 10,964 | |
| Step 3.7 Flash | 5.3 | 10.0 | 33.3% | 0 | 27.26s | 837 | 52,484 | 0 |
| Kecerdasan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash Lite | 4.7 | 3.1 | 33.3% | 1 | 2.97s | 488 | 100 | 1,558 | |
| Step 3.7 Flash | 4.0 | 10.0 | 0.0% | 0 | 6.85s | 525 | 3,987 | 0 |
| Kepatuhan instruksi | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash Lite | 9.8 | 10.0 | 100.0% | 0 | 1.72s | 625 | 69 | 2,657 | |
| Step 3.7 Flash | 9.8 | 10.0 | 100.0% | 0 | 1.83s | 735 | 2,166 | 0 |
| Pemecahan teka-teki | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash Lite | 8.2 | 7.2 | 88.9% | 1 | 1.82s | 570 | 199 | 2,988 | |
| Step 3.7 Flash | 5.7 | 9.9 | 33.3% | 0 | 6.19s | 756 | 15,071 | 0 |
| Pemanggilan alat | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash Lite | 10.0 | 10.0 | 100.0% | 0 | 2.84s | 6,132 | 287 | 1,277 | |
| Step 3.7 Flash | 10.0 | 10.0 | 100.0% | 0 | 4.16s | 7,746 | 2,115 | 0 |
| Pengetahuan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash Lite | 2.8 | 1.6 | 33.3% | 1 | 3.75s | 158 | 9 | 2,269 | |
| Step 3.7 Flash | 3.0 | 10.0 | 0.0% | 0 | 113.98s | 237 | 139,164 | 0 |
Perbandingan Cepat
Ganti Pasangan Perbandingan
GPT-5.2 ChatnonevsStep 3.7 FlashmediumKimi K3maxvsStep 3.7 FlashmediumQwen3.8 27BlowvsStep 3.7 FlashmediumGPT-5.6 TerrahighvsStep 3.7 FlashmediumGemini 3.5 Flash LitemediumvsQwen3.8 27BlowGemini 3.5 Flash LitemediumvsGPT-5.2 ChatnoneStep 3.7 FlashmediumvsGLM 5.2highGemini 3.5 Flash LitemediumvsKimi K3maxClaude Opus 4.8lowvsGemini 3.5 Flash LitemediumGemini 3.5 Flash LitemediumvsQwen3.7 FlashhighDeepSeek V4 Flash 0731highvsStep 3.7 FlashmediumDeepSeek V4 Flash 0731lowvsStep 3.7 Flashmedium