- Peringkat
- #149
- Total token output
- 31,386
- Waktu respons (rata-rata)
- 10.78s
- Total Biaya
- $2.766
Claude Opus 5 vs Step 3.7 Flash (low)
Skor rata-rata hampir imbang di 7.1 vs 7.2. Step 3.7 Flash (low) memiliki biaya benchmark lebih rendah di $0.449 vs $2.766. Claude Opus 5 lebih cepat di 10.78s vs 20.72s, dengan tingkat keberhasilan 55.1% vs 63.8%.
Model yang Dibandingkan
- Peringkat
- #147
- Total token output
- 339,108
- Waktu respons (rata-rata)
- 20.72s
- Total Biaya
- $0.449
Model yang direkomendasikan
Step 3.7 Flash (low)
It has the best score here (7.2), while costing about 6.2x less than Claude Opus 5.
Perbandingan terperinci
| Metrik | Claude Opus 5 Claude Opus 5 none | Step 3.7 Flash Step 3.7 Flash low |
|---|---|---|
| Skor | 7.1 | 7.2 |
| Peringkat | #149 | #147 |
| Keandalan | 10.0 | 10.0 |
| Konsistensi | 9.6 | 7.9 |
| Percobaan | 69/69 | 69/69 |
| Tes benar | ||
| Tingkat lulus per percobaan | 55.1% | 63.8% |
| Tes tidak stabil | 1 | 6 |
| Total Run | 69 | 69 |
| Biaya per hasil | 23.044 | 4.078 |
| Total Biaya | $2.766 | $0.449 |
| Harga input | $5.000 / 1M | $0.200 / 1M |
| Harga output | $25.000 / 1M | $1.150 / 1M |
| Total token input | 396,120 | 292,685 |
| Token output | 31,386 | 339,108 |
| Token penalaran | 0 | 0 |
| Waktu respons (rata-rata) | 10.78s | 20.72s |
| Waktu respons (maks) | 79.61s | 124.75s |
| Waktu respons (total) | 247.96s | 476.67s |
| Parameter | ~5T total (~500B aktif) | 198B total (11B aktif) |
| Ketersediaan | Tertutup | Sumber terbuka |
Showcase generasi model
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#149 Claude Opus 5
none- Biaya
- $0.271
- Waktu
- 149.3s
- Token
- 10,962 tok
#147 Step 3.7 Flash
low
SVG tidak valid
- Biaya
- $0.004
- Waktu
- 25.3s
- Token
- 3,072 tok
Model teratas berdasarkan skor
Skor vs Total Biaya
Waktu respons (rata-rata)
Skor vs Waktu respons (rata-rata)
Total token output
Skor vs Total token output
Rincian Kategori
| Tugas agen | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 5 | 5.4 | 9.6 | 0.0% | 0 | 79.61s | 210,573 | 6,520 | 0 | |
| Step 3.7 Flash | 7.4 | 3.8 | 66.7% | 1 | 83.63s | 188,843 | 18,715 | 0 |
| Trik anti-AI | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 5 | 5.5 | 8.3 | 41.7% | 1 | 4.33s | 834 | 1,398 | 0 | |
| Step 3.7 Flash | 8.7 | 7.9 | 91.7% | 1 | 4.02s | 756 | 10,896 | 0 |
| Pemrograman | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 5 | 5.9 | 9.7 | 33.3% | 0 | 5.54s | 10,590 | 2,886 | 0 | |
| Step 3.7 Flash | 8.2 | 7.2 | 88.9% | 1 | 9.46s | 7,437 | 18,685 | 0 |
| Gabungan | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 5 | 8.3 | 10.0 | 50.0% | 0 | 30.54s | 148,140 | 13,011 | 0 | |
| Step 3.7 Flash | 7.3 | 5.8 | 83.3% | 1 | 66.18s | 77,415 | 93,682 | 0 |
| Parsing dan ekstraksi data | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 5 | 10.0 | 10.0 | 100.0% | 0 | 3.88s | 10,503 | 309 | 0 | |
| Step 3.7 Flash | 7.3 | 5.8 | 83.3% | 1 | 2.29s | 7,398 | 2,667 | 0 |
| Spesifik domain | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 5 | 5.3 | 10.0 | 33.3% | 0 | 11.10s | 972 | 5,440 | 0 | |
| Step 3.7 Flash | 2.9 | 7.2 | 11.1% | 1 | 22.65s | 837 | 48,299 | 0 |
| Kecerdasan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 5 | 10.0 | 10.0 | 100.0% | 0 | 3.70s | 708 | 316 | 0 | |
| Step 3.7 Flash | 3.4 | 9.3 | 0.0% | 0 | 7.00s | 525 | 4,604 | 0 |
| Kepatuhan instruksi | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 5 | 10.0 | 10.0 | 100.0% | 0 | 2.81s | 909 | 99 | 0 | |
| Step 3.7 Flash | 9.8 | 10.0 | 100.0% | 0 | 1.58s | 735 | 1,857 | 0 |
| Pemecahan teka-teki | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 5 | 7.7 | 10.0 | 66.7% | 0 | 3.66s | 894 | 874 | 0 | |
| Step 3.7 Flash | 5.5 | 9.9 | 33.3% | 0 | 1.84s | 756 | 3,564 | 0 |
| Pemanggilan alat | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 5 | 10.0 | 10.0 | 100.0% | 0 | 7.89s | 11,739 | 355 | 0 | |
| Step 3.7 Flash | 10.0 | 10.0 | 100.0% | 0 | 3.25s | 7,746 | 1,360 | 0 |
| Pengetahuan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 5 | 3.0 | 10.0 | 0.0% | 0 | 4.08s | 258 | 178 | 0 | |
| Step 3.7 Flash | 3.0 | 10.0 | 0.0% | 0 | 124.75s | 237 | 134,779 | 0 |
Perbandingan Cepat
Ganti Pasangan Perbandingan
Step 3.7 FlashlowvsGLM 5mediumLongCat 2.0mediumvsStep 3.7 FlashlowQwen3.6 27BmediumvsStep 3.7 FlashlowClaude Opus 5nonevsQwen3.6 27BmediumQwen3.7 FlashhighvsStep 3.7 FlashlowClaude Opus 5nonevsGLM 5mediumClaude Opus 5nonevsLongCat 2.0mediumQwen3.8 27BmediumTersedia gratisvsStep 3.7 FlashlowClaude Opus 5nonevsQwen3.7 FlashhighQwen3.5 Plus 2026-02-15mediumvsStep 3.7 FlashlowClaude Opus 5nonevsGemini 3.8 FlashlowClaude Opus 5nonevsQwen3.8 27BmediumTersedia gratis