#40 Claude Sonnet 4.6
medium
SVG tidak valid
- Biaya
- $0.000
- Waktu
- 300.0s
- Token
- 0 tok
AI BENCHY Compare
Anthropic: Claude Sonnet 4.6 vs StepFun: Step 3.7 Flash
Ringkasan
Claude Sonnet 4.6 (medium) unggul dalam skor rata-rata dengan 7.8 vs 7.7. Step 3.7 Flash (low) memiliki biaya benchmark lebih rendah di $0.341 vs $1.418. Step 3.7 Flash (low) lebih cepat di 15.74s vs 17.06s, dengan tingkat keberhasilan 65.1% vs 68.3%.
Model yang direkomendasikanStep 3.7 Flash (low)Its score stays close to the best score here (7.7 vs 7.8), while costing about 4.2x less than Claude Sonnet 4.6 (medium).
Benchmark dihasilkan dari suite pengujian AI BENCHY pada: 2026-07-14
| Metrik | Claude Sonnet 4.6 Claude Sonnet 4.6 medium | Step 3.7 Flash Step 3.7 Flash low |
|---|---|---|
| Skor | 7.8 | 7.7 |
| Peringkat | #40 | #51 |
| Keandalan | 10.0 | 10.0 |
| Konsistensi | 9.1 | 8.4 |
| Tes benar | ||
| Tingkat lulus per percobaan | 65.1% | 68.3% |
| Tes tidak stabil | 2 | 4 |
| Total Run | 63 | 63 |
| Biaya per hasil | 10.904 | 2.840 |
| Total Biaya | $1.418 | $0.341 |
| Harga input | $3.000 / 1M | $0.200 / 1M |
| Harga output | $15.000 / 1M | $1.150 / 1M |
| Total token input | 49,112 | 40,101 |
| Token output | 54,703 | 289,325 |
| Token penalaran | 29,970 | 0 |
| Waktu respons (rata-rata) | 17.06s | 15.74s |
| Waktu respons (maks) | 46.35s | 124.75s |
| Waktu respons (total) | 221.83s | 330.63s |
Showcase generasi
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#51 Step 3.7 Flash
low
SVG tidak valid
- Biaya
- $0.004
- Waktu
- 25.3s
- Token
- 3,072 tok
Model teratas berdasarkan skor
Skor vs Total Biaya
Waktu respons (rata-rata)
Skor vs Waktu respons (rata-rata)
Total token output
Skor vs Total token output
Rincian Kategori
| Pemrograman | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 4.6 | 5.7 | 6.6 | 44.4% | 1 | 33.29s | 6,995 | 16,089 | 3,686 | |
| Step 3.7 Flash | 8.2 | 7.2 | 88.9% | 1 | 9.46s | 7,437 | 18,685 | 0 |
Perbandingan Cepat
Ganti Pasangan Perbandingan
GPT-5.6 LunahighvsStep 3.7 FlashlowClaude Opus 4.6mediumvsStep 3.7 FlashlowClaude Sonnet 4.6mediumvsGrok 4.5lowStep 3.7 FlashlowvsGrok 4.3mediumKAT-Coder-Pro V2.5highvsStep 3.7 FlashlowQwen3.5-122B-A10BmediumvsStep 3.7 FlashlowKimi K2.6mediumTersedia gratisvsStep 3.7 FlashlowGemini 3.1 Flash LitemediumvsStep 3.7 FlashlowQwen3.5 Plus 2026-04-20mediumvsStep 3.7 FlashlowGemini 3.1 Flash Lite PreviewmediumvsStep 3.7 FlashlowMiniMax M3mediumvsStep 3.7 FlashlowDeepSeek V4 ProhighvsStep 3.7 Flashlow