#110 KAT-Coder-Air V2.5
high
SVG tidak valid
- Biaya
- $0.000
- Waktu
- 300.0s
- Token
- 0 tok
AI BENCHY Compare
Kwaipilot: KAT-Coder-Air V2.5 vs StepFun: Step 3.5 Flash
Ringkasan
Step 3.5 Flash (medium) unggul dalam skor rata-rata dengan 6.6 vs 6.2. KAT-Coder-Air V2.5 (high) memiliki biaya benchmark lebih rendah di $0.064 vs $0.070. KAT-Coder-Air V2.5 (high) lebih cepat di 11.02s vs 72.53s, dengan tingkat keberhasilan 46.0% vs 54.0%.
Model yang direkomendasikanKAT-Coder-Air V2.5 (high)Its score stays close to the best score here (6.2 vs 6.6), while responding about 6.6x faster than Step 3.5 Flash (medium).
Benchmark dihasilkan dari suite pengujian AI BENCHY pada: 2026-07-14
| Metrik | KAT-Coder-Air V2.5 KAT-Coder-Air V2.5 high | Step 3.5 Flash Step 3.5 Flash medium |
|---|---|---|
| Skor | 6.2 | 6.6 |
| Peringkat | #110 | #98 |
| Keandalan | 9.7 | 10.0 |
| Konsistensi | 7.6 | 8.9 |
| Tes benar | ||
| Tingkat lulus per percobaan | 46.0% | 54.0% |
| Tes tidak stabil | 6 | 1 |
| Total Run | 63 | 60 |
| Biaya per hasil | 0.910 | 0.198 |
| Total Biaya | $0.064 | $0.070 |
| Harga input | $0.150 / 1M | $0.100 / 1M |
| Harga output | $0.600 / 1M | $0.300 / 1M |
| Total token input | 41,748 | 34,431 |
| Token output | 3,894 | 91,587 |
| Token penalaran | 91,773 | 195,973 |
| Waktu respons (rata-rata) | 11.02s | 72.53s |
| Waktu respons (maks) | 104.98s | 453.94s |
| Waktu respons (total) | 231.37s | 1015.47s |
Showcase generasi
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#98 Step 3.5 Flash
medium- Biaya
- $0.008
- Waktu
- 277.1s
- Token
- 23,695 tok
Model teratas berdasarkan skor
Skor vs Total Biaya
Waktu respons (rata-rata)
Skor vs Waktu respons (rata-rata)
Total token output
Skor vs Total token output
Rincian Kategori
| Pemrograman | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| KAT-Coder-Air V2.5 | 4.3 | 7.3 | 11.1% | 1 | 39.07s | 6,948 | 1,166 | 55,883 | |
| Step 3.5 Flash | 2.4 | 5.2 | 0.0% | 0 | 258.38s | 2,211 | 13,207 | 22,429 |
Perbandingan Cepat
Ganti Pasangan Perbandingan
Seed-2.0-LitenonevsKAT-Coder-Air V2.5highKAT-Coder-Air V2.5highvsGPT-5.6 LunalowKAT-Coder-Air V2.5highvsGPT-5.5noneKAT-Coder-Air V2.5highvsQwen3.5-35B-A3BmediumGemini 2.5 FlashnonevsKAT-Coder-Air V2.5highGemma 4 31BmediumTersedia gratisvsKAT-Coder-Air V2.5highKAT-Coder-Air V2.5highvsGPT-5.6 SolnoneGemini 3.1 Flash LiteminimalvsKAT-Coder-Air V2.5highKAT-Coder-Air V2.5highvsNemotron 3 SupermediumTersedia gratisGemini 3.1 Flash LitenonevsKAT-Coder-Air V2.5highGemini 3.1 Flash Lite PreviewlowvsStep 3.5 FlashmediumKAT-Coder-Air V2.5highvsQwen3.5-Flashnone