Kegagalan kategori AI BENCHY
Pemrograman: Jawaban salah
Pemrograman
Jawaban salah
Lihat model AI mana yang paling mungkin mengalami Jawaban salah di Pemrograman, agar Anda bisa menemukan titik lemahnya lebih cepat. Urutkan berdasarkan: Waktu respons (rata-rata) ↓.
Alasan kegagalan
134/134
Filter model
Tidak ada model yang cocok dengan pencarian dan filter saat ini.
| Peringkat | Model | Perusahaan | Jumlah Jawaban salah | Skor kategori | Total Biaya | Tes benar | Waktu respons (rata-rata) |
|---|---|---|---|---|---|---|---|
| #123 | North Mini Code medium | Cohere | 3 | 4.5 | $0.000 | 0/3 | 320.4s |
| #60 | DeepSeek V3.2 medium | DeepSeek | 1 | 6.0 | $0.044 | 1/3 | 248.7s |
| #62 | Seed-2.0-Mini medium | Bytedance Seed | 1 | 5.5 | $0.044 | 1/3 | 220.5s |
| #75 | Step 3.7 Flash high | Stepfun | 1 | 4.0 | $1.148 | 0/3 | 206.2s |
| #165 | MiniMax M2.5 medium | Minimax | 1 | 3.4 | $0.303 | 0/3 | 188.6s |
| #86 | Mimo V2 Omni medium | Xiaomi | 1 | 3.3 | $0.683 | 0/3 | 183.9s |
| #33 | Qwen3.5 Plus 2026-02-15 medium | Qwen | 1 | 6.6 | $0.310 | 1/3 | 180.7s |
| #34 | Qwen3.5-27B medium | Qwen | 2 | 6.2 | $0.536 | 1/3 | 160.7s |
| #21 | Seed-2.0-Lite medium | Bytedance Seed | 1 | 8.0 | $0.175 | 2/3 | 156.7s |
| #26 | Grok 4.5 medium | X AI | 1 | 7.6 | $1.696 | 2/3 | 155.7s |
| #36 | Qwen3.6 Plus medium | Qwen | 1 | 6.1 | $0.294 | 1/3 | 153.1s |
| #14 | Qwen3.6 Max Preview medium | Qwen | 1 | 8.8 | $0.960 | 2/3 | 146.5s |
| #41 | Qwen3.5 Plus 2026-04-20 medium | Qwen | 2 | 6.2 | $0.317 | 1/3 | 125.3s |
| #44 | Qwen3.5-122B-A10B medium | Qwen | 1 | 6.0 | $0.588 | 1/3 | 114.5s |
| #65 | Grok 4.20 medium | X AI | 2 | 6.3 | $0.609 | 1/3 | 109.9s |