AI BENCHY Category Failures
Coding: Timed out
Coding
Timed out
See which AI models are most likely to hit Timed out on Coding, so you can spot weak points faster. Sort by: Total Cost ↓.
Failure Reasons
22/22
Filter models
No models match the current search and filters.
| Rank | Model | Company | Timed out Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #63 | Seed-2.0-Mini medium | Bytedance Seed | 1 | 5.5 | $0.044 | 1/3 | 220.5s |
| #75 | MiMo-V2-Flash medium | Xiaomi | 1 | 6.0 | $0.043 | 1/3 | 10.7s |
| #61 | DeepSeek V3.2 medium | DeepSeek | 1 | 6.0 | $0.042 | 1/3 | 248.7s |
| #185 | Qwen3.5-9B medium | Qwen | 1 | 2.9 | $0.036 | 0/3 | 100.9s |
| #103 | Gemma 4 31B medium | 2 | 4.3 | $0.033 | 0/3 | 219.8s | |
| #168 | Qwen3 Coder Next medium | Qwen | 1 | 3.7 | $0.008 | 0/3 | 924ms |
| #139 | Gemma 4 26B A4B none | 1 | 3.7 | $0.004 | 0/3 | 4.16s |