AI BENCHY Category Failures
Coding: Timed out
Coding
Timed out
See which AI models are most likely to hit Timed out on Coding, so you can spot weak points faster. Sort by: Response Time (avg) ↑.
Failure Reasons
21/21
Filter models
No models match the current search and filters.
| Rank | Model | Company | Timed out Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #167 | Qwen3 Coder Next medium | Qwen | 1 | 3.7 | $0.008 | 0/3 | 924ms |
| #138 | Gemma 4 26B A4B none | 1 | 3.7 | $0.004 | 0/3 | 4.16s | |
| #74 | MiMo-V2-Flash medium | Xiaomi | 1 | 6.0 | $0.043 | 1/3 | 10.7s |
| #176 | GLM 4.7 Flash medium | Z.ai | 2 | 3.2 | $0.054 | 0/3 | 55.3s |
| #83 | Qwen3.5-Flash medium | Qwen | 1 | 3.7 | $0.080 | 0/3 | 58.9s |
| #184 | Qwen3.5-9B medium | Qwen | 1 | 2.9 | $0.036 | 0/3 | 100.9s |
| #30 | Qwen3.7 Plus medium | Qwen | 1 | 6.1 | $0.177 | 1/3 | 108.6s |
| #76 | GLM 5.1 medium | Z.ai | 1 | 4.6 | $0.288 | 0/3 | 109.6s |
| #44 | Qwen3.5-122B-A10B medium | Qwen | 1 | 6.0 | $0.588 | 1/3 | 114.5s |
| #51 | MiniMax M3 medium | Minimax | 1 | 6.1 | $0.131 | 1/3 | 144.7s |
| #78 | Kimi K2.7 Code medium | Moonshot AI | 1 | 7.6 | $0.581 | 2/3 | 146.7s |
| #165 | MiniMax M2.5 medium | Minimax | 1 | 3.4 | $0.303 | 0/3 | 188.6s |
| #103 | Qwen3.5-35B-A3B medium | Qwen | 1 | 5.9 | $0.401 | 1/3 | 206.6s |
| #43 | Kimi K2.6 medium | Moonshot AI | 1 | 5.7 | $0.888 | 1/3 | 214.4s |
| #55 | Kimi K2.5 medium | Moonshot AI | 1 | 6.1 | $0.348 | 1/3 | 217.5s |