AI BENCHY Category Failures
Coding: Timed out
Coding
Timed out
See which AI models are most likely to hit Timed out on Coding, so you can spot weak points faster. Sort by: Total Cost ↑.
Failure Reasons
21/21
Filter models
No models match the current search and filters.
| Rank | Model | Company | Timed out Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #138 | Gemma 4 26B A4B none | 1 | 3.7 | $0.004 | 0/3 | 4.16s | |
| #167 | Qwen3 Coder Next medium | Qwen | 1 | 3.7 | $0.008 | 0/3 | 924ms |
| #102 | Gemma 4 31B medium | 2 | 4.3 | $0.033 | 0/3 | 219.8s | |
| #184 | Qwen3.5-9B medium | Qwen | 1 | 2.9 | $0.036 | 0/3 | 100.9s |
| #74 | MiMo-V2-Flash medium | Xiaomi | 1 | 6.0 | $0.043 | 1/3 | 10.7s |
| #62 | Seed-2.0-Mini medium | Bytedance Seed | 1 | 5.5 | $0.044 | 1/3 | 220.5s |
| #60 | DeepSeek V3.2 medium | DeepSeek | 1 | 6.0 | $0.044 | 1/3 | 248.7s |
| #71 | Gemma 4 26B A4B medium | 1 | 2.9 | $0.045 | 0/3 | 272.5s | |
| #176 | GLM 4.7 Flash medium | Z.ai | 2 | 3.2 | $0.054 | 0/3 | 55.3s |
| #93 | Step 3.5 Flash medium | Stepfun | 1 | 2.4 | $0.070 | 0/2 | 258.4s |
| #83 | Qwen3.5-Flash medium | Qwen | 1 | 3.7 | $0.080 | 0/3 | 58.9s |
| #51 | MiniMax M3 medium | Minimax | 1 | 6.1 | $0.131 | 1/3 | 144.7s |
| #52 | DeepSeek V4 Pro high | DeepSeek | 1 | 6.1 | $0.157 | 1/3 | 243.0s |
| #30 | Qwen3.7 Plus medium | Qwen | 1 | 6.1 | $0.177 | 1/3 | 108.6s |
| #76 | GLM 5.1 medium | Z.ai | 1 | 4.6 | $0.288 | 0/3 | 109.6s |