AI BENCHY Category Failures
Coding: Timed out
Coding
Timed out
See which AI models are most likely to hit Timed out on Coding, so you can spot weak points faster. Sort by: Response Time (avg) ↑.
Failure Reasons
22/22
Filter models
No models match the current search and filters.
| Rank | Model | Company | Timed out Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #56 | Kimi K2.5 medium | Moonshot AI | 1 | 6.1 | $0.348 | 1/3 | 217.5s |
| #103 | Gemma 4 31B medium | 2 | 4.3 | $0.033 | 0/3 | 219.8s | |
| #63 | Seed-2.0-Mini medium | Bytedance Seed | 1 | 5.5 | $0.044 | 1/3 | 220.5s |
| #53 | DeepSeek V4 Pro high | DeepSeek | 1 | 6.1 | $0.157 | 1/3 | 243.0s |
| #61 | DeepSeek V3.2 medium | DeepSeek | 1 | 6.0 | $0.042 | 1/3 | 248.7s |
| #94 | Step 3.5 Flash medium | Stepfun | 1 | 2.4 | $0.070 | 0/2 | 258.4s |
| #72 | Gemma 4 26B A4B medium | 1 | 2.9 | $0.045 | 0/3 | 272.5s |