AI BENCHY Category Failures
Coding: Wrong answer
Coding
Wrong answer
See which AI models are most likely to hit Wrong answer on Coding, so you can spot weak points faster. Sort by: Response Time (avg) ↑.
Failure Reasons
| Rank | Model | Company | Wrong answer Count | Category Score | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|
| #25 | Qwen3.5-27B medium | Qwen | 1 | 7.0 | 1/2 | 123.9s |
| #119 | MiniMax M2.5 medium | Minimax | 1 | 3.5 | 0/2 | 125.8s |
| #42 | Qwen3.5 Plus 2026-04-20 medium | Qwen | 1 | 5.4 | 1/2 | 137.5s |
| #14 | Qwen3.6 Max Preview medium | Qwen | 1 | 8.2 | 1/2 | 178.0s |
| #72 | MiMo-V2-Omni medium | Xiaomi | 1 | 3.4 | 0/2 | 183.9s |
| #71 | DeepSeek V3.2 medium | DeepSeek | 1 | 3.9 | 0/2 | 185.0s |
| #20 | Qwen3.5 Plus 2026-02-15 medium | Qwen | 1 | 7.6 | 1/2 | 193.8s |
| #33 | Qwen3.6 Plus medium | Qwen | 1 | 4.1 | 0/2 | 201.7s |
| #68 | Seed-2.0-Mini medium | Bytedance Seed | 1 | 6.8 | 1/2 | 220.5s |