AI BENCHY Category Failures
Coding: Wrong answer
Coding
Wrong answer
See which AI models are most likely to hit Wrong answer on Coding, so you can spot weak points faster. Sort by: Total Cost ↓.
Failure Reasons
134/134
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #90 | MiMo-V2.5 medium | Xiaomi | 2 | 6.2 | $0.061 | 1/3 | 97.1s |
| #57 | Mercury 2 medium | Inception | 1 | 8.2 | $0.058 | 2/3 | 2.04s |
| #134 | GLM 5.1 none | Z.ai | 3 | 3.9 | $0.057 | 0/3 | 4.96s |
| #175 | Grok 4.20 none | X AI | 1 | 1.1 | $0.057 | 0/1 | 1.22s |
| #82 | Qwen3.7 Max none | Qwen | 2 | 5.5 | $0.054 | 1/3 | 1.35s |
| #122 | GLM 5V Turbo none | Z.ai | 2 | 5.5 | $0.052 | 1/3 | 3.13s |
| #141 | GLM 5 Turbo none | Z.ai | 3 | 3.9 | $0.047 | 0/3 | 2.41s |
| #143 | GPT-5.6 Luna none | OpenAI | 3 | 3.8 | $0.047 | 0/3 | 980ms |
| #126 | Mimo V2 PRO none | Xiaomi | 1 | 5.5 | $0.045 | 1/3 | 2.65s |
| #63 | Seed-2.0-Mini medium | Bytedance Seed | 1 | 5.5 | $0.044 | 1/3 | 220.5s |
| #75 | MiMo-V2-Flash medium | Xiaomi | 1 | 6.0 | $0.043 | 1/3 | 10.7s |
| #74 | GLM 5.2 none | Z.ai | 2 | 3.7 | $0.042 | 0/3 | 7.55s |
| #61 | DeepSeek V3.2 medium | DeepSeek | 1 | 6.0 | $0.042 | 1/3 | 248.7s |
| #144 | GPT-5.4 Mini none | OpenAI | 2 | 5.5 | $0.038 | 1/3 | 913ms |
| #78 | Laguna XS 2.1 medium | Poolside | 2 | 5.5 | $0.036 | 1/3 | 70.3s |