AI BENCHY Category Failures
Coding: Wrong answer
Coding
Wrong answer
See which AI models are most likely to hit Wrong answer on Coding, so you can spot weak points faster.
Failure Reasons
134/134
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #57 | GPT-5.3 Chat none | OpenAI | 2 | 5.6 | $0.433 | 1/3 | 10.5s |
| #58 | GPT-5.4 Nano medium | OpenAI | 2 | 6.1 | $0.107 | 1/3 | 19.1s |
| #64 | Gemini 3 Flash Preview low | 2 | 5.8 | $0.111 | 1/3 | 6.00s | |
| #65 | Grok 4.20 medium | X AI | 2 | 6.3 | $0.609 | 1/3 | 109.9s |
| #68 | GLM 5V Turbo medium | Z.ai | 2 | 6.0 | $0.457 | 1/3 | 63.4s |
| #72 | Qwen3.7 Plus none | Qwen | 2 | 5.5 | $0.023 | 1/3 | 2.15s |
| #73 | GLM 5.2 none | Z.ai | 2 | 3.7 | $0.030 | 0/3 | 7.55s |
| #77 | Laguna XS 2.1 medium | Poolside | 2 | 5.5 | $0.036 | 1/3 | 70.3s |
| #80 | Gemini 3 Flash Preview none | 2 | 5.5 | $0.025 | 1/3 | 1.80s | |
| #81 | Qwen3.7 Max none | Qwen | 2 | 5.5 | $0.054 | 1/3 | 1.35s |
| #83 | Qwen3.5-Flash medium | Qwen | 2 | 3.7 | $0.080 | 0/3 | 58.9s |
| #89 | MiMo-V2.5 medium | Xiaomi | 2 | 6.2 | $0.061 | 1/3 | 97.1s |
| #91 | gpt-oss-120b medium | OpenAI | 2 | 5.9 | $0.013 | 1/3 | 38.4s |
| #92 | GPT-5 Nano medium | OpenAI | 2 | 7.0 | $0.081 | 1/3 | 41.6s |
| #95 | Gemini 3.1 Flash Lite Preview low | 2 | 5.5 | $0.026 | 1/3 | 1.39s |