Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one.
Categories
219/219
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #128 | Gemini 3.1 Flash Lite none | 11 | 6.1 | $0.046 | 9/22 | 1.75s | |
| #138 | GPT-5.6 Terra none | OpenAI | 11 | 6.0 | $0.349 | 8/22 | 1.65s |
| #144 | Kimi K2.6 none | Moonshot AI | 11 | 5.8 | $0.184 | 7/22 | 19.6s |
| #151 | GLM 5V Turbo none | Z.ai | 11 | 5.6 | $0.052 | 8/21 | 2.99s |
| #153 | Mimo V2 PRO none | Xiaomi | 11 | 5.6 | $0.045 | 7/21 | 2.27s |
| #155 | KAT-Coder-Air V2.5 medium | Kwaipilot | 11 | 5.6 | $0.048 | 8/22 | 8.42s |
| #158 | Qwen3.6 27B none | Qwen | 11 | 5.5 | $0.087 | 7/22 | 10.7s |
| #160 | MiMo-V2.5-Pro none | Xiaomi | 11 | 5.5 | $0.068 | 6/22 | 4.12s |
| #167 | Laguna S 2.1 high | Poolside | 11 | 5.4 | $0.127 | 4/22 | 111.6s |
| #66 | KAT-Coder-Pro V2.5 low | Kwaipilot | 10 | 7.4 | $0.387 | 11/22 | 19.5s |
| #73 | KAT-Coder-Pro V2.5 high | Kwaipilot | 10 | 7.2 | $0.482 | 11/22 | 20.8s |
| #75 | Qwen3.7 Plus none | Qwen | 10 | 7.2 | $0.106 | 11/22 | 12.1s |
| #87 | GPT-5.6 Sol none | OpenAI | 10 | 6.9 | $0.524 | 11/22 | 2.16s |
| #97 | KAT-Coder-Pro V2.5 none | Kwaipilot | 10 | 6.7 | $0.476 | 11/22 | 25.6s |
| #103 | Qwen3.6 Max Preview none | Qwen | 10 | 6.6 | $0.231 | 12/22 | 7.82s |