Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Failure Count ↑.
Categories
447/447
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #348 | Mercury 2.5 low | Inception | 14 | 0.5 | $0.020 | 6/23 | 3.34s |
| #352 | Laguna S 2.1 medium | Poolside | 14 | 0.5 | $0.092 | 4/23 | 63.1s |
| #364 | MiMo-V2.5 none | Xiaomi | 14 | 0.5 | $0.049 | 5/23 | 9.88s |
| #366 | Hy4 preview none | Tencent | 14 | 0.5 | $0.165 | 3/23 | 40.4s |
| #381 | Nemotron 3.5 Lightning low | NVIDIA | 14 | 0.5 | $0.175 | 5/23 | 83.2s |
| #307 | Mistral Large 4 none | Mistral | 15 | 0.6 | $0.290 | 6/23 | 20.4s |
| #312 | GPT-5.4 none | OpenAI | 15 | 0.6 | $0.690 | 7/23 | 3.89s |
| #330 | MiMo-V2.6-Flash none | Xiaomi | 15 | 0.5 | $0.060 | 6/23 | 6.20s |
| #334 | GPT-5.6 Luna none | OpenAI | 15 | 0.5 | $0.042 | 6/23 | 3.78s |
| #359 | Inkling Small none | Thinkingmachines | 15 | 0.5 | $0.054 | 5/23 | 1.45s |
| #360 | Qwen3 Coder Next default | Qwen | 15 | 0.5 | $0.067 | 5/23 | 19.7s |
| #365 | Qwen3.5-9B none | Qwen | 15 | 0.5 | $0.041 | 4/23 | 37.2s |
| #369 | GLM 4.7 Flash none | Z.ai | 15 | 0.5 | $0.027 | 5/23 | 13.0s |
| #375 | Qwen3 Coder Next medium | Qwen | 15 | 0.5 | $0.071 | 3/23 | 17.0s |
| #400 | Mercury 2.5 none | Inception | 15 | 0.4 | $0.026 | 2/23 | 5.10s |