Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Total Cost ↓.
Categories
447/447
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #97 | GPT-6 Luna medium | OpenAI | 7 | 0.8 | $0.047 | 15/23 | 18.1s |
| #347 | Mistral Small 4 none | Mistral | 17 | 0.5 | $0.047 | 5/23 | 3.12s |
| #399 | GLM 5 Turbo none | Z.ai | 13 | 0.4 | $0.047 | 6/21 | 2.82s |
| #357 | KAT Coder AIR V2.5 low | Kwaipilot | 7 | 0.5 | $0.046 | 7/23 | 10.2s |
| #383 | Mimo V2 PRO default | Xiaomi | 11 | 0.5 | $0.045 | 7/21 | 2.27s |
| #117 | Qwen3.8 Flash Next low | Qwen | 6 | 0.8 | ~$0.045 | 15/23 | 23.7s |
| #373 | Laguna S 2.1 none | Poolside | 18 | 0.5 | $0.044 | 2/23 | 17.7s |
| #234 | Mercury 2.5 high | Inception | 9 | 0.6 | $0.044 | 12/23 | 7.62s |
| #345 | MiMo-V2-Flash medium | Xiaomi | 5 | 0.5 | $0.043 | 12/21 | 20.1s |
| #386 | Hy3 preview low | Tencent | 4 | 0.5 | $0.042 | 10/21 | 24.6s |
| #334 | GPT-5.6 Luna none | OpenAI | 15 | 0.5 | $0.042 | 6/23 | 3.78s |
| #365 | Qwen3.5-9B none | Qwen | 15 | 0.5 | $0.041 | 4/23 | 37.2s |
| #317 | Nemotron 3.5 Super VL none | NVIDIA | 11 | 0.6 | $0.040 | 8/23 | 47.0s |
| #233 | Mercury 2.5 Preview high | Inception | 6 | 0.6 | $0.040 | 12/23 | 7.61s |
| #207 | Mercury 2.5 Preview medium | Inception | 4 | 0.7 | $0.039 | 15/23 | 6.66s |