Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Total Cost ↓.
Categories
291/291
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #61 | Step 3.7 Flash medium | Stepfun | 6 | 7.9 | $0.495 | 13/22 | 23.5s |
| #145 | LongCat 2.0 high | Meituan | 7 | 6.7 | $0.492 | 9/22 | 153.3s |
| #141 | KAT-Coder-Pro V2.5 none | Kwaipilot | 10 | 6.7 | $0.487 | 11/22 | 26.0s |
| #126 | KAT-Coder-Pro V2.5 medium | Kwaipilot | 9 | 6.9 | $0.478 | 11/22 | 24.9s |
| #87 | Qwen3.5 Plus 2026-02-15 medium | Qwen | 4 | 7.5 | $0.459 | 14/22 | 91.8s |
| #144 | GLM 5V Turbo medium | Z.ai | 7 | 6.7 | $0.457 | 11/21 | 23.1s |
| #24 | Gemini 3.5 Flash low | 3 | 8.8 | $0.449 | 18/22 | 5.76s | |
| #97 | Grok 4.6 low | X AI | 7 | 7.4 | $0.449 | 15/22 | 14.6s |
| #9 | GPT-5.6 Sol high | OpenAI | 4 | 9.4 | $0.446 | 18/22 | 11.5s |
| #3 | Gemini 3.6 Flash medium | 2 | 9.8 | $0.427 | 20/22 | 11.9s | |
| #84 | GPT-5.6 Terra low | OpenAI | 8 | 7.5 | $0.420 | 13/22 | 5.45s |
| #64 | Qwen3.6 Plus medium | Qwen | 5 | 7.8 | $0.418 | 15/22 | 45.5s |
| #76 | DeepSeek V4 Pro high | DeepSeek | 7 | 7.7 | $0.414 | 10/22 | 92.5s |
| #142 | LongCat 2.0 low | Meituan | 7 | 6.7 | $0.412 | 10/22 | 113.6s |
| #100 | GLM 5.3 high | Z.ai | 6 | 7.3 | $0.403 | 13/22 | 27.8s |