Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Total Cost ↓.
Categories
447/447
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #284 | KAT-Coder-Pro V2.5 default | Kwaipilot | 10 | 0.6 | $0.742 | 11/23 | 25.0s |
| #258 | Gemini 3.1 Flash Lite Preview low | 7 | 0.6 | $0.736 | 14/23 | 19.0s | |
| #260 | Gemini 3.1 Flash Lite low | 9 | 0.6 | $0.717 | 13/23 | 19.0s | |
| #255 | Qwen3.5-35B-A3B medium | Qwen | 3 | 0.6 | $0.716 | 11/23 | 111.5s |
| #19 | GPT-6 Sol medium | OpenAI | 2 | 0.9 | $0.703 | 21/23 | 12.1s |
| #93 | GPT-5.6 Terra high | OpenAI | 7 | 0.8 | $0.698 | 15/23 | 13.6s |
| #312 | GPT-5.4 none | OpenAI | 15 | 0.6 | $0.690 | 7/23 | 3.89s |
| #235 | Beam 1.0 501B A23B xhigh | Reflection | 8 | 0.6 | $0.688 | 12/23 | 9.18s |
| #367 | Mimo V2 Omni medium | Xiaomi | 5 | 0.5 | $0.683 | 10/21 | 41.2s |
| #167 | Gemini 2.5 Flash medium | 6 | 0.7 | $0.680 | 15/23 | 20.5s | |
| #114 | Nemotron 3 Ultra medium | NVIDIA | 7 | 0.8 | $0.674 | 14/23 | 40.3s |
| #277 | Beam 1.0 501B A23B high | Reflection | 7 | 0.6 | $0.674 | 11/23 | 9.03s |
| #50 | Gemini 4 Argon medium | 4 | 0.9 | $0.674 | 19/23 | 6.63s | |
| #271 | KAT-Coder-Pro V2.5 medium | Kwaipilot | 9 | 0.6 | $0.669 | 11/23 | 23.9s |
| #286 | Claude Sonnet 4.6 none | Anthropic | 5 | 0.6 | $0.661 | 12/22 | 7.67s |