Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Total Cost ↑.
Categories
447/447
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #277 | Beam 1.0 501B A23B high | Reflection | 7 | 0.6 | $0.674 | 11/23 | 9.03s |
| #114 | Nemotron 3 Ultra medium | NVIDIA | 7 | 0.8 | $0.674 | 14/23 | 40.3s |
| #167 | Gemini 2.5 Flash medium | 6 | 0.7 | $0.680 | 15/23 | 20.5s | |
| #367 | Mimo V2 Omni medium | Xiaomi | 5 | 0.5 | $0.683 | 10/21 | 41.2s |
| #235 | Beam 1.0 501B A23B xhigh | Reflection | 8 | 0.6 | $0.688 | 12/23 | 9.18s |
| #312 | GPT-5.4 none | OpenAI | 15 | 0.6 | $0.690 | 7/23 | 3.89s |
| #93 | GPT-5.6 Terra high | OpenAI | 7 | 0.8 | $0.698 | 15/23 | 13.6s |
| #19 | GPT-6 Sol medium | OpenAI | 2 | 0.9 | $0.703 | 21/23 | 12.1s |
| #255 | Qwen3.5-35B-A3B medium | Qwen | 3 | 0.6 | $0.716 | 11/23 | 111.5s |
| #260 | Gemini 3.1 Flash Lite low | 9 | 0.6 | $0.717 | 13/23 | 19.0s | |
| #258 | Gemini 3.1 Flash Lite Preview low | 7 | 0.6 | $0.736 | 14/23 | 19.0s | |
| #284 | KAT-Coder-Pro V2.5 default | Kwaipilot | 10 | 0.6 | $0.742 | 11/23 | 25.0s |
| #358 | Grok 4.20 Beta medium | X AI | 3 | 0.5 | $0.750 | 14/18 | 9.75s |
| #46 | Gemini 3.5 Flash low | 3 | 0.9 | $0.752 | 19/23 | 7.85s | |
| #12 | GPT-6.1 Sol high | OpenAI | 2 | 1.0 | $0.755 | 21/23 | 15.5s |