Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Failure Count ↑.
Categories
447/447
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #425 | Grok Build 0.1 none | X AI | 7 | 0.3 | $0.547 | 7/19 | 28.7s |
| #432 | Nemotron 3 Nano Omni 30b A3b Reasoning medium | NVIDIA | 7 | 0.3 | $0.000 | 4/19 | 17.1s |
| #433 | d1-ultra default | Liquid | 7 | 0.3 | $0.003 | 4/12 | 531ms |
| #441 | Jev 1.14 default | Typesafe | 7 | 0.2 | $0.003 | 4/12 | 377ms |
| #105 | GPT-5.6 Terra medium | OpenAI | 8 | 0.8 | $0.483 | 15/23 | 8.93s |
| #113 | GPT-5.6 Luna high | OpenAI | 8 | 0.8 | $0.118 | 15/23 | 18.4s |
| #115 | GPT-5.4 Nano medium | OpenAI | 8 | 0.8 | $0.235 | 13/23 | 16.0s |
| #118 | GPT-5.6 Terra low | OpenAI | 8 | 0.8 | $0.435 | 14/23 | 7.58s |
| #142 | Qwen3.5 Plus 2026-04-20 medium | Qwen | 8 | 0.8 | $0.435 | 14/23 | 54.1s |
| #155 | Qwen3.6 Flash medium | Qwen | 8 | 0.7 | $0.783 | 13/23 | 45.5s |
| #156 | DeepSeek V4 Flash 0731 low | DeepSeek | 8 | 0.7 | $0.306 | 13/23 | 88.1s |
| #158 | GLM 5.3 FlashX high | Z.ai | 8 | 0.7 | $0.210 | 13/23 | 14.9s |
| #176 | Qwen3.7 Flash high | Qwen | 8 | 0.7 | $0.063 | 13/23 | 45.5s |
| #177 | LongCat 2.0 medium | Meituan | 8 | 0.7 | $0.767 | 12/23 | 144.9s |
| #183 | GLM 5.3 FlashX medium | Z.ai | 8 | 0.7 | $0.114 | 12/23 | 7.37s |