Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Total Cost ↓.
Categories
447/447
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #169 | Qwen3.6 Plus medium | Qwen | 6 | 0.7 | $0.554 | 15/23 | 57.4s |
| #208 | GPT-6 Sol none | OpenAI | 10 | 0.7 | $0.551 | 13/23 | 9.02s |
| #425 | Grok Build 0.1 none | X AI | 7 | 0.3 | $0.547 | 7/19 | 28.7s |
| #218 | GPT 5.3 Chat default | OpenAI | 6 | 0.7 | $0.533 | 13/23 | 6.31s |
| #11 | GPT-6.1 Sol medium | OpenAI | 2 | 1.0 | $0.530 | 21/23 | 8.90s |
| #9 | Gemini 3.7 Flash high | 2 | 1.0 | $0.528 | 21/23 | 15.1s | |
| #162 | Inkling medium | Thinkingmachines | 5 | 0.7 | $0.527 | 15/23 | 17.0s |
| #83 | Claude Haiku 5.5 max | Anthropic | 1 | 0.8 | $0.509 | 19/23 | 61.7s |
| #250 | Gemini 3.5 Flash minimal | 7 | 0.6 | $0.508 | 13/23 | 4.67s | |
| #238 | KAT-Coder-Pro V2.5 high | Kwaipilot | 10 | 0.6 | $0.506 | 11/23 | 21.2s |
| #139 | Muse Glimmer 30B high | Meta | 7 | 0.8 | $0.506 | 11/23 | 69.9s |
| #326 | Claude Opus 4.7 none | Anthropic | 3 | 0.5 | $0.505 | 16/19 | 3.02s |
| #228 | Beam 1.0 501B A23B medium | Reflection | 6 | 0.7 | $0.499 | 14/23 | 6.27s |
| #131 | GLM 5.3 high | Z.ai | 6 | 0.8 | $0.495 | 14/23 | 28.4s |
| #112 | DeepSeek V4.1 Flash low | DeepSeek | 7 | 0.8 | $0.494 | 15/23 | 28.0s |