Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Score ↓.
Categories
313/313
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #109 | LongCat 2.0 medium | Meituan | 7 | 7.4 | $0.499 | 12/22 | 143.6s |
| #110 | Qwen3.8 2.4T A95B high | Qwen | 3 | 7.4 | $2.357 | 14/22 | 120.6s |
| #111 | Grok 4.6 low | X AI | 7 | 7.4 | $0.449 | 15/22 | 14.6s |
| #112 | Gemini 3 Flash Preview low | 6 | 7.4 | $0.185 | 16/22 | 6.51s | |
| #113 | Claude Sonnet 4.6 none | Anthropic | 5 | 7.3 | $0.661 | 12/22 | 7.67s |
| #114 | GLM 5.3 high | Z.ai | 6 | 7.3 | $0.403 | 13/22 | 27.8s |
| #115 | KAT-Coder-Pro V2.5 low | Kwaipilot | 10 | 7.3 | $0.400 | 11/22 | 20.2s |
| #116 | GLM 5.3 Flash high | Z.ai | 4 | 7.3 | $0.029 | 13/22 | 25.4s |
| #117 | Gemini 3.1 Flash Lite medium | 7 | 7.3 | $0.120 | 13/22 | 4.38s | |
| #118 | Qwen3.7 Plus none | Qwen | 9 | 7.3 | $0.106 | 12/22 | 12.1s |
| #119 | DeepSeek V4 Flash 0731 medium | DeepSeek | 5 | 7.3 | $0.066 | 11/22 | 84.7s |
| #120 | Claude Opus 4.8 none | Anthropic | 4 | 7.3 | $1.166 | 13/22 | 4.92s |
| #121 | Kimi K2.6 medium | Moonshot AI | 3 | 7.2 | $1.247 | 12/22 | 115.9s |
| #122 | KAT-Coder-Pro V2.5 high | Kwaipilot | 10 | 7.2 | $0.506 | 11/22 | 22.1s |
| #123 | Muse Glimmer 30B high | Meta | 7 | 7.2 | $0.397 | 10/22 | 66.7s |