Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Total Cost ↑.
Categories
291/291
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #203 | Inkling Small low | Thinkingmachines | 9 | 5.7 | $0.055 | 9/22 | 2.07s |
| #274 | Grok 4.20 none | X AI | 10 | 4.1 | $0.057 | 6/18 | 1.11s |
| #69 | Qwen3.8 27B medium | Qwen | 3 | 7.8 | ~$0.058 | 14/22 | 33.0s |
| #55 | DeepSeek V4 Flash 0731 high | DeepSeek | 4 | 8.0 | $0.058 | 14/22 | 114.9s |
| #148 | Qwen3.5-27B none | Qwen | 11 | 6.6 | $0.058 | 9/22 | 4.77s |
| #29 | GLM 5.3 Flash max | Z.ai | 2 | 8.7 | $0.059 | 16/22 | 52.1s |
| #234 | Qwen3.6 35B A3B none | Qwen | 13 | 5.3 | $0.060 | 4/22 | 5.57s |
| #179 | Qwen3.6 Flash none | Qwen | 12 | 6.1 | $0.062 | 7/22 | 3.73s |
| #285 | Qwen3.5-9B medium | Qwen | 2 | 3.8 | $0.062 | 3/22 | 107.5s |
| #127 | Qwen3.7 Flash medium | Qwen | 8 | 6.9 | $0.065 | 10/22 | 47.4s |
| #167 | Seed-2.0-Lite none | Bytedance Seed | 13 | 6.2 | $0.066 | 8/22 | 4.37s |
| #155 | Laguna XS 2.1 medium | Poolside | 10 | 6.5 | $0.068 | 9/22 | 48.2s |
| #225 | MiMo-V2.5-Pro none | Xiaomi | 12 | 5.4 | $0.068 | 5/22 | 4.24s |
| #261 | Grok 4.1 Fast medium | X AI | 4 | 4.7 | $0.069 | 9/19 | 23.8s |
| #257 | KAT-Coder-Air V2.5 none | Kwaipilot | 13 | 4.8 | $0.070 | 5/22 | 12.5s |