Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one.
Categories
291/291
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #52 | Inkling high | Thinkingmachines | 4 | 8.0 | $1.041 | 15/22 | 62.6s |
| #55 | DeepSeek V4 Flash 0731 high | DeepSeek | 4 | 8.0 | $0.058 | 14/22 | 114.9s |
| #57 | Inkling medium | Thinkingmachines | 4 | 8.0 | $0.377 | 15/22 | 15.7s |
| #62 | Qwen3.8 27B low | Qwen | 4 | 7.9 | ~$0.071 | 15/22 | 39.1s |
| #68 | Claude Sonnet 4.6 medium | Anthropic | 4 | 7.8 | $2.126 | 14/22 | 28.1s |
| #71 | Claude Opus 4.8 low | Anthropic | 4 | 7.8 | $2.089 | 16/22 | 12.9s |
| #75 | Claude Opus 4.6 medium | Anthropic | 4 | 7.7 | $2.961 | 13/22 | 32.2s |
| #78 | GLM 5 Turbo medium | Z.ai | 4 | 7.6 | $0.323 | 14/21 | 23.0s |
| #80 | Solar Pro 4 xhigh | Upstage | 4 | 7.6 | $0.050 | 12/22 | 134.9s |
| #85 | MiniMax M3 medium | Minimax | 4 | 7.5 | $0.300 | 11/22 | 75.2s |
| #87 | Qwen3.5 Plus 2026-02-15 medium | Qwen | 4 | 7.5 | $0.459 | 14/22 | 91.8s |
| #88 | Qwen3.5-27B medium | Qwen | 4 | 7.5 | $0.982 | 13/22 | 113.3s |
| #102 | GLM 5.3 Flash high | Z.ai | 4 | 7.3 | $0.029 | 13/22 | 25.4s |
| #106 | Claude Opus 4.8 none | Anthropic | 4 | 7.3 | $1.166 | 13/22 | 4.92s |
| #120 | GLM 5.1 medium | Z.ai | 4 | 7.0 | $0.948 | 12/22 | 58.8s |