Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Score ↑.
Categories
313/313
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #151 | GLM 5.3 low | Z.ai | 8 | 6.8 | $0.257 | 12/22 | 13.6s |
| #150 | DeepSeek V4 Pro none | DeepSeek | 9 | 6.8 | $0.220 | 9/22 | 11.7s |
| #149 | Solar Pro 4 medium | Upstage | 5 | 6.8 | $0.047 | 12/22 | 127.6s |
| #148 | Solar Pro 4 low | Upstage | 6 | 6.8 | $0.044 | 11/22 | 136.1s |
| #147 | Seed-2.0-Code medium | Bytedance Seed | 4 | 6.8 | $1.153 | 10/22 | 101.1s |
| #146 | Step 3.7 Flash high | Stepfun | 7 | 6.8 | $1.229 | 11/22 | 70.1s |
| #145 | Qwen3.6 Flash medium | Qwen | 8 | 6.8 | $0.741 | 12/22 | 45.0s |
| #144 | Gemini 3.5 Flash none | 4 | 6.9 | $1.093 | 14/22 | 10.2s | |
| #143 | Seed-2.0-Code high | Bytedance Seed | 4 | 6.9 | $1.273 | 11/22 | 124.2s |
| #142 | Qwen3.7 Flash medium | Qwen | 8 | 6.9 | $0.065 | 10/22 | 47.4s |
| #141 | Claude Fable 5.1 low | Anthropic | 4 | 6.9 | $2.565 | 11/22 | 10.3s |
| #140 | KAT-Coder-Pro V2.5 medium | Kwaipilot | 9 | 6.9 | $0.478 | 11/22 | 24.9s |
| #139 | Kimi K2.5 medium | Moonshot AI | 5 | 7.0 | $0.479 | 10/22 | 98.2s |
| #138 | Seed-2.0-Mini medium | Bytedance Seed | 5 | 7.0 | $0.116 | 11/22 | 93.1s |
| #137 | Grok 4.20 medium | X AI | 6 | 7.0 | $0.805 | 11/22 | 32.6s |