Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Tests Correct ↑.
Categories
313/313
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #130 | Solar Pro 4 high | Upstage | 5 | 7.1 | $0.046 | 11/22 | 120.6s |
| #133 | DeepSeek V3.2 medium | DeepSeek | 5 | 7.0 | $0.078 | 11/22 | 68.4s |
| #137 | Grok 4.20 medium | X AI | 6 | 7.0 | $0.805 | 11/22 | 32.6s |
| #138 | Seed-2.0-Mini medium | Bytedance Seed | 5 | 7.0 | $0.116 | 11/22 | 93.1s |
| #140 | KAT-Coder-Pro V2.5 medium | Kwaipilot | 9 | 6.9 | $0.478 | 11/22 | 24.9s |
| #141 | Claude Fable 5.1 low | Anthropic | 4 | 6.9 | $2.565 | 11/22 | 10.3s |
| #143 | Seed-2.0-Code high | Bytedance Seed | 4 | 6.9 | $1.273 | 11/22 | 124.2s |
| #146 | Step 3.7 Flash high | Stepfun | 7 | 6.8 | $1.229 | 11/22 | 70.1s |
| #148 | Solar Pro 4 low | Upstage | 6 | 6.8 | $0.044 | 11/22 | 136.1s |
| #152 | MiMo-V2.5-Pro medium | Xiaomi | 3 | 6.8 | $0.221 | 11/22 | 48.7s |
| #156 | KAT-Coder-Pro V2.5 none | Kwaipilot | 10 | 6.7 | $0.487 | 11/22 | 26.0s |
| #169 | Qwen3.5 Plus 2026-02-15 none | Qwen | 11 | 6.6 | $0.073 | 11/22 | 9.86s |
| #174 | Qwen3.6 Max Preview none | Qwen | 11 | 6.4 | $0.228 | 11/22 | 7.82s |
| #178 | MiMo-V2.5 medium | Xiaomi | 5 | 6.4 | $0.104 | 11/22 | 46.3s |
| #180 | Ring-2.6-1T medium | Inclusionai | 6 | 6.4 | $0.102 | 11/22 | 68.8s |