Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Tests Correct ↓.
Categories
313/313
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #125 | Qwen3.7 Flash low | Qwen | 7 | 7.2 | $0.043 | 11/22 | 38.0s |
| #126 | Muse Glimmer 30B medium | Meta | 9 | 7.2 | $0.211 | 11/22 | 30.6s |
| #128 | Muse Glimmer 30B low | Meta | 6 | 7.1 | $0.143 | 11/22 | 18.6s |
| #129 | Step 3.7 Flash low | Stepfun | 9 | 7.1 | $0.390 | 11/22 | 17.9s |
| #130 | Solar Pro 4 high | Upstage | 5 | 7.1 | $0.046 | 11/22 | 120.6s |
| #133 | DeepSeek V3.2 medium | DeepSeek | 5 | 7.0 | $0.078 | 11/22 | 68.4s |
| #137 | Grok 4.20 medium | X AI | 6 | 7.0 | $0.805 | 11/22 | 32.6s |
| #138 | Seed-2.0-Mini medium | Bytedance Seed | 5 | 7.0 | $0.116 | 11/22 | 93.1s |
| #140 | KAT-Coder-Pro V2.5 medium | Kwaipilot | 9 | 6.9 | $0.478 | 11/22 | 24.9s |
| #141 | Claude Fable 5.1 low | Anthropic | 4 | 6.9 | $2.565 | 11/22 | 10.3s |
| #143 | Seed-2.0-Code high | Bytedance Seed | 4 | 6.9 | $1.273 | 11/22 | 124.2s |
| #146 | Step 3.7 Flash high | Stepfun | 7 | 6.8 | $1.229 | 11/22 | 70.1s |
| #148 | Solar Pro 4 low | Upstage | 6 | 6.8 | $0.044 | 11/22 | 136.1s |
| #152 | MiMo-V2.5-Pro medium | Xiaomi | 3 | 6.8 | $0.221 | 11/22 | 48.7s |
| #156 | KAT-Coder-Pro V2.5 none | Kwaipilot | 10 | 6.7 | $0.487 | 11/22 | 26.0s |