Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Tests Correct ↓.
Categories
447/447
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #197 | Minimax M3.1 Flash max | Minimax | 8 | 0.7 | $0.000 | 11/23 | 40.9s |
| #201 | GPT-5.6 Luna low | OpenAI | 10 | 0.7 | $0.049 | 11/23 | 6.96s |
| #206 | Inkling low | Thinkingmachines | 8 | 0.7 | $0.293 | 11/23 | 6.81s |
| #209 | Space Bunny Alpha max | Stealth | 10 | 0.7 | $0.000 | 11/23 | 36.2s |
| #214 | Solar Pro 4 low | Upstage | 7 | 0.7 | $0.101 | 11/23 | 145.2s |
| #216 | MiniMax M3 medium | Minimax | 5 | 0.7 | $0.422 | 11/23 | 77.0s |
| #217 | Ember-1 max | Fireworks | 3 | 0.7 | $3.264 | 11/23 | 97.3s |
| #220 | Apodex 1.1 Mini high | Apodex | 9 | 0.7 | $0.000 | 11/23 | 31.2s |
| #221 | GLM 5.3 Flash low | Z.ai | 8 | 0.7 | $0.038 | 11/23 | 11.8s |
| #227 | Step 3.7 Flash high | Stepfun | 8 | 0.7 | $1.478 | 11/23 | 72.7s |
| #229 | KAT-Coder-Pro V2.5 low | Kwaipilot | 10 | 0.7 | $0.568 | 11/23 | 19.4s |
| #238 | KAT-Coder-Pro V2.5 high | Kwaipilot | 10 | 0.6 | $0.506 | 11/23 | 21.2s |
| #248 | Beam 1.0 501B A23B low | Reflection | 6 | 0.6 | $0.432 | 11/23 | 4.89s |
| #251 | MiMo-V2.5-Pro medium | Xiaomi | 4 | 0.6 | $0.332 | 11/23 | 56.7s |
| #255 | Qwen3.5-35B-A3B medium | Qwen | 3 | 0.6 | $0.716 | 11/23 | 111.5s |