Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one.
Categories
447/447
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #334 | GPT-5.6 Luna none | OpenAI | 15 | 0.5 | $0.042 | 6/23 | 3.78s |
| #359 | Inkling Small none | Thinkingmachines | 15 | 0.5 | $0.054 | 5/23 | 1.45s |
| #360 | Qwen3 Coder Next default | Qwen | 15 | 0.5 | $0.067 | 5/23 | 19.7s |
| #365 | Qwen3.5-9B none | Qwen | 15 | 0.5 | $0.041 | 4/23 | 37.2s |
| #369 | GLM 4.7 Flash none | Z.ai | 15 | 0.5 | $0.027 | 5/23 | 13.0s |
| #375 | Qwen3 Coder Next medium | Qwen | 15 | 0.5 | $0.071 | 3/23 | 17.0s |
| #400 | Mercury 2.5 none | Inception | 15 | 0.4 | $0.026 | 2/23 | 5.10s |
| #213 | Qwen3.5-Flash none | Qwen | 14 | 0.7 | $0.089 | 8/23 | 26.5s |
| #290 | Seed-2.0-Lite none | Bytedance Seed | 14 | 0.6 | $0.114 | 8/23 | 7.49s |
| #297 | Qwen3.7 Flash none | Qwen | 14 | 0.6 | $0.028 | 7/23 | 14.7s |
| #298 | Qwen3.8 Flash Next none | Qwen | 14 | 0.6 | ~$0.011 | 8/23 | 5.71s |
| #299 | DeepSeek V4.1 Flash 1017 none | DeepSeek | 14 | 0.6 | $0.055 | 8/23 | 3.46s |
| #306 | GPT-5.4 Mini none | OpenAI | 14 | 0.6 | $0.170 | 6/23 | 3.34s |
| #313 | Solar Pro 4 none | Upstage | 14 | 0.6 | $0.022 | 7/23 | 8.14s |
| #316 | Qwen3.5-35B-A3B none | Qwen | 14 | 0.6 | $0.120 | 6/23 | 18.3s |