Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Total Cost ↑.
Categories
291/291
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #116 | Solar Pro 4 high | Upstage | 5 | 7.1 | $0.046 | 11/22 | 120.6s |
| #243 | GLM 5 Turbo none | Z.ai | 13 | 5.1 | $0.047 | 6/21 | 2.82s |
| #171 | Gemini 3.1 Flash Lite minimal | 8 | 6.1 | $0.047 | 10/22 | 1.85s | |
| #134 | Solar Pro 4 medium | Upstage | 5 | 6.8 | $0.047 | 12/22 | 127.6s |
| #215 | KAT-Coder-Air V2.5 medium | Kwaipilot | 10 | 5.6 | $0.048 | 8/22 | 8.65s |
| #156 | Hy3 preview medium | Tencent | 3 | 6.5 | $0.049 | 14/21 | 16.3s |
| #201 | Nemotron 3 Super medium | NVIDIA | 5 | 5.7 | $0.050 | 8/22 | 52.3s |
| #80 | Solar Pro 4 xhigh | Upstage | 4 | 7.6 | $0.050 | 12/22 | 134.9s |
| #169 | GPT-5.6 Luna low | OpenAI | 10 | 6.2 | $0.051 | 10/22 | 5.20s |
| #247 | DeepSeek V3.2 none | DeepSeek | 8 | 5.0 | $0.052 | 6/22 | 17.9s |
| #157 | Gemini 3.1 Flash Lite Preview none | 7 | 6.4 | $0.052 | 12/22 | 1.56s | |
| #210 | GLM 5V Turbo none | Z.ai | 11 | 5.6 | $0.052 | 8/21 | 2.99s |
| #72 | Qwen3.7 Flash high | Qwen | 7 | 7.8 | $0.052 | 13/22 | 41.4s |
| #222 | Laguna S 2.1 medium | Poolside | 13 | 5.4 | $0.053 | 4/22 | 58.4s |
| #229 | Inkling Small none | Thinkingmachines | 15 | 5.3 | $0.054 | 5/22 | 1.51s |