Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Total Cost ↓.
Categories
291/291
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #156 | Hy3 preview medium | Tencent | 3 | 6.5 | $0.049 | 14/21 | 16.3s |
| #215 | KAT-Coder-Air V2.5 medium | Kwaipilot | 10 | 5.6 | $0.048 | 8/22 | 8.65s |
| #134 | Solar Pro 4 medium | Upstage | 5 | 6.8 | $0.047 | 12/22 | 127.6s |
| #171 | Gemini 3.1 Flash Lite minimal | 8 | 6.1 | $0.047 | 10/22 | 1.85s | |
| #243 | GLM 5 Turbo none | Z.ai | 13 | 5.1 | $0.047 | 6/21 | 2.82s |
| #116 | Solar Pro 4 high | Upstage | 5 | 7.1 | $0.046 | 11/22 | 120.6s |
| #175 | Gemini 3.1 Flash Lite none | 11 | 6.1 | $0.046 | 9/22 | 1.75s | |
| #223 | KAT-Coder-Air V2.5 low | Kwaipilot | 7 | 5.4 | $0.046 | 7/22 | 10.6s |
| #105 | DeepSeek V4 Flash 0731 medium | DeepSeek | 5 | 7.3 | $0.046 | 11/22 | 84.7s |
| #213 | Mimo V2 PRO none | Xiaomi | 11 | 5.6 | $0.045 | 7/21 | 2.27s |
| #161 | LongCat 2.0 none | Meituan | 13 | 6.4 | $0.044 | 8/22 | 5.17s |
| #133 | Solar Pro 4 low | Upstage | 6 | 6.8 | $0.044 | 11/22 | 136.1s |
| #166 | MiMo-V2-Flash medium | Xiaomi | 5 | 6.3 | $0.043 | 12/21 | 20.1s |
| #111 | Qwen3.7 Flash low | Qwen | 7 | 7.2 | $0.043 | 11/22 | 38.0s |
| #218 | Hy3 preview low | Tencent | 4 | 5.5 | $0.042 | 10/21 | 24.6s |