Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Tests Correct ↑.
Categories
219/219
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #82 | Mercury 2 medium | Inception | 8 | 7.0 | $0.093 | 10/22 | 2.72s |
| #86 | DeepSeek V4 Pro none | DeepSeek | 8 | 6.9 | $0.096 | 10/22 | 11.6s |
| #96 | LongCat 2.0 low | Meituan | 8 | 6.7 | $0.391 | 10/22 | 100.3s |
| #105 | Qwen3.6 27B medium | Qwen | 6 | 6.5 | $0.779 | 10/22 | 106.3s |
| #113 | Qwen3.5 Plus 2026-02-15 none | Qwen | 12 | 6.4 | $0.073 | 10/22 | 9.85s |
| #121 | Gemma 4 31B none | 9 | 6.2 | $0.021 | 10/22 | 5.34s | |
| #123 | GPT-5.6 Luna low | OpenAI | 10 | 6.2 | $0.249 | 10/22 | 5.04s |
| #126 | Gemini 3.1 Flash Lite minimal | 8 | 6.1 | $0.047 | 10/22 | 1.86s | |
| #129 | Inkling low | Thinkingmachines | 8 | 6.1 | $0.187 | 10/22 | 5.15s |
| #184 | Qwen3.6 Plus Preview medium | Qwen | 2 | 4.9 | $0.000 | 9/19 | 15.2s |
| #194 | Grok 4.1 Fast medium | X AI | 4 | 4.7 | $0.069 | 9/19 | 23.8s |
| #195 | Laguna M.1 medium | Poolside | 4 | 4.7 | $0.033 | 9/19 | 14.7s |
| #140 | Mimo V2 Omni medium | Xiaomi | 5 | 5.9 | $0.683 | 10/21 | 41.2s |
| #159 | Hy3 preview low | Tencent | 4 | 5.5 | $0.015 | 10/21 | 24.6s |
| #66 | KAT-Coder-Pro V2.5 low | Kwaipilot | 10 | 7.4 | $0.387 | 11/22 | 19.5s |