Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Total Cost ↓.
Categories
291/291
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #101 | KAT-Coder-Pro V2.5 low | Kwaipilot | 10 | 7.3 | $0.400 | 11/22 | 20.2s |
| #45 | Inkling Small high | Thinkingmachines | 6 | 8.4 | $0.398 | 14/22 | 30.4s |
| #198 | GPT-5.4 none | OpenAI | 14 | 5.8 | $0.397 | 7/22 | 2.08s |
| #115 | Step 3.7 Flash low | Stepfun | 9 | 7.1 | $0.390 | 11/22 | 17.9s |
| #187 | Gemini 3 PRO Preview medium | 3 | 6.0 | $0.385 | 14/21 | 9.05s | |
| #57 | Inkling medium | Thinkingmachines | 4 | 8.0 | $0.377 | 15/22 | 15.7s |
| #4 | GPT-5.6 Sol low | OpenAI | 4 | 9.5 | $0.357 | 18/22 | 9.04s |
| #165 | Mimo V2 PRO medium | Xiaomi | 5 | 6.3 | $0.333 | 12/21 | 22.2s |
| #266 | MiniMax M2.5 medium | Minimax | 7 | 4.6 | $0.327 | 5/22 | 69.1s |
| #2 | Gemini 3.7 Flash high | 2 | 9.8 | $0.323 | 20/22 | 12.2s | |
| #78 | GLM 5 Turbo medium | Z.ai | 4 | 7.6 | $0.323 | 14/21 | 23.0s |
| #110 | Qwen3.5 Plus 2026-04-20 medium | Qwen | 8 | 7.2 | $0.323 | 13/22 | 47.0s |
| #85 | MiniMax M3 medium | Minimax | 4 | 7.5 | $0.300 | 11/22 | 75.2s |
| #143 | Gemini 3.5 Flash minimal | 6 | 6.7 | $0.300 | 13/22 | 2.65s | |
| #43 | Qwen3.8 27B high | Qwen | 2 | 8.4 | ~$0.287 | 16/22 | 167.9s |