Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Total Cost ↑.
Categories
447/447
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #396 | MiniMax M2.5 medium | Minimax | 7 | 0.4 | $0.440 | 5/23 | 102.3s |
| #170 | Gemini 3.5 Flash Lite medium | 6 | 0.7 | $0.440 | 14/23 | 8.68s | |
| #179 | Step 3.7 Flash low | Stepfun | 9 | 0.7 | $0.449 | 11/23 | 20.7s |
| #123 | Qwen3.7 Max none | Qwen | 7 | 0.8 | $0.451 | 16/23 | 7.85s |
| #237 | GLM 5.1 none | Z.ai | 12 | 0.6 | $0.451 | 9/23 | 11.1s |
| #324 | GLM 5V Turbo medium | Z.ai | 7 | 0.5 | $0.457 | 11/21 | 23.1s |
| #16 | GPT-6.1 Sol low | OpenAI | 2 | 1.0 | $0.460 | 21/23 | 7.15s |
| #136 | DeepSeek V4 Flash 0731 medium | DeepSeek | 5 | 0.8 | $0.460 | 12/23 | 94.2s |
| #72 | GPT-6 Sol low | OpenAI | 5 | 0.9 | $0.477 | 18/23 | 8.72s |
| #178 | GLM 5 medium | Z.ai | 4 | 0.7 | $0.479 | 15/22 | 39.0s |
| #105 | GPT-5.6 Terra medium | OpenAI | 8 | 0.8 | $0.483 | 15/23 | 8.93s |
| #319 | Kimi K2.6 none | Moonshot AI | 13 | 0.5 | $0.486 | 6/23 | 26.3s |
| #112 | DeepSeek V4.1 Flash low | DeepSeek | 7 | 0.8 | $0.494 | 15/23 | 28.0s |
| #131 | GLM 5.3 high | Z.ai | 6 | 0.8 | $0.495 | 14/23 | 28.4s |
| #228 | Beam 1.0 501B A23B medium | Reflection | 6 | 0.7 | $0.499 | 14/23 | 6.27s |