Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Tests Correct ↑.
Categories
219/219
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #21 | GPT-5.4 medium | OpenAI | 5 | 8.5 | $1.533 | 15/22 | 23.1s |
| #28 | Gemini 2.5 Flash medium | 6 | 8.2 | $0.643 | 15/22 | 21.2s | |
| #32 | Inkling high | Thinkingmachines | 4 | 8.0 | $1.006 | 15/22 | 64.2s |
| #36 | Inkling medium | Thinkingmachines | 4 | 8.0 | $0.391 | 15/22 | 16.2s |
| #40 | Qwen3.7 Plus medium | Qwen | 5 | 7.9 | $0.267 | 15/22 | 51.5s |
| #41 | Qwen3.6 Plus medium | Qwen | 5 | 7.8 | $0.405 | 15/22 | 43.1s |
| #48 | GPT-5.6 Luna high | OpenAI | 7 | 7.7 | $1.017 | 15/22 | 18.7s |
| #63 | Qwen3.7 Max none | Qwen | 7 | 7.4 | $0.197 | 15/22 | 4.52s |
| #83 | Gemini 3.5 Flash none | 3 | 7.0 | $1.079 | 15/22 | 9.93s | |
| #42 | GLM 5.2 medium | Z.ai | 3 | 7.8 | $0.182 | 15/21 | 23.3s |
| #46 | GLM 5 medium | Z.ai | 3 | 7.7 | $0.307 | 15/21 | 33.5s |
| #16 | GPT-5.3-Codex medium | OpenAI | 4 | 8.9 | $0.920 | 16/22 | 17.0s |
| #22 | Qwen3.6 Max Preview medium | Qwen | 5 | 8.4 | $1.143 | 16/22 | 67.5s |
| #23 | Grok 4.5 low | X AI | 6 | 8.4 | $0.935 | 16/22 | 15.6s |
| #25 | Grok 4.5 medium | X AI | 6 | 8.3 | $1.928 | 16/22 | 61.7s |