Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Total Cost ↓.
Categories
291/291
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #22 | GPT-5.3-Codex medium | OpenAI | 4 | 8.9 | $0.988 | 16/22 | 16.9s |
| #88 | Qwen3.5-27B medium | Qwen | 4 | 7.5 | $0.982 | 13/22 | 113.3s |
| #120 | GLM 5.1 medium | Z.ai | 4 | 7.0 | $0.948 | 12/22 | 58.8s |
| #41 | Grok 4.5 low | X AI | 6 | 8.4 | $0.945 | 16/22 | 16.2s |
| #48 | Claude Sonnet 5 medium | Anthropic | 5 | 8.2 | $0.922 | 15/22 | 12.5s |
| #154 | Qwen3.6 27B medium | Qwen | 5 | 6.5 | $0.907 | 10/22 | 106.1s |
| #58 | GPT-5.6 Terra high | OpenAI | 7 | 8.0 | $0.836 | 14/22 | 11.2s |
| #123 | Grok 4.20 medium | X AI | 6 | 7.0 | $0.805 | 11/22 | 32.6s |
| #178 | Trinity Large Thinking medium | Arcee AI | 8 | 6.1 | $0.798 | 8/22 | 85.4s |
| #89 | GPT-5.4 Mini medium | OpenAI | 6 | 7.5 | $0.786 | 12/22 | 26.7s |
| #81 | Nemotron 3 Ultra medium | NVIDIA | 7 | 7.6 | $0.780 | 13/22 | 33.6s |
| #20 | Qwen3.8 Max medium | Qwen | 4 | 9.0 | $0.771 | 17/22 | 23.3s |
| #74 | Seed-2.0-Code low | Bytedance Seed | 6 | 7.7 | $0.767 | 13/22 | 72.2s |
| #5 | Gemini 3 Flash Preview medium | 2 | 9.5 | $0.763 | 20/22 | 19.9s | |
| #185 | Grok 4.20 Beta medium | X AI | 3 | 6.0 | $0.750 | 14/18 | 9.75s |