Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Total Cost ↑.
Categories
225/225
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #55 | Grok Build 0.1 medium | X AI | 5 | 7.6 | $1.097 | 14/22 | 52.1s |
| #13 | Qwen3.7 Max medium | Qwen | 3 | 9.2 | $1.116 | 18/22 | 40.6s |
| #23 | Claude Opus 5 low | Anthropic | 5 | 8.6 | $1.121 | 17/22 | 6.99s |
| #25 | Qwen3.6 Max Preview medium | Qwen | 5 | 8.4 | $1.143 | 16/22 | 67.5s |
| #74 | Claude Opus 4.8 none | Anthropic | 4 | 7.3 | $1.166 | 13/22 | 4.91s |
| #94 | Step 3.7 Flash high | Stepfun | 6 | 6.9 | $1.207 | 11/22 | 64.7s |
| #8 | GPT-5.6 Sol high | OpenAI | 4 | 9.4 | $1.234 | 18/22 | 11.7s |
| #9 | GPT-5.5 low | OpenAI | 3 | 9.3 | $1.253 | 19/22 | 10.1s |
| #7 | GPT-5.6 Sol medium | OpenAI | 4 | 9.4 | $1.316 | 18/22 | 11.4s |
| #21 | Muse Spark 1.1 medium | Meta | 4 | 8.6 | $1.357 | 15/22 | 25.0s |
| #10 | Gemini 3.1 Pro Preview medium | 2 | 9.2 | $1.361 | 20/22 | 21.5s | |
| #20 | Claude Opus 4.7 medium | Anthropic | 3 | 8.7 | $1.477 | 18/22 | 7.61s |
| #12 | Claude Opus 5 medium | Anthropic | 3 | 9.2 | $1.486 | 18/22 | 9.38s |
| #24 | GPT-5.4 medium | OpenAI | 5 | 8.5 | $1.533 | 15/22 | 23.1s |
| #59 | Claude Opus 5 none | Anthropic | 6 | 7.5 | $1.550 | 12/22 | 7.60s |