Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one.
Categories
447/447
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #6 | GPT-6.1 Sol xhigh | OpenAI | 1 | 1.0 | $1.377 | 22/23 | 33.1s |
| #7 | GPT-6 Astra high | OpenAI | 1 | 1.0 | $4.458 | 22/23 | 20.2s |
| #8 | GPT-6 Astra xhigh | OpenAI | 1 | 1.0 | $6.213 | 22/23 | 29.7s |
| #17 | Gemini 4 Argon high | 1 | 1.0 | $1.802 | 21/23 | 19.0s | |
| #58 | Claude Fable 5 medium | Anthropic | 1 | 0.9 | $5.089 | 18/23 | 16.8s |
| #83 | Claude Haiku 5.5 max | Anthropic | 1 | 0.8 | $0.509 | 19/23 | 61.7s |
| #202 | Claude Sonnet 5.5 low | Anthropic | 1 | 0.7 | $0.909 | 10/23 | 7.46s |
| #230 | Claude Sonnet 5.5 medium | Anthropic | 1 | 0.7 | $1.100 | 9/23 | 8.03s |
| #420 | Command A+ medium | Cohere | 1 | 0.3 | $0.064 | 0/23 | 91.7s |
| #426 | Command A+ high | Cohere | 1 | 0.3 | $0.079 | 0/23 | 90.0s |
| #430 | Command A+ low | Cohere | 1 | 0.3 | $0.073 | 0/23 | 92.5s |
| #446 | Step 3.5 Flash none | Stepfun | 1 | 0.2 | $0.020 | 6/12 | 39.0s |