Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Tests Correct ↑.
Categories
447/447
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #52 | Gemini 3.6 Flash low | 4 | 0.9 | $0.363 | 19/23 | 6.82s | |
| #79 | Grok 4.6 high | X AI | 3 | 0.9 | $2.629 | 19/23 | 87.5s |
| #83 | Claude Haiku 5.5 max | Anthropic | 1 | 0.8 | $0.509 | 19/23 | 61.7s |
| #95 | Gemini 3.5 Flash high | 2 | 0.8 | $2.737 | 19/23 | 18.6s | |
| #116 | Gemini 3.8 Flash medium | 2 | 0.8 | $0.769 | 19/23 | 16.6s | |
| #121 | Claude Fable 5.1 high | Anthropic | 3 | 0.8 | $3.471 | 19/23 | 13.3s |
| #326 | Claude Opus 4.7 none | Anthropic | 3 | 0.5 | $0.505 | 16/19 | 3.02s |
| #21 | GPT-6 Astra medium | OpenAI | 3 | 0.9 | $2.707 | 20/23 | 9.90s |
| #23 | GPT-5.5 low | OpenAI | 3 | 0.9 | $1.822 | 20/23 | 11.9s |
| #31 | Claude Opus 5.5 medium | Anthropic | 2 | 0.9 | $1.804 | 20/23 | 25.9s |
| #88 | Gemini 3.1 Pro Preview medium | 2 | 0.8 | $1.585 | 20/23 | 22.7s | |
| #9 | Gemini 3.7 Flash high | 2 | 1.0 | $0.528 | 21/23 | 15.1s | |
| #10 | Gemini 3.6 Flash medium | 2 | 1.0 | $0.577 | 21/23 | 14.0s | |
| #11 | GPT-6.1 Sol medium | OpenAI | 2 | 1.0 | $0.530 | 21/23 | 8.90s |
| #12 | GPT-6.1 Sol high | OpenAI | 2 | 1.0 | $0.755 | 21/23 | 15.5s |