Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Score ↑.
Categories
447/447
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #29 | Seed 2.1 Turbo low | Bytedance Seed | 3 | 0.9 | $1.645 | 18/23 | 161.2s |
| #28 | Claude Opus 5 medium | Anthropic | 3 | 0.9 | $2.870 | 19/23 | 13.2s |
| #27 | Claude Opus 5 high | Anthropic | 2 | 0.9 | $4.524 | 19/23 | 25.3s |
| #26 | Gemini 3.7 Flash low | 2 | 0.9 | $0.183 | 21/23 | 6.24s | |
| #25 | Claude Opus 5.5 high | Anthropic | 2 | 0.9 | $2.133 | 19/23 | 27.6s |
| #24 | Claude Opus 5.5 low | Anthropic | 2 | 0.9 | $1.733 | 19/23 | 25.7s |
| #23 | GPT-5.5 low | OpenAI | 3 | 0.9 | $1.822 | 20/23 | 11.9s |
| #22 | GPT-5.6 Sol high | OpenAI | 4 | 0.9 | $1.595 | 19/23 | 13.6s |
| #21 | GPT-6 Astra medium | OpenAI | 3 | 0.9 | $2.707 | 20/23 | 9.90s |
| #19 | GPT-6 Sol medium | OpenAI | 2 | 0.9 | $0.703 | 21/23 | 12.1s |
| #20 | GPT-5.6 Sol medium | OpenAI | 4 | 0.9 | $1.700 | 19/23 | 14.6s |
| #18 | Gemini 3.7 Flash medium | 2 | 1.0 | $0.278 | 21/23 | 8.16s | |
| #17 | Gemini 4 Argon high | 1 | 1.0 | $1.802 | 21/23 | 19.0s | |
| #16 | GPT-6.1 Sol low | OpenAI | 2 | 1.0 | $0.460 | 21/23 | 7.15s |
| #15 | Gemini 3 Flash Preview medium | 2 | 1.0 | $0.876 | 21/23 | 21.6s |