Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Tests Correct ↑.
Categories
447/447
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #110 | Claude Opus 4.7 medium | Anthropic | 3 | 0.8 | $3.636 | 18/23 | 14.1s |
| #124 | Gemini 3.5 Flash medium | 3 | 0.8 | $1.316 | 18/23 | 11.8s | |
| #395 | Gemini 3.1 Flash Lite Preview high | 2 | 0.4 | $2.310 | 13/16 | 68.1s | |
| #13 | GPT-5.6 Sol low | OpenAI | 4 | 1.0 | $1.244 | 19/23 | 11.1s |
| #20 | GPT-5.6 Sol medium | OpenAI | 4 | 0.9 | $1.700 | 19/23 | 14.6s |
| #22 | GPT-5.6 Sol high | OpenAI | 4 | 0.9 | $1.595 | 19/23 | 13.6s |
| #24 | Claude Opus 5.5 low | Anthropic | 2 | 0.9 | $1.733 | 19/23 | 25.7s |
| #25 | Claude Opus 5.5 high | Anthropic | 2 | 0.9 | $2.133 | 19/23 | 27.6s |
| #27 | Claude Opus 5 high | Anthropic | 2 | 0.9 | $4.524 | 19/23 | 25.3s |
| #28 | Claude Opus 5 medium | Anthropic | 3 | 0.9 | $2.870 | 19/23 | 13.2s |
| #33 | GPT-5.5 medium | OpenAI | 4 | 0.9 | $4.809 | 19/23 | 39.9s |
| #42 | Pareto default | Unbiased | 3 | 0.9 | $1.520 | 19/23 | 33.5s |
| #46 | Gemini 3.5 Flash low | 3 | 0.9 | $0.752 | 19/23 | 7.85s | |
| #50 | Gemini 4 Argon medium | 4 | 0.9 | $0.674 | 19/23 | 6.63s | |
| #51 | Claude Opus 5 low | Anthropic | 4 | 0.9 | $2.350 | 19/23 | 9.87s |