Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Tests Correct ↑.
Categories
447/447
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #207 | Mercury 2.5 Preview medium | Inception | 4 | 0.7 | $0.039 | 15/23 | 6.66s |
| #272 | GLM 5 Turbo medium | Z.ai | 4 | 0.6 | $0.323 | 14/21 | 23.0s |
| #333 | Hy3 preview medium | Tencent | 3 | 0.5 | $0.049 | 14/21 | 16.3s |
| #362 | Gemini 3 PRO Preview medium | 3 | 0.5 | $0.385 | 14/21 | 9.05s | |
| #178 | GLM 5 medium | Z.ai | 4 | 0.7 | $0.479 | 15/22 | 39.0s |
| #36 | DeepSeek V4.1 Flash 1017 low | DeepSeek | 5 | 0.9 | $0.355 | 16/23 | 32.5s |
| #45 | Muse Spark Open xhigh | Meta | 2 | 0.9 | $2.081 | 16/23 | 92.4s |
| #54 | Muse Spark Open low | Meta | 4 | 0.9 | $0.600 | 16/23 | 21.6s |
| #57 | Muse Spark 1.1 medium | Meta | 4 | 0.9 | $1.665 | 16/23 | 27.0s |
| #62 | GPT-5.4 medium | OpenAI | 5 | 0.9 | $2.213 | 16/23 | 24.8s |
| #64 | DeepSeek V4.1 Flash high | DeepSeek | 5 | 0.9 | $0.617 | 16/23 | 33.3s |
| #65 | DeepSeek V4.1 Flash medium | DeepSeek | 5 | 0.9 | $0.591 | 16/23 | 32.9s |
| #67 | Muse Spark 1.2 low | Meta | 4 | 0.9 | $0.881 | 16/23 | 11.8s |
| #71 | Seed 2.1 Turbo medium | Bytedance Seed | 5 | 0.9 | $2.042 | 16/23 | 189.1s |
| #75 | Claude Sonnet 5.5 xhigh | Anthropic | 3 | 0.9 | $1.516 | 16/23 | 15.0s |