Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Total Cost ↑.
Categories
447/447
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #60 | Kimi K3.1 Pro low | Moonshot AI | 5 | 0.9 | $1.836 | 17/23 | 47.5s |
| #329 | Hy4 preview low | Tencent | 13 | 0.5 | $1.844 | 3/23 | 207.2s |
| #59 | Pareto 26.9 default | Unbiased | 6 | 0.9 | $1.864 | 15/23 | 28.3s |
| #40 | Muse Spark 1.3 high | Meta | 3 | 0.9 | $1.891 | 17/23 | 52.9s |
| #43 | Seed 2.1 Turbo high | Bytedance Seed | 4 | 0.9 | $1.892 | 17/23 | 170.5s |
| #159 | Grok 4.7 low | X AI | 6 | 0.7 | $1.933 | 14/23 | 63.2s |
| #55 | Muse Spark 1.2 high | Meta | 4 | 0.9 | $2.018 | 15/23 | 28.1s |
| #71 | Seed 2.1 Turbo medium | Bytedance Seed | 5 | 0.9 | $2.042 | 16/23 | 189.1s |
| #378 | Gemini 3.1 Flash Lite high | 4 | 0.5 | $2.044 | 10/18 | 62.0s | |
| #45 | Muse Spark Open xhigh | Meta | 2 | 0.9 | $2.081 | 16/23 | 92.4s |
| #245 | Claude Sonnet 4.6 medium | Anthropic | 4 | 0.6 | $2.126 | 14/22 | 28.1s |
| #25 | Claude Opus 5.5 high | Anthropic | 2 | 0.9 | $2.133 | 19/23 | 27.6s |
| #14 | GPT-6 Astra low | OpenAI | 2 | 1.0 | $2.160 | 21/23 | 7.01s |
| #62 | GPT-5.4 medium | OpenAI | 5 | 0.9 | $2.213 | 16/23 | 24.8s |
| #133 | Grok 4.6 medium | X AI | 6 | 0.8 | $2.270 | 16/23 | 74.8s |