Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Total Cost ↑.
Categories
291/291
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #106 | Claude Opus 4.8 none | Anthropic | 4 | 7.3 | $1.166 | 13/22 | 4.92s |
| #42 | GPT-5.2 medium | OpenAI | 3 | 8.4 | $1.182 | 14/22 | 28.5s |
| #131 | Step 3.7 Flash high | Stepfun | 7 | 6.8 | $1.229 | 11/22 | 70.1s |
| #107 | Kimi K2.6 medium | Moonshot AI | 3 | 7.2 | $1.247 | 12/22 | 115.9s |
| #10 | GPT-5.5 low | OpenAI | 3 | 9.3 | $1.257 | 19/22 | 10.1s |
| #128 | Seed-2.0-Code high | Bytedance Seed | 4 | 6.9 | $1.273 | 11/22 | 124.2s |
| #32 | Muse Spark 1.2 medium | Meta | 3 | 8.6 | $1.339 | 14/22 | 19.7s |
| #12 | Gemini 3.1 Pro Preview medium | 2 | 9.2 | $1.352 | 20/22 | 20.6s | |
| #33 | Muse Spark 1.1 medium | Meta | 4 | 8.6 | $1.420 | 15/22 | 26.2s |
| #56 | GLM 5.2 high | Z.ai | 2 | 8.0 | $1.463 | 14/22 | 69.9s |
| #30 | Claude Opus 4.7 medium | Anthropic | 3 | 8.7 | $1.476 | 18/22 | 7.62s |
| #16 | Seed 2.1 Turbo low | Bytedance Seed | 3 | 9.1 | $1.546 | 17/22 | 163.9s |
| #82 | Claude Opus 5 none | Anthropic | 6 | 7.5 | $1.550 | 12/22 | 7.65s |
| #37 | GPT-5.4 medium | OpenAI | 5 | 8.5 | $1.560 | 15/22 | 22.9s |
| #15 | Claude Opus 5 medium | Anthropic | 3 | 9.2 | $1.586 | 18/22 | 10.3s |