Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Failure Count ↑.
Categories
313/313
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #83 | Claude Opus 4.8 low | Anthropic | 4 | 7.8 | $2.089 | 16/22 | 12.9s |
| #87 | Claude Opus 4.6 medium | Anthropic | 4 | 7.7 | $2.961 | 13/22 | 32.2s |
| #90 | GLM 5 Turbo medium | Z.ai | 4 | 7.6 | $0.323 | 14/21 | 23.0s |
| #92 | Solar Pro 4 xhigh | Upstage | 4 | 7.6 | $0.050 | 12/22 | 134.9s |
| #97 | MiniMax M3 medium | Minimax | 4 | 7.5 | $0.300 | 11/22 | 75.2s |
| #99 | Qwen3.5 Plus 2026-02-15 medium | Qwen | 4 | 7.5 | $0.459 | 14/22 | 91.8s |
| #100 | Qwen3.5-27B medium | Qwen | 4 | 7.5 | $0.982 | 13/22 | 113.3s |
| #101 | Mercury 2.5 Preview medium | Inception | 4 | 7.5 | $0.024 | 15/22 | 3.58s |
| #116 | GLM 5.3 Flash high | Z.ai | 4 | 7.3 | $0.029 | 13/22 | 25.4s |
| #120 | Claude Opus 4.8 none | Anthropic | 4 | 7.3 | $1.166 | 13/22 | 4.92s |
| #134 | GLM 5.1 medium | Z.ai | 4 | 7.0 | $0.727 | 12/22 | 58.8s |
| #141 | Claude Fable 5.1 low | Anthropic | 4 | 6.9 | $2.565 | 11/22 | 10.3s |
| #143 | Seed-2.0-Code high | Bytedance Seed | 4 | 6.9 | $1.273 | 11/22 | 124.2s |
| #144 | Gemini 3.5 Flash none | 4 | 6.9 | $1.093 | 14/22 | 10.2s | |
| #147 | Seed-2.0-Code medium | Bytedance Seed | 4 | 6.8 | $1.153 | 10/22 | 101.1s |