Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Tests Correct ↑.
Categories
447/447
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #315 | GLM 5 none | Z.ai | 13 | 0.6 | $0.140 | 9/22 | 8.74s |
| #436 | Decider V1.2 default | Perplexity | 5 | 0.3 | $0.001 | 5/12 | 517ms |
| #450 | Solar Decide Flash default | Upstage | 4 | 0.2 | $0.003 | 3/7 | 1.33s |
| #453 | Tev1 4B Experimental default | Togethercomputer | 4 | 1.0 | $0.002 | 3/7 | 498ms |
| #161 | DeepSeek V4 Pro 0423 none | DeepSeek | 9 | 0.7 | $0.083 | 10/23 | 14.1s |
| #168 | LongCat 2.0 high | Meituan | 7 | 0.7 | $0.778 | 10/23 | 151.7s |
| #171 | Qwen3.5-27B none | Qwen | 11 | 0.7 | $0.116 | 10/23 | 9.98s |
| #192 | Step 5 Preview high | Stepfun | 3 | 0.7 | $4.513 | 10/23 | 154.4s |
| #202 | Claude Sonnet 5.5 low | Anthropic | 1 | 0.7 | $0.909 | 10/23 | 7.46s |
| #224 | Qwen3.7 Flash medium | Qwen | 8 | 0.7 | $0.076 | 10/23 | 51.8s |
| #225 | LongCat 2.0 low | Meituan | 8 | 0.7 | $0.630 | 10/23 | 115.0s |
| #226 | Mercury 2 medium | Inception | 9 | 0.7 | $0.121 | 10/23 | 4.40s |
| #246 | Minimax M3.1 Flash xhigh | Minimax | 9 | 0.6 | $0.000 | 10/23 | 21.7s |
| #247 | Kimi K2.5 medium | Moonshot AI | 5 | 0.6 | $0.841 | 10/23 | 125.8s |
| #252 | Dots 3 Note Preview high | Dots Studio | 9 | 0.6 | $0.000 | 10/23 | 70.5s |