Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one.
Categories
313/313
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #93 | Nemotron 3 Ultra medium | NVIDIA | 7 | 7.6 | $0.701 | 13/22 | 33.6s |
| #106 | Qwen3.7 Max none | Qwen | 7 | 7.4 | $0.197 | 15/22 | 4.56s |
| #109 | LongCat 2.0 medium | Meituan | 7 | 7.4 | $0.499 | 12/22 | 143.6s |
| #111 | Grok 4.6 low | X AI | 7 | 7.4 | $0.449 | 15/22 | 14.6s |
| #117 | Gemini 3.1 Flash Lite medium | 7 | 7.3 | $0.120 | 13/22 | 4.38s | |
| #123 | Muse Glimmer 30B high | Meta | 7 | 7.2 | $0.397 | 10/22 | 66.7s |
| #125 | Qwen3.7 Flash low | Qwen | 7 | 7.2 | $0.043 | 11/22 | 38.0s |
| #146 | Step 3.7 Flash high | Stepfun | 7 | 6.8 | $1.229 | 11/22 | 70.1s |
| #155 | GLM 5.2 none | Z.ai | 7 | 6.7 | $0.153 | 13/22 | 9.65s |
| #157 | LongCat 2.0 low | Meituan | 7 | 6.7 | $0.412 | 10/22 | 113.6s |
| #159 | GLM 5V Turbo medium | Z.ai | 7 | 6.7 | $0.457 | 11/21 | 23.1s |
| #160 | LongCat 2.0 high | Meituan | 7 | 6.7 | $0.492 | 9/22 | 153.3s |
| #173 | Gemini 3.1 Flash Lite Preview none | 7 | 6.4 | $0.052 | 12/22 | 1.56s | |
| #175 | Dots 3 Note Preview low | Dots Studio | 7 | 6.4 | $0.000 | 10/22 | 61.8s |
| #179 | Ling-3.0-flash high | Inclusionai | 7 | 6.4 | $0.021 | 12/22 | 13.7s |