Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Total Cost ↓.
Categories
291/291
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #245 | MiniMax M2.7 medium | Minimax | 6 | 5.0 | $0.208 | 5/22 | 43.2s |
| #118 | GPT-5.6 Sol none | OpenAI | 9 | 7.0 | $0.201 | 12/22 | 2.17s |
| #92 | Qwen3.7 Max none | Qwen | 7 | 7.4 | $0.197 | 15/22 | 4.56s |
| #135 | DeepSeek V4 Pro none | DeepSeek | 9 | 6.8 | $0.191 | 9/22 | 11.7s |
| #140 | GLM 5.2 none | Z.ai | 7 | 6.7 | $0.188 | 13/22 | 9.65s |
| #114 | Muse Glimmer 30B low | Meta | 6 | 7.1 | $0.187 | 11/22 | 18.6s |
| #98 | Gemini 3 Flash Preview low | 6 | 7.4 | $0.185 | 16/22 | 6.51s | |
| #177 | Inkling low | Thinkingmachines | 8 | 6.1 | $0.181 | 10/22 | 5.11s |
| #79 | GPT-5.6 Luna high | OpenAI | 8 | 7.6 | $0.179 | 14/22 | 16.5s |
| #271 | GLM 4.7 Flash medium | Z.ai | 9 | 4.3 | $0.168 | 4/22 | 134.3s |
| #237 | Nemotron 3.5 Lightning medium | NVIDIA | 13 | 5.1 | $0.156 | 5/22 | 70.1s |
| #7 | Gemini 3.7 Flash medium | 2 | 9.4 | $0.155 | 20/22 | 5.87s | |
| #231 | Seed-2.0-Code none | Bytedance Seed | 11 | 5.3 | $0.151 | 6/22 | 14.7s |
| #190 | Qwen3.5-35B-A3B none | Qwen | 13 | 5.9 | $0.142 | 6/22 | 12.7s |
| #236 | Inkling none | Thinkingmachines | 13 | 5.2 | $0.142 | 6/22 | 3.47s |