Puzzle Solving: Wrong answer
Puzzle Solving
Wrong answer
See which AI models are most likely to hit Wrong answer on Puzzle Solving, so you can spot weak points faster. Sort by: Total Cost ↑.
Failure Reasons
145/145
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #121 | Gemma 4 31B none | 1 | 6.5 | $0.021 | 1/3 | 4.23s | |
| #175 | Qwen3.5-9B none | Qwen | 2 | 3.2 | $0.021 | 0/3 | 621ms |
| #171 | Mistral Small 4 none | Mistral | 2 | 3.1 | $0.022 | 0/3 | 399ms |
| #172 | Qwen3 Coder Next none | Qwen | 3 | 3.0 | $0.025 | 0/3 | 24.3s |
| #206 | MiMo-V2-Flash none | Xiaomi | 2 | 5.3 | $0.025 | 1/3 | 1.86s |
| #174 | MiMo-V2.5 none | Xiaomi | 1 | 5.4 | $0.025 | 1/3 | 2.13s |
| #195 | Mercury 2 none | Inception | 3 | 3.1 | $0.030 | 0/3 | 535ms |
| #193 | Qwen3 Coder Next medium | Qwen | 2 | 3.0 | $0.032 | 0/3 | 1.25s |
| #192 | Laguna M.1 medium | Poolside | 1 | 5.3 | $0.033 | 1/3 | 10.2s |
| #210 | Qwen3.5-9B medium | Qwen | 1 | 3.0 | $0.036 | 0/3 | 32.3s |
| #147 | GLM 5 none | Z.ai | 1 | 7.7 | $0.041 | 2/3 | 1.91s |
| #186 | GPT-5.4 Nano none | OpenAI | 1 | 5.4 | $0.041 | 1/3 | 1.25s |
| #164 | KAT-Coder-Air V2.5 low | Kwaipilot | 2 | 3.1 | $0.041 | 0/3 | 1.57s |
| #156 | DeepSeek V4 Flash none | DeepSeek | 1 | 3.1 | $0.042 | 0/3 | 23.7s |
| #119 | MiMo-V2-Flash medium | Xiaomi | 1 | 7.7 | $0.043 | 2/3 | 3.87s |