Puzzle Solving: Wrong answer
Puzzle Solving
Wrong answer
See which AI models are most likely to hit Wrong answer on Puzzle Solving, so you can spot weak points faster. Sort by: Response Time (avg) ↑.
Failure Reasons
246/246
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #140 | Qwen3.7 Flash low | Qwen | 1 | 0.7 | $0.071 | 1/3 | 9.79s |
| #403 | Laguna M.1 medium | Poolside | 1 | 0.5 | $0.033 | 1/3 | 10.2s |
| #243 | Minimax M3.1 Flash xhigh | Minimax | 1 | 0.8 | $0.000 | 2/3 | 10.2s |
| #224 | Step 3.7 Flash high | Stepfun | 2 | 0.5 | $1.478 | 1/3 | 10.2s |
| #321 | GLM 5V Turbo medium | Z.ai | 1 | 0.8 | $0.457 | 2/3 | 10.2s |
| #368 | Nemotron 3.5 Lightning medium | NVIDIA | 3 | 0.4 | $0.195 | 0/3 | 10.5s |
| #87 | Inkling high | Thinkingmachines | 1 | 0.7 | $1.238 | 1/3 | 10.7s |
| #173 | Qwen3.7 Flash high | Qwen | 1 | 0.7 | $0.063 | 1/3 | 10.8s |
| #210 | Qwen3.5-Flash none | Qwen | 3 | 0.3 | $0.089 | 0/3 | 10.9s |
| #393 | MiniMax M2.5 medium | Minimax | 1 | 0.5 | $0.440 | 1/3 | 11.2s |
| #100 | DeepSeek V4.1 Flash 1017 max | DeepSeek | 1 | 0.6 | $0.757 | 1/3 | 12.3s |
| #156 | Grok 4.7 low | X AI | 1 | 0.8 | $1.933 | 2/3 | 12.4s |
| #249 | Dots 3 Note Preview high | Dots Studio | 2 | 0.6 | $0.000 | 1/3 | 12.7s |
| #390 | Cobuddy medium | Baidu | 2 | 0.4 | $0.000 | 0/3 | 12.8s |
| #394 | GLM 4.7 Flash medium | Z.ai | 2 | 0.3 | $0.193 | 0/3 | 12.9s |