Puzzle Solving: Wrong answer
Puzzle Solving
Wrong answer
See which AI models are most likely to hit Wrong answer on Puzzle Solving, so you can spot weak points faster. Sort by: Tests Correct ↑.
Failure Reasons
246/246
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #235 | KAT-Coder-Pro V2.5 high | Kwaipilot | 1 | 0.8 | $0.506 | 2/3 | 3.38s |
| #239 | Gemini 3 Flash Preview none | 1 | 0.8 | $0.155 | 2/3 | 1.05s | |
| #243 | Minimax M3.1 Flash xhigh | Minimax | 1 | 0.8 | $0.000 | 2/3 | 10.2s |
| #254 | Gemini 3.5 Flash Lite low | 1 | 0.8 | $0.183 | 2/3 | 1.19s | |
| #259 | Qwen3.5 Plus 2026-02-15 none | Qwen | 1 | 0.8 | $0.176 | 2/3 | 2.71s |
| #261 | Claude Opus 4.6 medium | Anthropic | 1 | 0.8 | $2.961 | 2/3 | 4.71s |
| #266 | Grok 4.20 medium | X AI | 1 | 0.8 | $1.246 | 2/3 | 6.22s |
| #267 | Space Bunny Alpha xhigh | Stealth | 1 | 0.8 | $0.000 | 2/3 | 5.45s |
| #274 | Beam 1.0 501B A23B high | Reflection | 1 | 0.8 | $0.674 | 2/3 | 4.02s |
| #279 | Step 5 Preview medium | Stepfun | 1 | 0.8 | $4.136 | 2/3 | 59.9s |
| #281 | KAT-Coder-Pro V2.5 default | Kwaipilot | 1 | 0.8 | $0.742 | 2/3 | 3.03s |
| #282 | Apodex 1.1 Mini medium | Apodex | 1 | 0.8 | $0.000 | 2/3 | 15.2s |
| #284 | GLM 5.3 FlashX low | Z.ai | 1 | 0.8 | $0.157 | 2/3 | 1.89s |
| #285 | MiMo-V2.6-Pro none | Xiaomi | 1 | 0.8 | $0.193 | 2/3 | 1.67s |
| #312 | GLM 5 none | Z.ai | 1 | 0.8 | $0.140 | 2/3 | 1.91s |