Puzzle Solving: Wrong answer
Puzzle Solving
Wrong answer
See which AI models are most likely to hit Wrong answer on Puzzle Solving, so you can spot weak points faster. Sort by: Tests Correct ↓.
Failure Reasons
145/145
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #101 | GLM 5.2 none | Z.ai | 1 | 7.7 | $0.128 | 2/3 | 3.31s |
| #104 | Gemini 3.5 Flash-Lite medium | 1 | 8.4 | $0.369 | 2/3 | 1.70s | |
| #105 | Qwen3.6 27B medium | Qwen | 1 | 7.7 | $0.779 | 2/3 | 61.1s |
| #113 | Qwen3.5 Plus 2026-02-15 none | Qwen | 1 | 7.7 | $0.073 | 2/3 | 2.71s |
| #119 | MiMo-V2-Flash medium | Xiaomi | 1 | 7.7 | $0.043 | 2/3 | 3.87s |
| #123 | GPT-5.6 Luna low | OpenAI | 1 | 7.6 | $0.249 | 2/3 | 3.59s |
| #124 | Gemini 2.5 Flash none | 1 | 7.7 | $0.017 | 2/3 | 604ms | |
| #147 | GLM 5 none | Z.ai | 1 | 7.7 | $0.041 | 2/3 | 1.91s |
| #157 | GLM 5.1 none | Z.ai | 1 | 7.7 | $0.164 | 2/3 | 1.45s |
| #197 | Grok 4.20 Beta none | X AI | 1 | 7.7 | $0.087 | 2/3 | 586ms |
| #29 | GPT-5 Mini medium | OpenAI | 1 | 5.6 | $0.237 | 1/3 | 15.2s |
| #32 | Inkling high | Thinkingmachines | 1 | 6.9 | $1.006 | 1/3 | 10.7s |
| #33 | Step 3.7 Flash medium | Stepfun | 2 | 5.7 | $0.515 | 1/3 | 6.19s |
| #35 | GLM 5.2 high | Z.ai | 1 | 6.0 | $0.817 | 1/3 | 33.7s |
| #50 | DeepSeek V4 Pro high | DeepSeek | 1 | 6.9 | $0.200 | 1/3 | 56.8s |