Puzzle Solving: Wrong answer
Puzzle Solving
Wrong answer
See which AI models are most likely to hit Wrong answer on Puzzle Solving, so you can spot weak points faster. Sort by: Response Time (avg) ↑.
Failure Reasons
145/145
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #186 | GPT-5.4 Nano none | OpenAI | 1 | 5.4 | $0.041 | 1/3 | 1.25s |
| #91 | GPT-5.5 none | OpenAI | 1 | 7.7 | $0.544 | 2/3 | 1.29s |
| #160 | MiMo-V2.5-Pro none | Xiaomi | 1 | 6.7 | $0.068 | 1/3 | 1.30s |
| #133 | Qwen3.5-35B-A3B none | Qwen | 2 | 3.7 | $0.106 | 0/3 | 1.35s |
| #109 | Qwen3.5-27B none | Qwen | 1 | 6.7 | $0.090 | 1/3 | 1.38s |
| #213 | Nemotron 3 Nano Omni 30b A3b Reasoning medium | NVIDIA | 2 | 2.9 | $0.000 | 0/3 | 1.40s |
| #144 | Kimi K2.6 none | Moonshot AI | 2 | 3.1 | $0.184 | 0/3 | 1.40s |
| #145 | GPT-5.4 none | OpenAI | 1 | 5.6 | $0.397 | 1/3 | 1.44s |
| #157 | GLM 5.1 none | Z.ai | 1 | 7.7 | $0.164 | 2/3 | 1.45s |
| #87 | GPT-5.6 Sol none | OpenAI | 1 | 7.7 | $0.524 | 2/3 | 1.49s |
| #164 | KAT-Coder-Air V2.5 low | Kwaipilot | 2 | 3.1 | $0.041 | 0/3 | 1.57s |
| #153 | Mimo V2 PRO none | Xiaomi | 1 | 6.0 | $0.045 | 1/3 | 1.61s |
| #104 | Gemini 3.5 Flash-Lite medium | 1 | 8.4 | $0.369 | 2/3 | 1.70s | |
| #75 | Qwen3.7 Plus none | Qwen | 1 | 7.7 | $0.106 | 2/3 | 1.71s |
| #216 | LFM2-24B-A2B none | Liquid | 2 | 3.8 | $0.001 | 0/3 | 1.78s |