Puzzle Solving: Wrong answer
Puzzle Solving
Wrong answer
See which AI models are most likely to hit Wrong answer on Puzzle Solving, so you can spot weak points faster. Sort by: Response Time (avg) ↓.
Failure Reasons
145/145
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #87 | GPT-5.6 Sol none | OpenAI | 1 | 7.7 | $0.524 | 2/3 | 1.49s |
| #157 | GLM 5.1 none | Z.ai | 1 | 7.7 | $0.164 | 2/3 | 1.45s |
| #145 | GPT-5.4 none | OpenAI | 1 | 5.6 | $0.397 | 1/3 | 1.44s |
| #144 | Kimi K2.6 none | Moonshot AI | 2 | 3.1 | $0.184 | 0/3 | 1.40s |
| #213 | Nemotron 3 Nano Omni 30b A3b Reasoning medium | NVIDIA | 2 | 2.9 | $0.000 | 0/3 | 1.40s |
| #109 | Qwen3.5-27B none | Qwen | 1 | 6.7 | $0.090 | 1/3 | 1.38s |
| #133 | Qwen3.5-35B-A3B none | Qwen | 2 | 3.7 | $0.106 | 0/3 | 1.35s |
| #160 | MiMo-V2.5-Pro none | Xiaomi | 1 | 6.7 | $0.068 | 1/3 | 1.30s |
| #91 | GPT-5.5 none | OpenAI | 1 | 7.7 | $0.544 | 2/3 | 1.29s |
| #186 | GPT-5.4 Nano none | OpenAI | 1 | 5.4 | $0.041 | 1/3 | 1.25s |
| #193 | Qwen3 Coder Next medium | Qwen | 2 | 3.0 | $0.032 | 0/3 | 1.25s |
| #138 | GPT-5.6 Terra none | OpenAI | 2 | 5.3 | $0.349 | 1/3 | 1.23s |
| #95 | Gemini 3.5 Flash-Lite low | 1 | 7.8 | $0.145 | 2/3 | 1.22s | |
| #130 | Qwen3.6 Flash none | Qwen | 2 | 3.5 | $0.062 | 0/3 | 1.21s |
| #180 | GPT-4o-mini none | OpenAI | 2 | 3.5 | $0.010 | 0/3 | 1.21s |