Puzzle Solving: Wrong answer
Puzzle Solving
Wrong answer
See which AI models are most likely to hit Wrong answer on Puzzle Solving, so you can spot weak points faster. Sort by: Total Cost ↑.
Failure Reasons
246/246
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #303 | GPT-5.4 Mini none | OpenAI | 1 | 0.5 | $0.170 | 1/3 | 836ms |
| #378 | Nemotron 3.5 Lightning low | NVIDIA | 3 | 0.4 | $0.175 | 0/3 | 6.21s |
| #259 | Qwen3.5 Plus 2026-02-15 none | Qwen | 1 | 0.8 | $0.176 | 2/3 | 2.71s |
| #131 | Qwen3.7 Plus none | Qwen | 1 | 0.8 | $0.178 | 2/3 | 1.71s |
| #254 | Gemini 3.5 Flash Lite low | 1 | 0.8 | $0.183 | 2/3 | 1.19s | |
| #285 | MiMo-V2.6-Pro none | Xiaomi | 1 | 0.8 | $0.193 | 2/3 | 1.67s |
| #394 | GLM 4.7 Flash medium | Z.ai | 2 | 0.3 | $0.193 | 0/3 | 12.9s |
| #368 | Nemotron 3.5 Lightning medium | NVIDIA | 3 | 0.4 | $0.195 | 0/3 | 10.5s |
| #179 | Qwen3.8 Flash Next xhigh | Qwen | 1 | 0.8 | ~$0.195 | 2/3 | 19.5s |
| #182 | MiMo-V2.6-Flash low | Xiaomi | 1 | 0.8 | $0.200 | 2/3 | 24.2s |
| #278 | Qwen3.5 Plus 2026-04-20 none | Qwen | 2 | 0.7 | $0.216 | 1/3 | 1.97s |
| #123 | MiMo-V2.6-Flash medium | Xiaomi | 1 | 0.8 | $0.218 | 2/3 | 52.9s |
| #112 | GPT-5.4 Nano medium | OpenAI | 2 | 0.4 | $0.235 | 0/3 | 3.79s |
| #220 | GLM 5.2 none | Z.ai | 1 | 0.8 | $0.250 | 2/3 | 3.31s |
| #333 | Kimi K2.5 none | Moonshot AI | 3 | 0.3 | $0.262 | 0/3 | 4.04s |