Puzzle Solving: Wrong answer
Puzzle Solving
Wrong answer
See which AI models are most likely to hit Wrong answer on Puzzle Solving, so you can spot weak points faster. Sort by: Tests Correct ↓.
Failure Reasons
246/246
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #253 | Qwen3.6 27B none | Qwen | 1 | 0.5 | $0.148 | 1/3 | 5.15s |
| #263 | DeepSeek V3.2 medium | DeepSeek | 1 | 0.7 | $0.152 | 1/3 | 37.7s |
| #264 | Trinity Large Thinking low | Arcee AI | 1 | 0.6 | $0.918 | 1/3 | 3.28s |
| #268 | KAT-Coder-Pro V2.5 medium | Kwaipilot | 2 | 0.6 | $0.669 | 1/3 | 3.20s |
| #277 | Inkling none | Thinkingmachines | 1 | 0.6 | $0.292 | 1/3 | 931ms |
| #278 | Qwen3.5 Plus 2026-04-20 none | Qwen | 2 | 0.7 | $0.216 | 1/3 | 1.97s |
| #286 | Inkling Small medium | Thinkingmachines | 1 | 0.6 | $0.113 | 1/3 | 5.24s |
| #287 | Seed-2.0-Lite none | Bytedance Seed | 2 | 0.5 | $0.114 | 1/3 | 2.78s |
| #289 | gpt-oss-120b medium | OpenAI | 1 | 0.5 | $0.030 | 1/3 | 21.7s |
| #290 | Gemini 3.1 Flash Lite none | 1 | 0.6 | $0.069 | 1/3 | 720ms | |
| #292 | Claude Sonnet 5 none | Anthropic | 1 | 0.6 | $1.095 | 1/3 | 3.22s |
| #293 | Nemotron 3 Ultra none | NVIDIA | 1 | 0.6 | $0.164 | 1/3 | 1.06s |
| #295 | Qwen3.8 Flash Next none | Qwen | 2 | 0.6 | ~$0.011 | 1/3 | 1.30s |
| #296 | DeepSeek V4.1 Flash 1017 none | DeepSeek | 2 | 0.5 | $0.055 | 1/3 | 750ms |
| #297 | GPT-5.6 Terra none | OpenAI | 2 | 0.5 | $0.377 | 1/3 | 1.23s |