Puzzle Solving: Wrong answer
Puzzle Solving
Wrong answer
See which AI models are most likely to hit Wrong answer on Puzzle Solving, so you can spot weak points faster.
Failure Reasons
186/186
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #200 | Qwen3.5-Flash none | Qwen | 3 | 3.1 | $0.073 | 0/3 | 10.9s |
| #211 | North Mini Code medium | Cohere | 3 | 3.3 | $0.000 | 0/3 | 19.7s |
| #220 | KAT-Coder-Air V2.5 high | Kwaipilot | 3 | 3.5 | $0.077 | 0/3 | 2.47s |
| #226 | KAT-Coder-Air V2.5 medium | Kwaipilot | 3 | 3.6 | $0.048 | 0/3 | 1.87s |
| #234 | Laguna S 2.1 medium | Poolside | 3 | 3.1 | $0.053 | 0/3 | 2.62s |
| #238 | Kimi K2.5 none | Moonshot AI | 3 | 3.0 | $0.101 | 0/3 | 4.04s |
| #241 | Inkling Small none | Thinkingmachines | 3 | 3.2 | $0.054 | 0/3 | 665ms |
| #242 | Laguna XS 2.1 none | Poolside | 3 | 3.0 | $0.008 | 0/3 | 1.01s |
| #247 | Dots 3 Note Preview none | Dots Studio | 3 | 3.3 | $0.000 | 0/3 | 1.50s |
| #250 | Nemotron 3.5 Lightning medium | NVIDIA | 3 | 4.2 | $0.156 | 0/3 | 10.5s |
| #254 | Qwen3 Coder Next none | Qwen | 3 | 3.0 | $0.026 | 0/3 | 24.3s |
| #270 | Nemotron 3.5 Lightning low | NVIDIA | 3 | 3.6 | $0.140 | 0/3 | 6.21s |
| #274 | KAT-Coder-Air V2.5 none | Kwaipilot | 3 | 2.9 | $0.070 | 0/3 | 1.84s |
| #281 | Mercury 2 none | Inception | 3 | 3.1 | $0.030 | 0/3 | 535ms |
| #285 | Laguna S 2.1 none | Poolside | 3 | 3.1 | $0.022 | 0/3 | 828ms |