Puzzle Solving: Wrong answer
Puzzle Solving
Wrong answer
See which AI models are most likely to hit Wrong answer on Puzzle Solving, so you can spot weak points faster. Sort by: Tests Correct ↓.
Failure Reasons
145/145
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #55 | Nemotron 3 Ultra medium | NVIDIA | 2 | 5.5 | $0.774 | 1/3 | 3.54s |
| #56 | Kimi K2.7 Code medium | Moonshot AI | 1 | 5.9 | $0.740 | 1/3 | 41.0s |
| #64 | LongCat 2.0 medium | Meituan | 2 | 5.4 | $0.478 | 1/3 | 8.84s |
| #66 | KAT-Coder-Pro V2.5 low | Kwaipilot | 2 | 6.4 | $0.387 | 1/3 | 3.11s |
| #71 | Step 3.7 Flash low | Stepfun | 2 | 5.5 | $0.454 | 1/3 | 1.84s |
| #72 | Kimi K2.6 medium | Moonshot AI | 1 | 6.0 | $1.036 | 1/3 | 25.1s |
| #77 | Grok 4.3 medium | X AI | 1 | 5.9 | $0.779 | 1/3 | 22.5s |
| #80 | DeepSeek V3.2 medium | DeepSeek | 1 | 7.0 | $0.078 | 1/3 | 37.7s |
| #81 | Kimi K2.5 medium | Moonshot AI | 1 | 5.3 | $0.600 | 1/3 | 43.2s |
| #82 | Mercury 2 medium | Inception | 1 | 5.4 | $0.093 | 1/3 | 949ms |
| #85 | KAT-Coder-Pro V2.5 medium | Kwaipilot | 2 | 5.9 | $0.467 | 1/3 | 3.20s |
| #88 | MiMo-V2.5-Pro medium | Xiaomi | 1 | 6.7 | $0.187 | 1/3 | 5.31s |
| #90 | Step 3.7 Flash high | Stepfun | 2 | 5.3 | $1.207 | 1/3 | 10.2s |
| #108 | Laguna XS 2.1 medium | Poolside | 2 | 5.3 | $0.068 | 1/3 | 3.43s |
| #109 | Qwen3.5-27B none | Qwen | 1 | 6.7 | $0.090 | 1/3 | 1.38s |