Puzzle Solving: Wrong answer
Puzzle Solving
Wrong answer
See which AI models are most likely to hit Wrong answer on Puzzle Solving, so you can spot weak points faster. Sort by: Tests Correct ↑.
Failure Reasons
246/246
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #189 | Step 5 Preview high | Stepfun | 1 | 0.6 | $4.513 | 1/3 | 143.2s |
| #201 | Kimi K2.6 medium | Moonshot AI | 1 | 0.6 | $1.594 | 1/3 | 25.1s |
| #203 | Inkling low | Thinkingmachines | 1 | 0.6 | $0.293 | 1/3 | 2.97s |
| #221 | Qwen3.7 Flash medium | Qwen | 1 | 0.7 | $0.076 | 1/3 | 8.30s |
| #223 | Mercury 2 medium | Inception | 1 | 0.5 | $0.121 | 1/3 | 949ms |
| #224 | Step 3.7 Flash high | Stepfun | 2 | 0.5 | $1.478 | 1/3 | 10.2s |
| #226 | KAT-Coder-Pro V2.5 low | Kwaipilot | 2 | 0.6 | $0.568 | 1/3 | 3.11s |
| #232 | Beam 1.0 501B A23B xhigh | Reflection | 2 | 0.6 | $0.688 | 1/3 | 4.46s |
| #236 | Grok 4.3 medium | X AI | 1 | 0.6 | $0.989 | 1/3 | 22.5s |
| #237 | Laguna XS 2.1 medium | Poolside | 2 | 0.5 | $0.083 | 1/3 | 3.43s |
| #244 | Kimi K2.5 medium | Moonshot AI | 1 | 0.5 | $0.841 | 1/3 | 43.2s |
| #245 | Beam 1.0 501B A23B low | Reflection | 2 | 0.6 | $0.432 | 1/3 | 3.42s |
| #248 | MiMo-V2.5-Pro medium | Xiaomi | 1 | 0.7 | $0.332 | 1/3 | 5.31s |
| #249 | Dots 3 Note Preview high | Dots Studio | 2 | 0.6 | $0.000 | 1/3 | 12.7s |
| #250 | Dots 3 Note Preview low | Dots Studio | 1 | 0.5 | $0.000 | 1/3 | 8.52s |