Puzzle Solving: Wrong answer
Puzzle Solving
Wrong answer
See which AI models are most likely to hit Wrong answer on Puzzle Solving, so you can spot weak points faster. Sort by: Total Cost ↑.
Failure Reasons
246/246
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #141 | Muse Glimmer 30B medium | Meta | 2 | 0.6 | $0.288 | 1/3 | 64.7s |
| #277 | Inkling none | Thinkingmachines | 1 | 0.6 | $0.292 | 1/3 | 931ms |
| #203 | Inkling low | Thinkingmachines | 1 | 0.6 | $0.293 | 1/3 | 2.97s |
| #238 | Qwen3.5-122B-A10B none | Qwen | 2 | 0.4 | $0.308 | 0/3 | 1.00s |
| #84 | GPT-5 Mini medium | OpenAI | 1 | 0.6 | $0.315 | 1/3 | 15.2s |
| #351 | MiniMax M2.7 medium | Minimax | 1 | 0.6 | $0.326 | 1/3 | 24.9s |
| #248 | MiMo-V2.5-Pro medium | Xiaomi | 1 | 0.7 | $0.332 | 1/3 | 5.31s |
| #36 | DeepSeek V4.1 Flash 1017 low | DeepSeek | 1 | 0.7 | $0.355 | 1/3 | 2.54s |
| #297 | GPT-5.6 Terra none | OpenAI | 2 | 0.5 | $0.377 | 1/3 | 1.23s |
| #298 | DeepSeek V4.1 Flash none | DeepSeek | 2 | 0.5 | $0.391 | 1/3 | 1.49s |
| #157 | Inkling Small high | Thinkingmachines | 2 | 0.5 | $0.398 | 0/3 | 14.4s |
| #213 | MiniMax M3 medium | Minimax | 1 | 0.8 | $0.422 | 2/3 | 49.9s |
| #245 | Beam 1.0 501B A23B low | Reflection | 2 | 0.6 | $0.432 | 1/3 | 3.42s |
| #139 | Qwen3.5 Plus 2026-04-20 medium | Qwen | 1 | 0.8 | $0.435 | 2/3 | 17.7s |
| #393 | MiniMax M2.5 medium | Minimax | 1 | 0.5 | $0.440 | 1/3 | 11.2s |