Puzzle Solving: Wrong answer
Puzzle Solving
Wrong answer
See which AI models are most likely to hit Wrong answer on Puzzle Solving, so you can spot weak points faster. Sort by: Total Cost ↑.
Failure Reasons
246/246
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #13 | GPT-5.6 Sol low | OpenAI | 1 | 0.8 | $1.244 | 2/3 | 3.44s |
| #266 | Grok 4.20 medium | X AI | 1 | 0.8 | $1.246 | 2/3 | 6.22s |
| #121 | Gemini 3.5 Flash medium | 1 | 0.8 | $1.316 | 2/3 | 2.38s | |
| #149 | Mistral Large 4 high | Mistral | 2 | 0.5 | $1.391 | 1/3 | 55.2s |
| #209 | Grok Build 0.1 medium | X AI | 1 | 0.8 | $1.419 | 2/3 | 18.3s |
| #79 | Claude Sonnet 5 medium | Anthropic | 1 | 0.8 | $1.438 | 2/3 | 2.98s |
| #224 | Step 3.7 Flash high | Stepfun | 2 | 0.5 | $1.478 | 1/3 | 10.2s |
| #42 | Pareto default | Unbiased | 1 | 0.8 | $1.520 | 2/3 | 18.2s |
| #147 | GLM 5.1 medium | Z.ai | 1 | 0.8 | $1.546 | 2/3 | 31.6s |
| #201 | Kimi K2.6 medium | Moonshot AI | 1 | 0.6 | $1.594 | 1/3 | 25.1s |
| #20 | GPT-5.6 Sol medium | OpenAI | 1 | 0.8 | $1.700 | 2/3 | 2.98s |
| #326 | Hy4 preview low | Tencent | 2 | 0.5 | $1.844 | 0/3 | 238.0s |
| #59 | Pareto 26.9 default | Unbiased | 1 | 0.8 | $1.864 | 2/3 | 8.40s |
| #156 | Grok 4.7 low | X AI | 1 | 0.8 | $1.933 | 2/3 | 12.4s |
| #41 | Muse Wonder low | Meta | 1 | 0.6 | $2.637 | 1/3 | 5.08s |