Puzzle Solving: Wrong answer
Puzzle Solving
Wrong answer
See which AI models are most likely to hit Wrong answer on Puzzle Solving, so you can spot weak points faster. Sort by: Response Time (avg) ↓.
Failure Reasons
145/145
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #182 | GLM 4.7 Flash none | Z.ai | 1 | 6.4 | $0.016 | 1/3 | 1.20s |
| #209 | Grok 4.1 Fast none | X AI | 3 | 3.0 | $0.008 | 0/3 | 1.10s |
| #167 | Qwen3.6 35B A3B none | Qwen | 1 | 3.2 | $0.061 | 0/3 | 1.07s |
| #135 | Nemotron 3 Ultra none | NVIDIA | 1 | 5.9 | $0.095 | 1/3 | 1.06s |
| #93 | Gemini 3 Flash Preview none | 1 | 7.7 | $0.085 | 2/3 | 1.05s | |
| #166 | Laguna XS 2.1 none | Poolside | 3 | 3.0 | $0.008 | 0/3 | 1.01s |
| #148 | Qwen3.5-122B-A10B none | Qwen | 2 | 3.8 | $0.247 | 0/3 | 1.00s |
| #82 | Mercury 2 medium | Inception | 1 | 5.4 | $0.093 | 1/3 | 949ms |
| #170 | Inkling none | Thinkingmachines | 1 | 5.6 | $0.147 | 1/3 | 931ms |
| #198 | Laguna M.1 none | Poolside | 2 | 3.0 | $0.009 | 0/3 | 891ms |
| #201 | Elephant Alpha medium | Openrouter | 1 | 5.3 | $0.000 | 1/3 | 868ms |
| #142 | GPT-5.4 Mini none | OpenAI | 1 | 5.4 | $0.095 | 1/3 | 836ms |
| #199 | Elephant Alpha none | Openrouter | 2 | 4.2 | $0.000 | 0/3 | 807ms |
| #165 | GPT-5.6 Luna none | OpenAI | 1 | 5.3 | $0.142 | 1/3 | 790ms |
| #162 | Gemma 4 26B A4B none | 1 | 6.2 | $0.015 | 1/3 | 744ms |