AI BENCHY Category Failures
Puzzle Solving: Wrong answer
Puzzle Solving
Wrong answer
See which AI models are most likely to hit Wrong answer on Puzzle Solving, so you can spot weak points faster. Sort by: Response Time (avg) ↓.
Failure Reasons
| Rank | Model | Company | Wrong answer Count | Category Score | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|
| #83 | Mistral Small 4 none | Mistral | 1 | 3.1 | 0/3 | 589ms |
| #62 | Gemini 2.5 Flash none | 1 | 5.7 | 1/3 | 576ms | |
| #79 | Grok 4.20 Beta none | X AI | 1 | 5.9 | 1/3 | 541ms |
| #91 | Mercury 2 none | Inception | 3 | 3.1 | 0/3 | 533ms |
| #82 | Grok 4.20 none | X AI | 1 | 5.3 | 1/3 | 487ms |