Puzzle Solving: Wrong answer
Puzzle Solving
Wrong answer
See which AI models are most likely to hit Wrong answer on Puzzle Solving, so you can spot weak points faster. Sort by: Total Cost ↓.
Failure Reasons
145/145
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #159 | Hy3 preview low | Tencent | 1 | 5.3 | $0.015 | 1/3 | 7.51s |
| #162 | Gemma 4 26B A4B none | 1 | 6.2 | $0.015 | 1/3 | 744ms | |
| #180 | GPT-4o-mini none | OpenAI | 2 | 3.5 | $0.010 | 0/3 | 1.21s |
| #212 | gpt-oss-120b none | OpenAI | 1 | 6.0 | $0.010 | 1/3 | 8.21s |
| #198 | Laguna M.1 none | Poolside | 2 | 3.0 | $0.009 | 0/3 | 891ms |
| #183 | Nemotron 3 Super none | NVIDIA | 1 | 5.5 | $0.008 | 1/3 | 2.36s |
| #189 | Trinity Large Preview none | Arcee AI | 2 | 3.6 | $0.008 | 0/3 | 1.97s |
| #209 | Grok 4.1 Fast none | X AI | 3 | 3.0 | $0.008 | 0/3 | 1.10s |
| #166 | Laguna XS 2.1 none | Poolside | 3 | 3.0 | $0.008 | 0/3 | 1.01s |
| #207 | Granite 4.1 8B none | IBM Granite | 2 | 3.2 | $0.007 | 0/3 | 608ms |
| #211 | Laguna Xs.2 none | Poolside | 1 | 5.3 | $0.004 | 1/3 | 650ms |
| #205 | Hy3 preview none | Tencent | 2 | 3.1 | $0.003 | 0/3 | 4.56s |
| #184 | Ling-2.6-flash none | Inclusionai | 2 | 2.9 | $0.002 | 0/3 | 6.51s |
| #216 | LFM2-24B-A2B none | Liquid | 2 | 3.8 | $0.001 | 0/3 | 1.78s |
| #143 | North Mini Code medium | Cohere | 3 | 3.3 | $0.000 | 0/3 | 19.7s |