Puzzle Solving: Did not follow instructions
Puzzle Solving
Did not follow instructions
See which AI models are most likely to hit Did not follow instructions on Puzzle Solving, so you can spot weak points faster. Sort by: Total Cost ↓.
Failure Reasons
157/157
Filter models
No models match the current search and filters.
| Rank | Model | Company | Did not follow instructions Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #244 | Kimi K2.5 medium | Moonshot AI | 1 | 0.5 | $0.841 | 1/3 | 43.2s |
| #240 | Beam 1.0 501B A23B max | Reflection | 1 | 0.8 | $0.799 | 2/3 | 3.94s |
| #301 | Trinity Large Thinking high | Arcee AI | 2 | 0.5 | $0.794 | 0/3 | 3.84s |
| #152 | Qwen3.6 Flash medium | Qwen | 1 | 0.8 | $0.783 | 2/3 | 6.29s |
| #165 | LongCat 2.0 high | Meituan | 1 | 0.3 | $0.778 | 0/3 | 9.18s |
| #100 | DeepSeek V4.1 Flash 1017 max | DeepSeek | 1 | 0.6 | $0.757 | 1/3 | 12.3s |
| #309 | GPT-5.4 none | OpenAI | 1 | 0.6 | $0.690 | 1/3 | 1.44s |
| #364 | Mimo V2 Omni medium | Xiaomi | 1 | 0.6 | $0.683 | 1/3 | 2.38s |
| #222 | LongCat 2.0 low | Meituan | 1 | 0.3 | $0.630 | 0/3 | 8.15s |
| #117 | GLM 5.3 FlashX max | Z.ai | 1 | 0.8 | $0.623 | 2/3 | 3.88s |
| #63 | DeepSeek V4.1 Flash high | DeepSeek | 1 | 0.6 | $0.617 | 1/3 | 14.3s |
| #64 | DeepSeek V4.1 Flash medium | DeepSeek | 1 | 0.9 | $0.591 | 2/3 | 8.01s |
| #126 | DeepSeek V4.1 Flash 1017 high | DeepSeek | 1 | 0.5 | $0.589 | 1/3 | 5.70s |
| #89 | DeepSeek V4 Flash 0731 high | DeepSeek | 1 | 0.8 | $0.576 | 2/3 | 9.36s |
| #422 | Grok Build 0.1 none | X AI | 1 | 0.6 | $0.547 | 1/3 | 9.55s |