Coding: Did not follow instructions
Coding
Did not follow instructions
See which AI models are most likely to hit Did not follow instructions on Coding, so you can spot weak points faster.
Failure Reasons
63/63
Filter models
No models match the current search and filters.
| Rank | Model | Company | Did not follow instructions Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #263 | Claude Sonnet 5.5 low | Anthropic | 2 | 0.3 | $0.909 | 0/3 | 5.81s |
| #293 | Claude Sonnet 5.5 medium | Anthropic | 2 | 0.3 | $1.100 | 0/3 | 6.07s |
| #341 | Claude Fable 5.1 low | Anthropic | 2 | 0.3 | $3.395 | 0/3 | 6.75s |
| #407 | Inkling 2 Mini none | Thinkingmachines | 2 | 0.4 | $0.315 | 0/3 | 89.6s |
| #104 | Qwen3.8 27B high | Qwen | 1 | 0.8 | ~$0.298 | 2/3 | 248.6s |
| #118 | Claude Fable 5.2 low | Anthropic | 1 | 0.6 | $3.471 | 1/3 | 6.83s |
| #121 | Claude Haiku 5.5 low | Anthropic | 1 | 0.8 | $0.061 | 2/3 | 7.30s |
| #139 | DeepSeek V4 Flash 0731 high | DeepSeek | 1 | 0.6 | $0.576 | 1/3 | 252.7s |
| #152 | DeepSeek V4.1 Flash 1017 max | DeepSeek | 1 | 0.6 | $0.757 | 1/3 | 199.2s |
| #178 | Particle-1 max | Particle AI | 1 | 0.6 | $0.361 | 1/3 | 79.3s |
| #180 | Gemini 3.5 Flash medium | 1 | 0.8 | $1.316 | 2/3 | 12.6s | |
| #181 | Qwen3.8 2.4T A95B high | Qwen | 1 | 0.6 | $2.949 | 1/3 | 160.5s |
| #185 | DeepSeek V4.1 Flash 1017 high | DeepSeek | 1 | 0.5 | $0.589 | 0/3 | 196.7s |
| #209 | Mistral Large 4 high | Mistral | 1 | 0.3 | $1.391 | 0/3 | 1277.8s |
| #210 | Seed-2.0-Code high | Bytedance Seed | 1 | 0.6 | $1.448 | 1/3 | 266.7s |