Did not follow instructions Failures
See which AI models run into Did not follow instructions most often, so you can spot reliability risks before choosing one. Sort by: Failure Count ↑.
215/215
Filter models
No models match the current search and filters.
| Rank | Model | Company | Did not follow instructions Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #192 | Qwen3.5-Flash medium | Qwen | 1 | 6.1 | $0.142 | 11/22 | 84.4s |
| #195 | Qwen3.6 Flash none | Qwen | 1 | 6.1 | $0.062 | 7/22 | 3.73s |
| #196 | Gemma 4 31B none | 1 | 6.1 | $0.016 | 9/22 | 5.41s | |
| #198 | Nemotron 3 Ultra none | NVIDIA | 1 | 6.1 | $0.093 | 8/22 | 3.88s |
| #201 | Grok 4.20 Beta medium | X AI | 1 | 6.0 | $0.750 | 14/18 | 9.75s |
| #202 | GPT-5.6 Terra none | OpenAI | 1 | 6.0 | $0.280 | 8/22 | 1.66s |
| #214 | GPT-5.4 none | OpenAI | 1 | 5.8 | $0.397 | 7/22 | 2.08s |
| #220 | Ling-3.0-flash none | Inclusionai | 1 | 5.7 | $0.004 | 6/22 | 3.56s |
| #231 | KAT-Coder-Air V2.5 medium | Kwaipilot | 1 | 5.6 | $0.048 | 8/22 | 8.65s |
| #233 | Hy4 preview low | Tencent | 1 | 5.6 | $1.745 | 3/22 | 214.3s |
| #236 | Qwen3.8 27B none | Qwen | 1 | 5.5 | ~$0.006 | 9/22 | 3.12s |
| #237 | Mimo V2 Omni none | Xiaomi | 1 | 5.5 | $0.021 | 8/21 | 2.44s |
| #238 | DeepSeek V4 Flash 0423 none | DeepSeek | 1 | 5.4 | $0.039 | 4/22 | 36.2s |
| #239 | Laguna S 2.1 medium | Poolside | 1 | 5.4 | $0.053 | 4/22 | 58.4s |
| #245 | Laguna S 2.1 high | Poolside | 1 | 5.4 | $0.114 | 4/22 | 111.6s |