Did not follow instructions Failures
See which AI models run into Did not follow instructions most often, so you can spot reliability risks before choosing one. Sort by: Failure Count ↑.
Categories
293/293
Filter models
No models match the current search and filters.
| Rank | Model | Company | Did not follow instructions Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #155 | GLM 5.3 FlashX high | Z.ai | 1 | 0.7 | $0.210 | 13/23 | 14.9s |
| #156 | Grok 4.7 low | X AI | 1 | 0.7 | $1.933 | 14/23 | 63.2s |
| #162 | Claude Fable 5.1 medium | Anthropic | 1 | 0.7 | $3.197 | 15/23 | 11.9s |
| #163 | Grok 4.7 medium | X AI | 1 | 0.7 | $2.938 | 15/23 | 117.7s |
| #166 | Qwen3.6 Plus medium | Qwen | 1 | 0.7 | $0.554 | 15/23 | 57.4s |
| #167 | Gemini 3.5 Flash Lite medium | 1 | 0.7 | $0.440 | 14/23 | 8.68s | |
| #173 | Qwen3.7 Flash high | Qwen | 1 | 0.7 | $0.063 | 13/23 | 45.5s |
| #175 | GLM 5 medium | Z.ai | 1 | 0.7 | $0.479 | 15/22 | 39.0s |
| #177 | Qwen3.6 27B medium | Qwen | 1 | 0.7 | $1.021 | 11/23 | 107.8s |
| #180 | GLM 5.3 FlashX medium | Z.ai | 1 | 0.7 | $0.114 | 12/23 | 7.37s |
| #183 | MiMo-V2.5 medium | Xiaomi | 1 | 0.7 | $0.130 | 12/23 | 49.2s |
| #184 | GPT-5.2 Chat default | OpenAI | 1 | 0.7 | $0.594 | 13/23 | 7.43s |
| #186 | Gemini 3.1 Flash Lite Preview medium | 1 | 0.7 | $0.158 | 14/23 | 6.78s | |
| #187 | Kimi K2.7 Code medium | Moonshot AI | 1 | 0.7 | $1.136 | 11/23 | 81.2s |
| #189 | Step 5 Preview high | Stepfun | 1 | 0.7 | $4.513 | 10/23 | 154.4s |