Did not follow instructions Failures
See which AI models run into Did not follow instructions most often, so you can spot reliability risks before choosing one. Sort by: Tests Correct ↓.
Categories
293/293
Filter models
No models match the current search and filters.
| Rank | Model | Company | Did not follow instructions Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #24 | Claude Opus 5.5 low | Anthropic | 1 | 0.9 | $1.733 | 19/23 | 25.7s |
| #25 | Claude Opus 5.5 high | Anthropic | 1 | 0.9 | $2.133 | 19/23 | 27.6s |
| #392 | Gemini 3.1 Flash Lite Preview high | 1 | 0.4 | $2.310 | 13/16 | 68.1s | |
| #34 | Claude Sonnet 5.5 max | Anthropic | 2 | 0.9 | $8.557 | 18/23 | 84.3s |
| #37 | Qwen3.8 Max (0902) high | Qwen | 1 | 0.9 | $3.306 | 18/23 | 186.1s |
| #39 | Claude Haiku 5.5 xhigh | Anthropic | 1 | 0.9 | $0.140 | 18/23 | 16.6s |
| #121 | Gemini 3.5 Flash medium | 1 | 0.8 | $1.316 | 18/23 | 11.8s | |
| #355 | Grok 4.20 Beta medium | X AI | 1 | 0.5 | $0.750 | 14/18 | 9.75s |
| #30 | Muse Spark Open high | Meta | 1 | 0.9 | $1.782 | 17/23 | 152.0s |
| #38 | GPT-5.3-Codex medium | OpenAI | 2 | 0.9 | $1.318 | 17/23 | 18.9s |
| #40 | Muse Spark 1.3 high | Meta | 2 | 0.9 | $1.891 | 17/23 | 52.9s |
| #43 | Seed 2.1 Turbo high | Bytedance Seed | 1 | 0.9 | $1.892 | 17/23 | 170.5s |
| #53 | GLM 5.3 Flash max | Z.ai | 1 | 0.9 | $0.089 | 17/23 | 54.0s |
| #60 | Qwen3.8 MAX low | Qwen | 1 | 0.9 | $1.089 | 17/23 | 25.1s |
| #67 | Qwen3.8 27B high | Qwen | 2 | 0.9 | ~$0.298 | 17/23 | 166.3s |