Did not follow instructions Failures
See which AI models run into Did not follow instructions most often, so you can spot reliability risks before choosing one. Sort by: Total Cost ↓.
Categories
293/293
Filter models
No models match the current search and filters.
| Rank | Model | Company | Did not follow instructions Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #88 | Muse Spark 1.1 high | Meta | 2 | 0.8 | $2.570 | 13/23 | 37.4s |
| #200 | Claude Opus 4.8 none | Anthropic | 1 | 0.7 | $2.334 | 13/23 | 7.54s |
| #392 | Gemini 3.1 Flash Lite Preview high | 1 | 0.4 | $2.310 | 13/16 | 68.1s | |
| #130 | Grok 4.6 medium | X AI | 1 | 0.8 | $2.270 | 16/23 | 74.8s |
| #61 | GPT-5.4 medium | OpenAI | 2 | 0.9 | $2.213 | 16/23 | 24.8s |
| #25 | Claude Opus 5.5 high | Anthropic | 1 | 0.9 | $2.133 | 19/23 | 27.6s |
| #375 | Gemini 3.1 Flash Lite high | 3 | 0.5 | $2.044 | 10/18 | 62.0s | |
| #69 | Seed 2.1 Turbo medium | Bytedance Seed | 1 | 0.9 | $2.042 | 16/23 | 189.1s |
| #55 | Muse Spark 1.2 high | Meta | 3 | 0.9 | $2.018 | 15/23 | 28.1s |
| #156 | Grok 4.7 low | X AI | 1 | 0.7 | $1.933 | 14/23 | 63.2s |
| #43 | Seed 2.1 Turbo high | Bytedance Seed | 1 | 0.9 | $1.892 | 17/23 | 170.5s |
| #40 | Muse Spark 1.3 high | Meta | 2 | 0.9 | $1.891 | 17/23 | 52.9s |
| #59 | Pareto 26.9 default | Unbiased | 1 | 0.9 | $1.864 | 15/23 | 28.3s |
| #326 | Hy4 preview low | Tencent | 1 | 0.5 | $1.844 | 3/23 | 207.2s |
| #30 | Muse Spark Open high | Meta | 1 | 0.9 | $1.782 | 17/23 | 152.0s |