Did not follow instructions Failures
See which AI models run into Did not follow instructions most often, so you can spot reliability risks before choosing one. Sort by: Total Cost ↓.
140/140
Filter models
No models match the current search and filters.
| Rank | Model | Company | Did not follow instructions Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #13 | GPT-5.3-Codex medium | OpenAI | 2 | 8.9 | $0.920 | 16/22 | 17.0s |
| #73 | Grok 4.3 medium | X AI | 2 | 7.1 | $0.779 | 13/22 | 47.4s |
| #99 | Qwen3.6 27B medium | Qwen | 1 | 6.5 | $0.779 | 10/22 | 106.3s |
| #75 | Grok 4.20 medium | X AI | 2 | 7.1 | $0.777 | 12/22 | 29.5s |
| #56 | GPT-5.4 Mini medium | OpenAI | 3 | 7.5 | $0.756 | 12/22 | 25.9s |
| #52 | Kimi K2.7 Code medium | Moonshot AI | 1 | 7.5 | $0.751 | 12/22 | 84.2s |
| #131 | Grok 4.20 Beta medium | X AI | 1 | 6.0 | $0.750 | 14/18 | 9.75s |
| #90 | Qwen3.6 35B A3B medium | Qwen | 1 | 6.7 | $0.746 | 13/22 | 58.1s |
| #85 | Qwen3.6 Flash medium | Qwen | 1 | 6.9 | $0.738 | 12/22 | 44.7s |
| #134 | Mimo V2 Omni medium | Xiaomi | 2 | 5.9 | $0.683 | 10/21 | 41.2s |
| #63 | Claude Sonnet 4.6 none | Anthropic | 1 | 7.3 | $0.661 | 12/22 | 8.12s |
| #24 | Muse Spark 1.1 low | Meta | 2 | 8.3 | $0.647 | 13/22 | 11.5s |
| #104 | Gemini 3.1 Flash Lite Preview low | 1 | 6.5 | $0.646 | 13/22 | 16.7s | |
| #25 | Gemini 2.5 Flash medium | 1 | 8.2 | $0.643 | 15/22 | 21.2s | |
| #9 | Gemini 3.5 Flash medium | 1 | 9.1 | $0.642 | 19/22 | 8.20s |