Did not follow instructions Failures
See which AI models run into Did not follow instructions most often, so you can spot reliability risks before choosing one. Sort by: Tests Correct ↓.
215/215
Filter models
No models match the current search and filters.
| Rank | Model | Company | Did not follow instructions Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #159 | GLM 5V Turbo medium | Z.ai | 1 | 6.7 | $0.457 | 11/21 | 23.1s |
| #97 | MiniMax M3 medium | Minimax | 2 | 7.5 | $0.300 | 11/22 | 75.2s |
| #107 | Kimi K2.7 Code medium | Moonshot AI | 1 | 7.4 | $0.687 | 11/22 | 80.1s |
| #125 | Qwen3.7 Flash low | Qwen | 3 | 7.2 | $0.043 | 11/22 | 38.0s |
| #126 | Muse Glimmer 30B medium | Meta | 1 | 7.2 | $0.211 | 11/22 | 30.6s |
| #128 | Muse Glimmer 30B low | Meta | 3 | 7.1 | $0.143 | 11/22 | 18.6s |
| #130 | Solar Pro 4 high | Upstage | 3 | 7.1 | $0.046 | 11/22 | 120.6s |
| #133 | DeepSeek V3.2 medium | DeepSeek | 1 | 7.0 | $0.078 | 11/22 | 68.4s |
| #137 | Grok 4.20 medium | X AI | 2 | 7.0 | $0.805 | 11/22 | 32.6s |
| #138 | Seed-2.0-Mini medium | Bytedance Seed | 1 | 7.0 | $0.116 | 11/22 | 93.1s |
| #140 | KAT-Coder-Pro V2.5 medium | Kwaipilot | 1 | 6.9 | $0.478 | 11/22 | 24.9s |
| #141 | Claude Fable 5.1 low | Anthropic | 3 | 6.9 | $2.565 | 11/22 | 10.3s |
| #143 | Seed-2.0-Code high | Bytedance Seed | 1 | 6.9 | $1.273 | 11/22 | 124.2s |
| #148 | Solar Pro 4 low | Upstage | 2 | 6.8 | $0.044 | 11/22 | 136.1s |
| #152 | MiMo-V2.5-Pro medium | Xiaomi | 2 | 6.8 | $0.221 | 11/22 | 48.7s |