Did not follow instructions Failures
See which AI models run into Did not follow instructions most often, so you can spot reliability risks before choosing one. Sort by: Total Cost ↓.
Categories
293/293
Filter models
No models match the current search and filters.
| Rank | Model | Company | Did not follow instructions Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #380 | Mimo V2 PRO default | Xiaomi | 2 | 0.5 | $0.045 | 7/21 | 2.27s |
| #114 | Qwen3.8 Flash Next low | Qwen | 1 | 0.8 | ~$0.045 | 15/23 | 23.7s |
| #370 | Laguna S 2.1 none | Poolside | 2 | 0.5 | $0.044 | 2/23 | 17.7s |
| #342 | MiMo-V2-Flash medium | Xiaomi | 1 | 0.5 | $0.043 | 12/21 | 20.1s |
| #362 | Qwen3.5-9B none | Qwen | 2 | 0.5 | $0.041 | 4/23 | 37.2s |
| #314 | Nemotron 3.5 Super VL none | NVIDIA | 2 | 0.6 | $0.040 | 8/23 | 47.0s |
| #230 | Mercury 2.5 Preview high | Inception | 2 | 0.6 | $0.040 | 12/23 | 7.61s |
| #204 | Mercury 2.5 Preview medium | Inception | 1 | 0.7 | $0.039 | 15/23 | 6.66s |
| #218 | GLM 5.3 Flash low | Z.ai | 2 | 0.7 | $0.038 | 11/23 | 11.8s |
| #389 | Granite 4.2 8B none | IBM Granite | 1 | 0.4 | $0.037 | 3/23 | 84.7s |
| #332 | Granite 4.2 8B low | IBM Granite | 1 | 0.5 | $0.036 | 7/23 | 58.2s |
| #391 | Mercury 2 none | Inception | 2 | 0.4 | $0.033 | 4/23 | 1.18s |
| #403 | Laguna M.1 medium | Poolside | 1 | 0.4 | $0.033 | 9/19 | 14.7s |
| #144 | GPT-6 Luna low | OpenAI | 1 | 0.8 | $0.033 | 12/23 | 23.2s |
| #307 | Gemma 4 31B none | 1 | 0.6 | $0.031 | 9/23 | 7.28s |