Did not follow instructions Failures
See which AI models run into Did not follow instructions most often, so you can spot reliability risks before choosing one. Sort by: Failure Count ↑.
Categories
293/293
Filter models
No models match the current search and filters.
| Rank | Model | Company | Did not follow instructions Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #367 | Mercury 2.5 Preview default | Inception | 1 | 0.5 | $0.023 | 4/23 | 7.05s |
| #373 | DeepSeek V3.2 none | DeepSeek | 1 | 0.5 | $0.119 | 6/23 | 22.4s |
| #385 | Mimo V2 Omni default | Xiaomi | 1 | 0.4 | $0.021 | 8/21 | 2.44s |
| #389 | Granite 4.2 8B none | IBM Granite | 1 | 0.4 | $0.037 | 3/23 | 84.7s |
| #392 | Gemini 3.1 Flash Lite Preview high | 1 | 0.4 | $2.310 | 13/16 | 68.1s | |
| #399 | Qwen3.5-9B medium | Qwen | 1 | 0.4 | $0.106 | 3/23 | 110.2s |
| #403 | Laguna M.1 medium | Poolside | 1 | 0.4 | $0.033 | 9/19 | 14.7s |
| #406 | Nemotron 3.5 Lightning none | NVIDIA | 1 | 0.4 | $0.009 | 3/23 | 15.9s |
| #411 | Grok 4.20 Beta default | X AI | 1 | 0.4 | $0.087 | 6/18 | 1.19s |
| #425 | Laguna Xs.2 default | Poolside | 1 | 0.3 | $0.004 | 5/19 | 806ms |
| #429 | Nemotron 3 Nano Omni 30b A3b Reasoning medium | NVIDIA | 1 | 0.3 | $0.000 | 4/19 | 17.1s |
| #430 | d1-ultra default | Liquid | 1 | 0.3 | $0.003 | 4/12 | 531ms |
| #433 | Decider V1.2 default | Perplexity | 1 | 0.3 | $0.001 | 5/12 | 517ms |
| #436 | GPT-6 Luna Decisions default | OpenAI | 1 | 0.2 | $0.005 | 3/12 | 495ms |
| #438 | Jev 1.14 default | Typesafe | 1 | 0.2 | $0.003 | 4/12 | 377ms |