Did not follow instructions Failures
See which AI models run into Did not follow instructions most often, so you can spot reliability risks before choosing one. Sort by: Total Cost ↓.
Categories
293/293
Filter models
No models match the current search and filters.
| Rank | Model | Company | Did not follow instructions Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #399 | Qwen3.5-9B medium | Qwen | 1 | 0.4 | $0.106 | 3/23 | 110.2s |
| #328 | Step 3.5 Flash medium | Stepfun | 3 | 0.5 | $0.105 | 10/22 | 190.5s |
| #336 | Qwen3.6 35B A3B none | Qwen | 2 | 0.5 | $0.105 | 4/23 | 8.43s |
| #300 | Ring 2.6 1t medium | Inclusionai | 2 | 0.6 | $0.102 | 11/23 | 65.5s |
| #211 | Solar Pro 4 low | Upstage | 2 | 0.7 | $0.101 | 11/23 | 145.2s |
| #241 | Solar Pro 4 medium | Upstage | 2 | 0.6 | $0.098 | 12/23 | 133.9s |
| #349 | Laguna S 2.1 medium | Poolside | 1 | 0.5 | $0.092 | 4/23 | 63.1s |
| #271 | Gemini 3.1 Flash Lite Preview none | 2 | 0.6 | $0.090 | 12/23 | 3.60s | |
| #145 | Qwen3.8 27B low | Qwen | 1 | 0.8 | ~$0.089 | 15/23 | 46.6s |
| #53 | GLM 5.3 Flash max | Z.ai | 1 | 0.9 | $0.089 | 17/23 | 54.0s |
| #92 | Claude Haiku 5.5 high | Anthropic | 1 | 0.8 | $0.088 | 15/23 | 10.4s |
| #411 | Grok 4.20 Beta default | X AI | 1 | 0.4 | $0.087 | 6/18 | 1.19s |
| #158 | DeepSeek V4 Pro 0423 none | DeepSeek | 2 | 0.7 | $0.083 | 10/23 | 14.1s |
| #315 | Nemotron 3 Super medium | NVIDIA | 3 | 0.6 | $0.081 | 8/23 | 56.4s |
| #288 | Gemini 3.1 Flash Lite minimal | 3 | 0.6 | $0.080 | 10/23 | 3.95s |