Did not follow instructions Failures
See which AI models run into Did not follow instructions most often, so you can spot reliability risks before choosing one. Sort by: Response Time (avg) ↑.
Categories
293/293
Filter models
No models match the current search and filters.
| Rank | Model | Company | Did not follow instructions Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #201 | Kimi K2.6 medium | Moonshot AI | 2 | 0.7 | $1.594 | 12/23 | 121.3s |
| #212 | Grok 4.7 high | X AI | 2 | 0.7 | $3.037 | 13/23 | 122.2s |
| #150 | Seed-2.0-Code high | Bytedance Seed | 1 | 0.7 | $1.448 | 12/23 | 124.9s |
| #244 | Kimi K2.5 medium | Moonshot AI | 2 | 0.6 | $0.841 | 10/23 | 125.8s |
| #258 | Solar Pro 4 high | Upstage | 3 | 0.6 | $0.077 | 11/23 | 128.9s |
| #241 | Solar Pro 4 medium | Upstage | 2 | 0.6 | $0.098 | 12/23 | 133.9s |
| #279 | Step 5 Preview medium | Stepfun | 2 | 0.6 | $4.136 | 10/23 | 136.1s |
| #311 | Step 5 Preview low | Stepfun | 1 | 0.6 | $4.110 | 10/23 | 138.3s |
| #207 | Solar Pro 4 xhigh | Upstage | 3 | 0.7 | $0.067 | 12/23 | 142.8s |
| #211 | Solar Pro 4 low | Upstage | 2 | 0.7 | $0.101 | 11/23 | 145.2s |
| #68 | MiMo-V2.6-Pro medium | Xiaomi | 1 | 0.9 | $0.586 | 14/23 | 148.1s |
| #394 | GLM 4.7 Flash medium | Z.ai | 2 | 0.4 | $0.193 | 4/23 | 150.9s |
| #165 | LongCat 2.0 high | Meituan | 2 | 0.7 | $0.778 | 10/23 | 151.7s |
| #30 | Muse Spark Open high | Meta | 1 | 0.9 | $1.782 | 17/23 | 152.0s |
| #189 | Step 5 Preview high | Stepfun | 1 | 0.7 | $4.513 | 10/23 | 154.4s |