General Intelligence: Did not follow instructions
General Intelligence
Did not follow instructions
See which AI models are most likely to hit Did not follow instructions on General Intelligence, so you can spot weak points faster.
Failure Reasons
122/122
Filter models
No models match the current search and filters.
| Rank | Model | Company | Did not follow instructions Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #155 | Seed-2.0-Mini medium | Bytedance Seed | 1 | 5.1 | $0.116 | 0/1 | 36.7s |
| #156 | Kimi K2.5 medium | Moonshot AI | 1 | 6.5 | $0.479 | 0/1 | 69.7s |
| #157 | KAT-Coder-Pro V2.5 medium | Kwaipilot | 1 | 4.7 | $0.478 | 0/1 | 2.35s |
| #159 | Qwen3.7 Flash medium | Qwen | 1 | 5.5 | $0.065 | 0/1 | 10.2s |
| #164 | Seed-2.0-Code medium | Bytedance Seed | 1 | 4.8 | $1.153 | 0/1 | 11.4s |
| #165 | GLM 5.3 FlashX high | Z.ai | 1 | 6.1 | $0.135 | 0/1 | 2.28s |
| #167 | Solar Pro 4 medium | Upstage | 1 | 3.0 | $0.140 | 0/1 | 48.0s |
| #169 | GLM 5.3 low | Z.ai | 1 | 4.1 | $0.167 | 0/1 | 4.70s |
| #170 | MiMo-V2.5-Pro medium | Xiaomi | 1 | 5.5 | $0.221 | 0/1 | 4.02s |
| #182 | Qwen3.5-27B none | Qwen | 1 | 5.0 | $0.058 | 0/1 | 2.51s |
| #183 | Gemini 3.1 Flash Lite Preview low | 1 | 4.0 | $0.646 | 0/1 | 1.54s | |
| #184 | Inkling Small medium | Thinkingmachines | 1 | 5.3 | $0.113 | 0/1 | 2.58s |
| #186 | Qwen3.6 35B A3B medium | Qwen | 1 | 4.4 | $0.750 | 0/1 | 8.66s |
| #187 | Mercury 2.5 Preview high | Inception | 1 | 5.1 | $0.030 | 0/1 | 1.88s |
| #189 | Qwen3.6 27B medium | Qwen | 1 | 6.5 | $0.577 | 0/1 | 39.5s |