Instructions following: Wrong answer
Instructions following
Wrong answer
See which AI models are most likely to hit Wrong answer on Instructions following, so you can spot weak points faster. Sort by: Total Cost ↓.
Failure Reasons
111/111
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #165 | Qwen3.5-27B none | Qwen | 1 | 0.6 | $0.116 | 1/2 | 1.03s |
| #368 | Laguna S 2.1 low | Poolside | 1 | 0.4 | $0.108 | 0/2 | 423ms |
| #327 | Qwen3.6 35B A3B none | Qwen | 1 | 0.6 | $0.105 | 1/2 | 1.86s |
| #244 | LongCat 2.0 none | Meituan | 1 | 0.7 | $0.104 | 1/2 | 2.82s |
| #340 | Laguna S 2.1 medium | Poolside | 1 | 0.4 | $0.092 | 0/2 | 400ms |
| #205 | Qwen3.5-Flash none | Qwen | 1 | 0.6 | $0.089 | 1/2 | 8.81s |
| #402 | Grok 4.20 Beta default | X AI | 1 | 0.6 | $0.087 | 1/2 | 649ms |
| #155 | DeepSeek V4 Pro 0423 none | DeepSeek | 1 | 0.6 | $0.083 | 1/2 | 4.12s |
| #216 | Qwen3.7 Flash medium | Qwen | 1 | 0.6 | $0.076 | 0/2 | 9.27s |
| #363 | Qwen3 Coder Next medium | Qwen | 1 | 0.6 | $0.071 | 1/2 | 7.49s |
| #365 | GPT-5.4 Nano none | OpenAI | 1 | 0.6 | $0.068 | 1/2 | 784ms |
| #348 | Qwen3 Coder Next default | Qwen | 1 | 0.6 | $0.067 | 1/2 | 7.78s |
| #318 | MiMo-V2.6-Flash none | Xiaomi | 1 | 0.7 | $0.060 | 1/2 | 810ms |
| #407 | Grok 4.20 none | X AI | 1 | 0.6 | $0.057 | 1/2 | 445ms |
| #347 | Inkling Small none | Thinkingmachines | 1 | 0.6 | $0.054 | 1/2 | 767ms |