Instructions following: API error
Instructions following
API error
See which AI models are most likely to hit API error on Instructions following, so you can spot weak points faster.
Failure Reasons
21/21
Filter models
No models match the current search and filters.
| Rank | Model | Company | API error Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #239 | Mercury 2.5 medium | Inception | 1 | 0.6 | $0.034 | 1/2 | 1.07s |
| #320 | Ember-1 none | Fireworks | 1 | 0.6 | $0.786 | 1/2 | 31.0s |
| #336 | Mercury 2.5 low | Inception | 1 | 0.3 | $0.020 | 0/2 | 972ms |
| #389 | Qwen3.6 Plus Preview medium | Qwen | 1 | 0.7 | $0.000 | 1/2 | 3.40s |
| #398 | Xing4.0 29b A4b medium | Xingchen AGI | 1 | 0.4 | $0.000 | 0/2 | 25.4s |
| #412 | Xing4.0 29b A4b none | Xingchen AGI | 1 | 0.4 | $0.000 | 0/2 | 11.7s |