Instructions following: API error
Instructions following
API error
See which AI models are most likely to hit API error on Instructions following, so you can spot weak points faster. Sort by: Total Cost ↑.
Failure Reasons
21/21
Filter models
No models match the current search and filters.
| Rank | Model | Company | API error Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #389 | Qwen3.6 Plus Preview medium | Qwen | 1 | 0.7 | $0.000 | 1/2 | 3.40s |
| #398 | Xing4.0 29b A4b medium | Xingchen AGI | 1 | 0.4 | $0.000 | 0/2 | 25.4s |
| #412 | Xing4.0 29b A4b none | Xingchen AGI | 1 | 0.4 | $0.000 | 0/2 | 11.7s |
| #417 | Command A+ none | Cohere | 2 | 0.3 | $0.000 | 0/2 | 95.7s |
| #336 | Mercury 2.5 low | Inception | 1 | 0.3 | $0.020 | 0/2 | 972ms |
| #141 | GPT-6 Luna low | OpenAI | 1 | 0.7 | $0.033 | 1/2 | 17.4s |
| #239 | Mercury 2.5 medium | Inception | 1 | 0.6 | $0.034 | 1/2 | 1.07s |
| #225 | Mercury 2.5 high | Inception | 1 | 0.7 | $0.044 | 1/2 | 934ms |
| #408 | Command A+ medium | Cohere | 2 | 0.3 | $0.064 | 0/2 | 103.0s |
| #418 | Command A+ low | Cohere | 2 | 0.3 | $0.073 | 0/2 | 105.7s |
| #414 | Command A+ high | Cohere | 2 | 0.3 | $0.079 | 0/2 | 110.3s |
| #320 | Ember-1 none | Fireworks | 1 | 0.6 | $0.786 | 1/2 | 31.0s |
| #184 | Ember-1 low | Fireworks | 1 | 0.6 | $1.488 | 1/2 | 32.7s |
| #43 | Muse Wonder minimal | Meta | 1 | 0.7 | $1.639 | 1/2 | 1.39s |
| #191 | Ember-1 high | Fireworks | 1 | 0.7 | $2.405 | 1/2 | 33.4s |