Instructions following: API error
Instructions following
API error
See which AI models are most likely to hit API error on Instructions following, so you can spot weak points faster. Sort by: Failure Count ↑.
Failure Reasons
21/21
Filter models
No models match the current search and filters.
| Rank | Model | Company | API error Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #32 | Muse Wonder medium | Meta | 1 | 0.7 | $3.397 | 1/2 | 3.88s |
| #40 | Muse Wonder low | Meta | 1 | 0.7 | $2.637 | 1/2 | 2.08s |
| #43 | Muse Wonder minimal | Meta | 1 | 0.7 | $1.639 | 1/2 | 1.39s |
| #131 | Muse Wonder high | Meta | 1 | 0.7 | $3.426 | 1/2 | 1.97s |
| #139 | Muse Wonder xhigh | Meta | 1 | 0.7 | $4.012 | 1/2 | 2.64s |
| #141 | GPT-6 Luna low | OpenAI | 1 | 0.7 | $0.033 | 1/2 | 17.4s |
| #184 | Ember-1 low | Fireworks | 1 | 0.6 | $1.488 | 1/2 | 32.7s |
| #185 | Step 5 Preview high | Stepfun | 1 | 0.7 | $4.513 | 1/2 | 20.5s |
| #191 | Ember-1 high | Fireworks | 1 | 0.7 | $2.405 | 1/2 | 33.4s |
| #209 | Ember-1 max | Fireworks | 1 | 0.6 | $3.264 | 1/2 | 33.0s |
| #225 | Mercury 2.5 high | Inception | 1 | 0.7 | $0.044 | 1/2 | 934ms |
| #239 | Mercury 2.5 medium | Inception | 1 | 0.6 | $0.034 | 1/2 | 1.07s |
| #320 | Ember-1 none | Fireworks | 1 | 0.6 | $0.786 | 1/2 | 31.0s |
| #336 | Mercury 2.5 low | Inception | 1 | 0.3 | $0.020 | 0/2 | 972ms |
| #389 | Qwen3.6 Plus Preview medium | Qwen | 1 | 0.7 | $0.000 | 1/2 | 3.40s |