Tool Calling: API error
Tool Calling
API error
See which AI models are most likely to hit API error on Tool Calling, so you can spot weak points faster. Sort by: Failure Count ↑.
Failure Reasons
39/39
Filter models
No models match the current search and filters.
| Rank | Model | Company | API error Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #93 | Kimi K3 max | Moonshot AI | 1 | 0.3 | $3.409 | 0/1 | 0ms |
| #98 | Gemini 4 Argon low | 1 | 0.5 | $0.438 | 0/1 | 6.57s | |
| #144 | GLM 5.1 medium | Z.ai | 1 | 0.3 | $1.546 | 0/1 | 0ms |
| #147 | Seed-2.0-Code high | Bytedance Seed | 1 | 0.5 | $1.448 | 0/1 | 35.1s |
| #151 | Seed-2.0-Code medium | Bytedance Seed | 1 | 0.5 | $1.275 | 0/1 | 36.4s |
| #167 | Qwen3.8 27B medium | Qwen | 1 | 0.3 | ~$0.073 | 0/1 | 0ms |
| #183 | Kimi K2.7 Code medium | Moonshot AI | 1 | 0.3 | $1.136 | 0/1 | 0ms |
| #184 | Ember-1 low | Fireworks | 1 | 0.3 | $1.488 | 0/1 | 26.4s |
| #191 | Ember-1 high | Fireworks | 1 | 0.3 | $2.405 | 0/1 | 26.5s |
| #192 | Gemma 4 31B medium | 1 | 0.3 | $0.144 | 0/1 | 0ms | |
| #199 | Mercury 2.5 Preview medium | Inception | 1 | 0.3 | $0.039 | 0/1 | 2.37s |
| #209 | Ember-1 max | Fireworks | 1 | 0.3 | $3.264 | 0/1 | 26.4s |
| #220 | Beam 1.0 501B A23B medium | Reflection | 1 | 0.3 | $0.499 | 0/1 | 1.95s |
| #223 | Qwen3.6 35B A3B medium | Qwen | 1 | 0.3 | $0.834 | 0/1 | 0ms |
| #224 | Mercury 2.5 Preview high | Inception | 1 | 0.3 | $0.040 | 0/1 | 2.25s |