API error Failure Ranking

See which AI models run into API error most often, so you can spot reliability risks before choosing one. Sort by: Total Cost ↑.

Models Shown

Total Failures

217

Most Affected Model

Categories

In category Coding56 In category Combined37 In category Tool Calling25 In category Anti-AI Tricks20 In category Data parsing and extraction17 In category Domain specific17 In category Puzzle Solving15 In category General Intelligence14 In category Trivia14 In category Instructions following2

94/94

Rank	Model	Company	API error Count	Score	Total Cost	Tests Correct	Response Time (avg)
#233	Hy4 preview low	Tencent	14	5.6	$1.745	3/22	214.3s
Total Tests 22 Wrong Tests 19 Total Cost $1.745 Response Time (avg) 214.3s
#65	Muse Spark 1.1 high	Meta	1	8.0	$2.253	12/22	36.9s
Total Tests 22 Wrong Tests 10 Total Cost $2.253 Response Time (avg) 36.9s
#71	Kimi K3 max	Moonshot AI	2	7.9	$3.467	16/22	142.8s
Total Tests 22 Wrong Tests 6 Total Cost $3.467 Response Time (avg) 142.8s
#278	Grok 4.20 Multi Agent Beta medium	X AI	2	4.8	$5.599	8/18	9.69s
Total Tests 18 Wrong Tests 10 Total Cost $5.599 Response Time (avg) 9.69s

←

1 2 3 4 5 6 7

API error Failures