API error Failure Ranking

See which AI models run into API error most often, so you can spot reliability risks before choosing one. Sort by: Score ↑.

Models Shown

Total Failures

217

Most Affected Model

Categories

In category Coding56 In category Combined37 In category Tool Calling25 In category Anti-AI Tricks20 In category Data parsing and extraction17 In category Domain specific17 In category Puzzle Solving15 In category General Intelligence14 In category Trivia14 In category Instructions following2

94/94

Rank	Model	Company	API error Count	Score	Total Cost	Tests Correct	Response Time (avg)
#69	Inkling medium	Thinkingmachines	1	8.0	$0.383	15/22	15.7s
Total Tests 22 Wrong Tests 7 Total Cost $0.383 Response Time (avg) 15.7s
#67	DeepSeek V4 Flash 0731 high	DeepSeek	1	8.0	$0.084	14/22	114.9s
Total Tests 22 Wrong Tests 8 Total Cost $0.084 Response Time (avg) 114.9s
#65	Muse Spark 1.1 high	Meta	1	8.0	$2.253	12/22	36.9s
Total Tests 22 Wrong Tests 10 Total Cost $2.253 Response Time (avg) 36.9s
#59	Muse Spark 1.3 low	Meta	1	8.2	$0.689	15/22	16.0s
Total Tests 22 Wrong Tests 7 Total Cost $0.689 Response Time (avg) 16.0s

←

1 2 3 4 5 6 7

API error Failures