API error Failure Ranking

See which AI models run into API error most often, so you can spot reliability risks before choosing one. Sort by: Tests Correct ↓.

Models Shown

Total Failures

217

Most Affected Model

Categories

In category Coding56 In category Combined37 In category Tool Calling25 In category Anti-AI Tricks20 In category Data parsing and extraction17 In category Domain specific17 In category Puzzle Solving15 In category General Intelligence14 In category Trivia14 In category Instructions following2

94/94

Rank	Model	Company	API error Count	Score	Total Cost	Tests Correct	Response Time (avg)
#309	Qwen3.5-9B medium	Qwen	1	3.8	$0.062	3/22	107.5s
Total Tests 22 Wrong Tests 19 Total Cost $0.062 Response Time (avg) 107.5s
#316	LFM2-24B-A2B none	Liquid	4	2.2	$0.001	2/16	782ms
Total Tests 16 Wrong Tests 14 Total Cost $0.001 Response Time (avg) 782ms
#314	Nemotron 3 Nano Omni 30b A3b Reasoning none	NVIDIA	6	3.2	$0.000	2/19	728ms
Total Tests 19 Wrong Tests 17 Total Cost $0.000 Response Time (avg) 728ms
#302	Ling 3.0 Tiny none	Inclusionai	1	4.0	$0.000	2/22	14.0s
Total Tests 22 Wrong Tests 20 Total Cost $0.000 Response Time (avg) 14.0s

←

1 2 3 4 5 6 7

API error Failures