API error Failure Ranking

See which AI models run into API error most often, so you can spot reliability risks before choosing one. Sort by: Response Time (avg) ↓.

Models Shown

Total Failures

161

Most Affected Model

Categories

In category Coding45 In category Combined26 In category Tool Calling17 In category Anti-AI Tricks14 In category Data parsing and extraction14 In category Trivia13 In category General Intelligence12 In category Puzzle Solving12 In category Domain specific7 In category Instructions following1

68/68

Rank	Model	Company	API error Count	Score	Total Cost	Tests Correct	Response Time (avg)
#206	MiMo-V2-Flash none	Xiaomi	1	4.0	$0.025	4/21	2.76s
Total Tests 21 Wrong Tests 17 Total Cost $0.025 Response Time (avg) 2.76s
#163	Mimo V2 Omni none	Xiaomi	1	5.5	$0.021	8/21	2.44s
Total Tests 21 Wrong Tests 13 Total Cost $0.021 Response Time (avg) 2.44s
#153	Mimo V2 PRO none	Xiaomi	1	5.6	$0.045	7/21	2.27s
Total Tests 21 Wrong Tests 14 Total Cost $0.045 Response Time (avg) 2.27s
#201	Elephant Alpha medium	Openrouter	3	4.3	$0.000	6/21	1.27s
Total Tests 21 Wrong Tests 15 Total Cost $0.000 Response Time (avg) 1.27s
#199	Elephant Alpha none	Openrouter	3	4.3	$0.000	5/21	1.22s
Total Tests 21 Wrong Tests 16 Total Cost $0.000 Response Time (avg) 1.22s
#211	Laguna Xs.2 none	Poolside	4	3.8	$0.004	5/19	806ms
Total Tests 19 Wrong Tests 14 Total Cost $0.004 Response Time (avg) 806ms
#216	LFM2-24B-A2B none	Liquid	4	2.2	$0.001	2/16	782ms
Total Tests 16 Wrong Tests 14 Total Cost $0.001 Response Time (avg) 782ms
#214	Nemotron 3 Nano Omni 30b A3b Reasoning none	NVIDIA	6	3.2	$0.000	2/19	728ms
Total Tests 19 Wrong Tests 17 Total Cost $0.000 Response Time (avg) 728ms

←

1 2 3 4 5

API error Failures