API error Failure Ranking

See which AI models run into API error most often, so you can spot reliability risks before choosing one. Sort by: Total Cost ↑.

Models Shown

Total Failures

419

Most Affected Model

Minimax M3.1 Flash 1

Categories

In category Coding65 In category Combined62 In category Anti-AI Tricks44 In category Domain specific40 In category Tool Calling39 In category Data parsing and extraction37 In category Agentic36 In category Puzzle Solving35 In category Instructions following25 In category Trivia19

149/149

Rank	Model	Company	API error Count	Score	Total Cost	Tests Correct	Response Time (avg)
#439	Classify-1 default	Scaledown	1	0.2	$0.008	3/12	4.58s
Total Tests 12 Wrong Tests 9 Total Cost $0.008 Response Time (avg) 4.58s
#412	Laguna M.1 default	Poolside	4	0.4	$0.009	4/19	2.89s
Total Tests 19 Wrong Tests 15 Total Cost $0.009 Response Time (avg) 2.89s
#418	Laguna Xs.2 medium	Poolside	4	0.3	$0.015	6/19	6.73s
Total Tests 19 Wrong Tests 13 Total Cost $0.015 Response Time (avg) 6.73s
#350	Mercury 2.5 Preview low	Inception	1	0.5	$0.015	6/23	4.92s
Total Tests 23 Wrong Tests 17 Total Cost $0.015 Response Time (avg) 4.92s
#360	Ling 2.6 1t default	Inclusionai	4	0.5	$0.016	4/23	8.16s
Total Tests 23 Wrong Tests 19 Total Cost $0.016 Response Time (avg) 8.16s
#395	gpt-oss-120b none	OpenAI	3	0.4	$0.016	6/20	28.6s
Total Tests 20 Wrong Tests 14 Total Cost $0.016 Response Time (avg) 28.6s
#345	Mercury 2.5 low	Inception	1	0.5	$0.020	6/23	3.34s
Total Tests 23 Wrong Tests 17 Total Cost $0.020 Response Time (avg) 3.34s
#442	Step 3.5 Flash none	Stepfun	4	0.2	$0.020	6/12	39.0s
Total Tests 12 Wrong Tests 6 Total Cost $0.020 Response Time (avg) 39.0s
#299	Ling 3.0 Flash high	Inclusionai	2	0.6	$0.021	12/23	13.1s
Total Tests 23 Wrong Tests 11 Total Cost $0.021 Response Time (avg) 13.1s
#385	Mimo V2 Omni default	Xiaomi	1	0.4	$0.021	8/21	2.44s
Total Tests 21 Wrong Tests 13 Total Cost $0.021 Response Time (avg) 2.44s
#420	MiMo-V2-Flash default	Xiaomi	1	0.3	$0.025	4/21	2.76s
Total Tests 21 Wrong Tests 17 Total Cost $0.025 Response Time (avg) 2.76s
#319	GPT-6 Luna none	OpenAI	1	0.5	$0.026	7/23	20.5s
Total Tests 23 Wrong Tests 16 Total Cost $0.026 Response Time (avg) 20.5s
#384	Ring 2.6 1t default	Inclusionai	7	0.4	$0.026	9/23	48.9s
Total Tests 23 Wrong Tests 14 Total Cost $0.026 Response Time (avg) 48.9s
#307	Gemma 4 31B none	Google	2	0.6	$0.031	9/23	7.28s
Total Tests 23 Wrong Tests 14 Total Cost $0.031 Response Time (avg) 7.28s
#144	GPT-6 Luna low	OpenAI	2	0.8	$0.033	12/23	23.2s
Total Tests 23 Wrong Tests 11 Total Cost $0.033 Response Time (avg) 23.2s

API error Failures

Filter models

Top Models by API error Count

API error Count vs Score

Top Models by Response Time (avg)