API error Failure Ranking

See which AI models run into API error most often, so you can spot reliability risks before choosing one. Sort by: Failure Count ↑.

Models Shown

Total Failures

419

Most Affected Model

Gemini 4 Argon 1

Categories

In category Coding65 In category Combined62 In category Anti-AI Tricks44 In category Domain specific40 In category Tool Calling39 In category Data parsing and extraction37 In category Agentic36 In category Puzzle Solving35 In category Instructions following25 In category Trivia19

149/149

Rank	Model	Company	API error Count	Score	Total Cost	Tests Correct	Response Time (avg)
#363	Hy4 preview none	Tencent	2	0.5	$0.165	3/23	40.4s
Total Tests 23 Wrong Tests 20 Total Cost $0.165 Response Time (avg) 40.4s
#387	KAT Coder AIR V2.5 default	Kwaipilot	2	0.4	$0.070	5/23	12.0s
Total Tests 23 Wrong Tests 18 Total Cost $0.070 Response Time (avg) 12.0s
#390	Cobuddy medium	Baidu	2	0.4	$0.000	7/22	38.0s
Total Tests 22 Wrong Tests 15 Total Cost $0.000 Response Time (avg) 38.0s
#400	Grok 4.20 Multi Agent Beta medium	X AI	2	0.4	$5.599	8/18	9.69s
Total Tests 18 Wrong Tests 10 Total Cost $5.599 Response Time (avg) 9.69s
#404	Ling 3.0 Tiny default	Inclusionai	2	0.4	$0.000	2/23	13.4s
Total Tests 23 Wrong Tests 21 Total Cost $0.000 Response Time (avg) 13.4s
#408	Ling 3.0 Tiny high	Inclusionai	2	0.4	$0.000	4/23	72.2s
Total Tests 23 Wrong Tests 19 Total Cost $0.000 Response Time (avg) 72.2s
#409	Ling 3.0 Tiny low	Inclusionai	2	0.4	$0.000	4/23	63.2s
Total Tests 23 Wrong Tests 19 Total Cost $0.000 Response Time (avg) 63.2s
#410	Ling 3.0 Tiny medium	Inclusionai	2	0.4	$0.000	4/23	65.0s
Total Tests 23 Wrong Tests 19 Total Cost $0.000 Response Time (avg) 65.0s
#44	Muse Wonder minimal	Meta	3	0.9	$1.639	17/23	7.72s
Total Tests 23 Wrong Tests 6 Total Cost $1.639 Response Time (avg) 7.72s
#150	Seed-2.0-Code high	Bytedance Seed	3	0.7	$1.448	12/23	124.9s
Total Tests 23 Wrong Tests 11 Total Cost $1.448 Response Time (avg) 124.9s
#225	Beam 1.0 501B A23B medium	Reflection	3	0.7	$0.499	14/23	6.27s
Total Tests 23 Wrong Tests 9 Total Cost $0.499 Response Time (avg) 6.27s
#232	Beam 1.0 501B A23B xhigh	Reflection	3	0.6	$0.688	12/23	9.18s
Total Tests 23 Wrong Tests 11 Total Cost $0.688 Response Time (avg) 9.18s
#240	Beam 1.0 501B A23B max	Reflection	3	0.6	$0.799	12/23	11.1s
Total Tests 23 Wrong Tests 11 Total Cost $0.799 Response Time (avg) 11.1s
#245	Beam 1.0 501B A23B low	Reflection	3	0.6	$0.432	11/23	4.89s
Total Tests 23 Wrong Tests 12 Total Cost $0.432 Response Time (avg) 4.89s
#274	Beam 1.0 501B A23B high	Reflection	3	0.6	$0.674	11/23	9.03s
Total Tests 23 Wrong Tests 12 Total Cost $0.674 Response Time (avg) 9.03s

API error Failures

Filter models

Top Models by API error Count

API error Count vs Score

Top Models by Response Time (avg)