API error Failure Ranking

See which AI models run into API error most often, so you can spot reliability risks before choosing one. Sort by: Failure Count ↑.

Models Shown

Total Failures

419

Most Affected Model

Gemini 4 Argon 1

Categories

In category Coding65 In category Combined62 In category Anti-AI Tricks44 In category Domain specific40 In category Tool Calling39 In category Data parsing and extraction37 In category Agentic36 In category Puzzle Solving35 In category Instructions following25 In category Trivia19

149/149

Rank	Model	Company	API error Count	Score	Total Cost	Tests Correct	Response Time (avg)
#315	Nemotron 3 Super medium	NVIDIA	4	0.6	$0.081	8/23	56.4s
Total Tests 23 Wrong Tests 15 Total Cost $0.081 Response Time (avg) 56.4s
#340	KAT Coder AIR V2.5 high	Kwaipilot	4	0.5	$0.077	7/23	15.2s
Total Tests 23 Wrong Tests 16 Total Cost $0.077 Response Time (avg) 15.2s
#359	Gemini 3 PRO Preview medium	Google	4	0.5	$0.385	14/21	9.05s
Total Tests 21 Wrong Tests 7 Total Cost $0.385 Response Time (avg) 9.05s
#360	Ling 2.6 1t default	Inclusionai	4	0.5	$0.016	4/23	8.16s
Total Tests 23 Wrong Tests 19 Total Cost $0.016 Response Time (avg) 8.16s
#403	Laguna M.1 medium	Poolside	4	0.4	$0.033	9/19	14.7s
Total Tests 19 Wrong Tests 10 Total Cost $0.033 Response Time (avg) 14.7s
#407	Xing4.0 29b A4b medium	Xingchen AGI	4	0.4	$0.000	1/23	371.7s
Total Tests 23 Wrong Tests 22 Total Cost $0.000 Response Time (avg) 371.7s
#412	Laguna M.1 default	Poolside	4	0.4	$0.009	4/19	2.89s
Total Tests 19 Wrong Tests 15 Total Cost $0.009 Response Time (avg) 2.89s
#418	Laguna Xs.2 medium	Poolside	4	0.3	$0.015	6/19	6.73s
Total Tests 19 Wrong Tests 13 Total Cost $0.015 Response Time (avg) 6.73s
#419	Hy3 preview none	Tencent	4	0.3	$0.007	4/21	12.9s
Total Tests 21 Wrong Tests 17 Total Cost $0.007 Response Time (avg) 12.9s
#425	Laguna Xs.2 default	Poolside	4	0.3	$0.004	5/19	806ms
Total Tests 19 Wrong Tests 14 Total Cost $0.004 Response Time (avg) 806ms
#442	Step 3.5 Flash none	Stepfun	4	0.2	$0.020	6/12	39.0s
Total Tests 12 Wrong Tests 6 Total Cost $0.020 Response Time (avg) 39.0s
#445	LFM2-24B-A2B default	Liquid	4	0.2	$0.001	2/16	782ms
Total Tests 16 Wrong Tests 14 Total Cost $0.001 Response Time (avg) 782ms
#326	Hy4 preview low	Tencent	5	0.5	$1.844	3/23	207.2s
Total Tests 23 Wrong Tests 20 Total Cost $1.844 Response Time (avg) 207.2s
#329	Ember-1 none	Fireworks	5	0.5	$0.786	8/23	22.6s
Total Tests 23 Wrong Tests 15 Total Cost $0.786 Response Time (avg) 22.6s
#134	Muse Wonder high	Meta	6	0.8	$3.426	15/23	23.0s
Total Tests 23 Wrong Tests 8 Total Cost $3.426 Response Time (avg) 23.0s

API error Failures

Filter models

Top Models by API error Count

API error Count vs Score

Top Models by Response Time (avg)