API error Failure Ranking

See which AI models run into API error most often, so you can spot reliability risks before choosing one. Sort by: Tests Correct ↑.

Models Shown

Total Failures

161

Most Affected Model

Categories

In category Coding45 In category Combined26 In category Tool Calling17 In category Anti-AI Tricks14 In category Data parsing and extraction14 In category Trivia13 In category General Intelligence12 In category Puzzle Solving12 In category Domain specific7 In category Instructions following1

68/68

Rank	Model	Company	API error Count	Score	Total Cost	Tests Correct	Response Time (avg)
#61	Qwen3.5 Plus 2026-02-15 medium	Qwen	1	7.5	$0.437	14/22	89.2s
Total Tests 22 Wrong Tests 8 Total Cost $0.437 Response Time (avg) 89.2s
#116	Gemma 4 31B medium	Google	2	6.3	$0.107	14/22	75.4s
Total Tests 22 Wrong Tests 8 Total Cost $0.107 Response Time (avg) 75.4s
#106	Hy3 preview medium	Tencent	3	6.5	$0.018	14/21	16.3s
Total Tests 21 Wrong Tests 7 Total Cost $0.018 Response Time (avg) 16.3s
#139	Gemini 3 PRO Preview medium	Google	4	6.0	$0.385	14/21	9.05s
Total Tests 21 Wrong Tests 7 Total Cost $0.385 Response Time (avg) 9.05s
#36	Inkling medium	Thinkingmachines	1	8.0	$0.391	15/22	16.2s
Total Tests 22 Wrong Tests 7 Total Cost $0.391 Response Time (avg) 16.2s
#41	Qwen3.6 Plus medium	Qwen	1	7.8	$0.405	15/22	43.1s
Total Tests 22 Wrong Tests 7 Total Cost $0.405 Response Time (avg) 43.1s
#83	Gemini 3.5 Flash none	Google	4	7.0	$1.079	15/22	9.93s
Total Tests 22 Wrong Tests 7 Total Cost $1.079 Response Time (avg) 9.93s
#37	Kimi K3 max	Moonshot AI	2	8.0	$3.112	16/22	122.5s
Total Tests 22 Wrong Tests 6 Total Cost $3.112 Response Time (avg) 122.5s

←

1 2 3 4 5

API error Failures