API error Failure Ranking

See which AI models run into API error most often, so you can spot reliability risks before choosing one. Sort by: Score ↓.

Models Shown

Total Failures

161

Most Affected Model

Categories

In category Coding45 In category Combined26 In category Tool Calling17 In category Anti-AI Tricks14 In category Data parsing and extraction14 In category Trivia13 In category General Intelligence12 In category Puzzle Solving12 In category Domain specific7 In category Instructions following1

68/68

Rank	Model	Company	API error Count	Score	Total Cost	Tests Correct	Response Time (avg)
#202	Grok Build 0.1 none	X AI	3	4.0	$0.547	7/19	28.7s
Total Tests 19 Wrong Tests 12 Total Cost $0.547 Response Time (avg) 28.7s
#204	Qwen3.5-9B medium	Qwen	1	3.8	$0.036	3/22	82.2s
Total Tests 22 Wrong Tests 19 Total Cost $0.036 Response Time (avg) 82.2s
#205	Laguna Xs.2 none	Poolside	4	3.8	$0.004	5/19	806ms
Total Tests 19 Wrong Tests 14 Total Cost $0.004 Response Time (avg) 806ms
#206	gpt-oss-120b none	OpenAI	3	3.7	$0.010	6/19	21.6s
Total Tests 19 Wrong Tests 13 Total Cost $0.010 Response Time (avg) 21.6s
#207	Nemotron 3 Nano Omni 30b A3b Reasoning medium	NVIDIA	6	3.4	$0.000	4/19	17.1s
Total Tests 19 Wrong Tests 15 Total Cost $0.000 Response Time (avg) 17.1s
#208	Nemotron 3 Nano Omni 30b A3b Reasoning none	NVIDIA	6	3.2	$0.000	2/19	728ms
Total Tests 19 Wrong Tests 17 Total Cost $0.000 Response Time (avg) 728ms
#209	Step 3.5 Flash none	Stepfun	4	2.3	$0.020	6/12	39.0s
Total Tests 12 Wrong Tests 6 Total Cost $0.020 Response Time (avg) 39.0s
#210	LFM2-24B-A2B none	Liquid	4	2.2	$0.001	2/16	782ms
Total Tests 16 Wrong Tests 14 Total Cost $0.001 Response Time (avg) 782ms

←

1 2 3 4 5

API error Failures