Combined x API error Ranking

See which AI models are most likely to hit API error on Combined, so you can spot weak points faster.

Models Shown

Total Failures

Most Affected Model

Failure Reasons

Invalid tool call147 Wrong answer95 No answer43 API error37 Timed out9 Did not follow instructions1 Extra formatting1

Categories

Coding56 Combined37 Tool Calling25 Anti-AI Tricks20 Data parsing and extraction17 Domain specific17 Puzzle Solving15 General Intelligence14 Trivia14 Instructions following2

33/33

Rank	Model	Company	API error Count	Category Score	Total Cost	Tests Correct	Response Time (avg)
#309	Nemotron 3 Nano Omni 30b A3b Reasoning none	NVIDIA	1	1.5	$0.000	0/1	0ms
Total Tests 1 Wrong Tests 1 Total Cost $0.000 Response Time (avg) 0ms
#310	Step 3.5 Flash none	Stepfun	1	1.5	$0.020	0/1	0ms
Total Tests 1 Wrong Tests 1 Total Cost $0.020 Response Time (avg) 0ms
#311	LFM2-24B-A2B none	Liquid	1	1.5	$0.001	0/1	0ms
Total Tests 1 Wrong Tests 1 Total Cost $0.001 Response Time (avg) 0ms

Filter models