Timed out Failure Ranking

See which AI models run into Timed out most often, so you can spot reliability risks before choosing one. Sort by: Tests Correct ↓.

Models Shown

Total Failures

126

Most Affected Model

Categories

In category Domain specific46 In category Coding26 In category Agentic11 In category Combined11 In category Puzzle Solving11 In category Anti-AI Tricks8 In category Instructions following5 In category General Intelligence4 In category Data parsing and extraction2 In category Trivia2

67/67

Rank	Model	Company	Timed out Count	Score	Total Cost	Tests Correct	Response Time (avg)
#362	Granite 4.2 8B high	IBM Granite	10	0.5	$0.111	4/23	235.4s
Total Tests 23 Wrong Tests 19 Total Cost $0.111 Response Time (avg) 235.4s
#385	GLM 4.7 Flash medium	Z.ai	2	0.4	$0.193	4/23	150.9s
Total Tests 23 Wrong Tests 19 Total Cost $0.193 Response Time (avg) 150.9s
#363	Qwen3 Coder Next medium	Qwen	1	0.5	$0.071	3/23	17.0s
Total Tests 23 Wrong Tests 20 Total Cost $0.071 Response Time (avg) 17.0s
#380	Granite 4.2 8B none	IBM Granite	3	0.4	$0.037	3/23	84.7s
Total Tests 23 Wrong Tests 20 Total Cost $0.037 Response Time (avg) 84.7s
#390	Qwen3.5-9B medium	Qwen	11	0.4	$0.106	3/23	110.2s
Total Tests 23 Wrong Tests 20 Total Cost $0.106 Response Time (avg) 110.2s
#397	Nemotron 3.5 Lightning none	NVIDIA	1	0.4	$0.009	3/23	15.9s
Total Tests 23 Wrong Tests 20 Total Cost $0.009 Response Time (avg) 15.9s
#398	Xing4.0 29b A4b medium	Xingchen AGI	6	0.4	$0.000	1/23	371.7s
Total Tests 23 Wrong Tests 22 Total Cost $0.000 Response Time (avg) 371.7s

←

1 2 3 4 5

Timed out Failures