Timed out Failure Ranking

See which AI models run into Timed out most often, so you can spot reliability risks before choosing one. Sort by: Total Cost ↓.

Models Shown

Total Failures

126

Most Affected Model

Categories

In category Domain specific46 In category Coding26 In category Agentic11 In category Combined11 In category Puzzle Solving11 In category Anti-AI Tricks8 In category Instructions following5 In category General Intelligence4 In category Data parsing and extraction2 In category Trivia2

67/67

Rank	Model	Company	Timed out Count	Score	Total Cost	Tests Correct	Response Time (avg)
#311	Gemma 4 26B A4B none	Google	1	0.5	$0.031	9/23	10.5s
Total Tests 23 Wrong Tests 14 Total Cost $0.031 Response Time (avg) 10.5s
#272	Granite 4.2 8B medium	IBM Granite	4	0.6	$0.029	8/23	50.5s
Total Tests 23 Wrong Tests 15 Total Cost $0.029 Response Time (avg) 50.5s
#326	Laguna XS 2.1 none	Poolside	1	0.5	$0.020	5/23	4.56s
Total Tests 23 Wrong Tests 18 Total Cost $0.020 Response Time (avg) 4.56s
#397	Nemotron 3.5 Lightning none	NVIDIA	1	0.4	$0.009	3/23	15.9s
Total Tests 23 Wrong Tests 20 Total Cost $0.009 Response Time (avg) 15.9s
#316	North Mini Code medium	Cohere	1	0.5	$0.000	8/23	140.4s
Total Tests 23 Wrong Tests 15 Total Cost $0.000 Response Time (avg) 140.4s
#392	Hunter Alpha medium	OpenRouter	2	0.4	$0.000	8/18	10.3s
Total Tests 18 Wrong Tests 10 Total Cost $0.000 Response Time (avg) 10.3s
#398	Xing4.0 29b A4b medium	Xingchen AGI	6	0.4	$0.000	1/23	371.7s
Total Tests 23 Wrong Tests 22 Total Cost $0.000 Response Time (avg) 371.7s

←

1 2 3 4 5

Timed out Failures