Coding x Timed out Ranking

AI BENCHY Category Failures

See which AI models are most likely to hit Timed out on Coding, so you can spot weak points faster. Sort by: Tests Correct ↓.

Models Shown

Total Failures

Most Affected Model

Failure Reasons

Wrong answer230 API error43 Timed out25 No answer18 Did not follow instructions16 Extra formatting12

Categories

Domain specific37 Coding25 Puzzle Solving5 Anti-AI Tricks4 General Intelligence4 Combined2 Data parsing and extraction1 Instructions following1

22/22

Rank	Model	Company	Timed out Count	Category Score	Total Cost	Tests Correct	Response Time (avg)
#94	Step 3.5 Flash medium	Stepfun	1	2.4	$0.070	0/2	258.4s
Total Tests 2 Wrong Tests 2 Total Cost $0.070 Response Time (avg) 258.4s
#103	Gemma 4 31B medium	Google	2	4.3	$0.033	0/3	219.8s
Total Tests 3 Wrong Tests 3 Total Cost $0.033 Response Time (avg) 219.8s
#139	Gemma 4 26B A4B none	Google	1	3.7	$0.004	0/3	4.16s
Total Tests 3 Wrong Tests 3 Total Cost $0.004 Response Time (avg) 4.16s
#166	MiniMax M2.5 medium	Minimax	1	3.4	$0.303	0/3	188.6s
Total Tests 3 Wrong Tests 3 Total Cost $0.303 Response Time (avg) 188.6s
#168	Qwen3 Coder Next medium	Qwen	1	3.7	$0.008	0/3	924ms
Total Tests 3 Wrong Tests 3 Total Cost $0.008 Response Time (avg) 924ms
#177	GLM 4.7 Flash medium	Z.ai	2	3.2	$0.054	0/3	55.3s
Total Tests 3 Wrong Tests 3 Total Cost $0.054 Response Time (avg) 55.3s
#185	Qwen3.5-9B medium	Qwen	1	2.9	$0.036	0/3	100.9s
Total Tests 3 Wrong Tests 3 Total Cost $0.036 Response Time (avg) 100.9s

Filter models