Puzzle Solving x Timed out Ranking

See which AI models are most likely to hit Timed out on Puzzle Solving, so you can spot weak points faster. Sort by: Response Time (avg) ↑.

Models Shown

Total Failures

Most Affected Model

Failure Reasons

Wrong answer201 Did not follow instructions90 API error12 Extra formatting8 Timed out5 No answer3

Categories

Domain specific43 Coding26 Combined5 Puzzle Solving5 Anti-AI Tricks4 General Intelligence4 Data parsing and extraction1 Instructions following1

4/4

Rank	Model	Company	Timed out Count	Category Score	Total Cost	Tests Correct	Response Time (avg)
#190	MiniMax M2.5 medium	Minimax	1	5.3	$0.340	1/3	11.2s
Total Tests 3 Wrong Tests 2 Total Cost $0.340 Response Time (avg) 11.2s
#114	Qwen3.5-Flash medium	Qwen	1	8.2	$0.139	2/3	27.6s
Total Tests 3 Wrong Tests 1 Total Cost $0.139 Response Time (avg) 27.6s
#204	Qwen3.5-9B medium	Qwen	2	3.0	$0.036	0/3	32.3s
Total Tests 3 Wrong Tests 3 Total Cost $0.036 Response Time (avg) 32.3s
#119	Qwen3.5-35B-A3B medium	Qwen	1	8.2	$0.837	2/3	33.1s
Total Tests 3 Wrong Tests 1 Total Cost $0.837 Response Time (avg) 33.1s

Filter models