Puzzle Solving x Wrong answer Ranking

See which AI models are most likely to hit Wrong answer on Puzzle Solving, so you can spot weak points faster. Sort by: Tests Correct ↓.

Models Shown

Total Failures

204

Most Affected Model

Failure Reasons

Wrong answer204 Did not follow instructions90 API error12 Extra formatting8 Timed out5 No answer3

Categories

Domain specific421 Anti-AI Tricks293 Coding259 Puzzle Solving204 Trivia172 Combined69 General Intelligence62 Instructions following61 Data parsing and extraction41 Tool Calling3

145/145

Rank	Model	Company	Wrong answer Count	Category Score	Total Cost	Tests Correct	Response Time (avg)
#198	Laguna M.1 none	Poolside	2	3.0	$0.009	0/3	891ms
Total Tests 3 Wrong Tests 3 Total Cost $0.009 Response Time (avg) 891ms
#199	Elephant Alpha none	Openrouter	2	4.2	$0.000	0/3	807ms
Total Tests 3 Wrong Tests 3 Total Cost $0.000 Response Time (avg) 807ms
#200	GLM 4.7 Flash medium	Z.ai	2	2.9	$0.166	0/3	12.9s
Total Tests 3 Wrong Tests 3 Total Cost $0.166 Response Time (avg) 12.9s
#205	Hy3 preview none	Tencent	2	3.1	$0.003	0/3	4.56s
Total Tests 3 Wrong Tests 3 Total Cost $0.003 Response Time (avg) 4.56s
#207	Granite 4.1 8B none	IBM Granite	2	3.2	$0.007	0/3	608ms
Total Tests 3 Wrong Tests 3 Total Cost $0.007 Response Time (avg) 608ms
#209	Grok 4.1 Fast none	X AI	3	3.0	$0.008	0/3	1.10s
Total Tests 3 Wrong Tests 3 Total Cost $0.008 Response Time (avg) 1.10s
#210	Qwen3.5-9B medium	Qwen	1	3.0	$0.036	0/3	32.3s
Total Tests 3 Wrong Tests 3 Total Cost $0.036 Response Time (avg) 32.3s
#213	Nemotron 3 Nano Omni 30b A3b Reasoning medium	NVIDIA	2	2.9	$0.000	0/3	1.40s
Total Tests 3 Wrong Tests 3 Total Cost $0.000 Response Time (avg) 1.40s
#214	Nemotron 3 Nano Omni 30b A3b Reasoning none	NVIDIA	1	3.0	$0.000	0/3	532ms
Total Tests 3 Wrong Tests 3 Total Cost $0.000 Response Time (avg) 532ms
#216	LFM2-24B-A2B none	Liquid	2	3.8	$0.001	0/3	1.78s
Total Tests 3 Wrong Tests 3 Total Cost $0.001 Response Time (avg) 1.78s

Filter models