Puzzle Solving x Wrong answer Ranking

See which AI models are most likely to hit Wrong answer on Puzzle Solving, so you can spot weak points faster. Sort by: Tests Correct ↑.

Models Shown

Total Failures

352

Most Affected Model

Failure Reasons

Wrong answer352 Did not follow instructions166 API error35 Extra formatting16 No answer14 Timed out11

Categories

Domain specific893 Anti-AI Tricks519 Coding484 Puzzle Solving352 Trivia315 General Intelligence134 Agentic128 Combined128 Instructions following117 Data parsing and extraction93

246/246

Rank	Model	Company	Wrong answer Count	Category Score	Total Cost	Tests Correct	Response Time (avg)
#317	Ling 3.1 Flash none	Inclusionai	1	0.8	$0.000	2/3	3.31s
Total Tests 3 Wrong Tests 1 Total Cost $0.000 Response Time (avg) 3.31s
#318	Gemini 2.5 Flash none	Google	1	0.8	$0.017	2/3	604ms
Total Tests 3 Wrong Tests 1 Total Cost $0.017 Response Time (avg) 604ms
#321	GLM 5V Turbo medium	Z.ai	1	0.8	$0.457	2/3	10.2s
Total Tests 3 Wrong Tests 1 Total Cost $0.457 Response Time (avg) 10.2s
#342	MiMo-V2-Flash medium	Xiaomi	1	0.8	$0.043	2/3	3.87s
Total Tests 3 Wrong Tests 1 Total Cost $0.043 Response Time (avg) 3.87s
#350	Mercury 2.5 Preview low	Inception	1	0.8	$0.015	2/3	710ms
Total Tests 3 Wrong Tests 1 Total Cost $0.015 Response Time (avg) 710ms
#411	Grok 4.20 Beta default	X AI	1	0.8	$0.087	2/3	586ms
Total Tests 3 Wrong Tests 1 Total Cost $0.087 Response Time (avg) 586ms

Filter models