Puzzle Solving Model Ranking

See which AI models perform best on Puzzle Solving, which ones stay reliable, and where the biggest gaps appear. Sort by: Tests Correct ↓.

Models Shown

Average Puzzle Solving Score

0.7

Best Model

Failure Reasons

With failure reason Wrong answer344 With failure reason Did not follow instructions160 With failure reason API error35 With failure reason Extra formatting16 With failure reason No answer14 With failure reason Timed out11

442/442

Rank	Model	Company	Puzzle Solving Score	Score	Total Cost	Tests Correct	Response Time (avg)
#436	LFM2-24B-A2B default	Liquid	0.4	0.2	$0.001	0/3	1.78s
Total Tests 3 Wrong Tests 3 Total Cost $0.001 Response Time (avg) 1.78s
#437	Solar Decide Flash default	Upstage	1.0	0.2	$0.003	0/1	1.66s
Total Tests 1 Wrong Tests 1 Total Cost $0.003 Response Time (avg) 1.66s
#438	Microsoft-Decision-1 default	Microsoft	0.2	0.1	$0.002	0/1	669ms
Total Tests 1 Wrong Tests 1 Total Cost $0.002 Response Time (avg) 669ms
#439	Solar Decide default	Upstage	1.0	0.1	$0.009	0/1	3.47s
Total Tests 1 Wrong Tests 1 Total Cost $0.009 Response Time (avg) 3.47s
#440	Tev1 4B Experimental default	Togethercomputer	0.2	1.0	$0.002	0/1	432ms
Total Tests 1 Wrong Tests 1 Total Cost $0.002 Response Time (avg) 432ms
#441	Nimble v3 9B default	Bespoke Labs	0.2	0.8	~$0.001	0/1	79ms
Total Tests 1 Wrong Tests 1 Total Cost ~$0.001 Response Time (avg) 79ms
#442	Claude Opus 5.5 none	Anthropic	0.0	0.2	$0.015	0/0	0ms
Total Tests 0 Wrong Tests 0 Total Cost $0.015 Response Time (avg) 0ms

Puzzle Solving Ranking