Puzzle Solving Model Ranking

See which AI models perform best on Puzzle Solving, which ones stay reliable, and where the biggest gaps appear. Sort by: Response Time (avg) ↓.

Models Shown

Average Puzzle Solving Score

0.7

Best Model

Xing4.0 29b A4b 0.3

Failure Reasons

With failure reason Wrong answer344 With failure reason Did not follow instructions160 With failure reason API error35 With failure reason Extra formatting16 With failure reason No answer14 With failure reason Timed out11

442/442

Rank	Model	Company	Puzzle Solving Score	Score	Total Cost	Tests Correct	Response Time (avg)
#415	Grok 4.1 Fast default	X AI	0.3	0.3	$0.008	0/3	1.10s
Total Tests 3 Wrong Tests 3 Total Cost $0.008 Response Time (avg) 1.10s
#327	Qwen3.6 35B A3B none	Qwen	0.3	0.5	$0.105	0/3	1.07s
Total Tests 3 Wrong Tests 3 Total Cost $0.105 Response Time (avg) 1.07s
#285	Nemotron 3 Ultra none	NVIDIA	0.6	0.6	$0.164	1/3	1.06s
Total Tests 3 Wrong Tests 2 Total Cost $0.164 Response Time (avg) 1.06s
#233	Gemini 3 Flash Preview none	Google	0.8	0.6	$0.155	2/3	1.05s
Total Tests 3 Wrong Tests 1 Total Cost $0.155 Response Time (avg) 1.05s
#326	Laguna XS 2.1 none	Poolside	0.3	0.5	$0.020	0/3	1.01s
Total Tests 3 Wrong Tests 3 Total Cost $0.020 Response Time (avg) 1.01s
#232	Qwen3.5-122B-A10B none	Qwen	0.4	0.6	$0.308	0/3	1.00s
Total Tests 3 Wrong Tests 3 Total Cost $0.308 Response Time (avg) 1.00s
#218	Mercury 2 medium	Inception	0.5	0.7	$0.121	1/3	949ms
Total Tests 3 Wrong Tests 2 Total Cost $0.121 Response Time (avg) 949ms
#269	Inkling none	Thinkingmachines	0.6	0.6	$0.292	1/3	931ms
Total Tests 3 Wrong Tests 2 Total Cost $0.292 Response Time (avg) 931ms
#263	Gemini 3.1 Flash Lite Preview none	Google	1.0	0.6	$0.090	3/3	900ms
Total Tests 3 Wrong Tests 0 Total Cost $0.090 Response Time (avg) 900ms
#403	Laguna M.1 default	Poolside	0.3	0.4	$0.009	0/3	891ms
Total Tests 3 Wrong Tests 3 Total Cost $0.009 Response Time (avg) 891ms
#405	Elephant Alpha medium	Openrouter	0.5	0.4	$0.000	1/3	868ms
Total Tests 3 Wrong Tests 2 Total Cost $0.000 Response Time (avg) 868ms
#426	Drex v1.5 default	Nace AI	1.0	0.2	$0.002	0/1	850ms
Total Tests 1 Wrong Tests 1 Total Cost $0.002 Response Time (avg) 850ms
#294	GPT-5.4 Mini none	OpenAI	0.5	0.6	$0.170	1/3	836ms
Total Tests 3 Wrong Tests 2 Total Cost $0.170 Response Time (avg) 836ms
#361	Laguna S 2.1 none	Poolside	0.3	0.5	$0.044	0/3	828ms
Total Tests 3 Wrong Tests 3 Total Cost $0.044 Response Time (avg) 828ms
#404	Elephant Alpha default	Openrouter	0.4	0.4	$0.000	0/3	807ms
Total Tests 3 Wrong Tests 3 Total Cost $0.000 Response Time (avg) 807ms

Puzzle Solving Ranking

Filter models

Top Models by Puzzle Solving Score

Puzzle Solving Score vs Total Cost

Top Models by Response Time (avg)