Puzzle Solving Model Ranking

See which AI models perform best on Puzzle Solving, which ones stay reliable, and where the biggest gaps appear. Sort by: Response Time (avg) ↓.

Models Shown

Average Puzzle Solving Score

0.7

Best Model

Xing4.0 29b A4b 0.3

Failure Reasons

With failure reason Wrong answer344 With failure reason Did not follow instructions160 With failure reason API error35 With failure reason Extra formatting16 With failure reason No answer14 With failure reason Timed out11

442/442

Rank	Model	Company	Puzzle Solving Score	Score	Total Cost	Tests Correct	Response Time (avg)
#378	KAT Coder AIR V2.5 default	Kwaipilot	0.3	0.4	$0.070	0/3	1.84s
Total Tests 3 Wrong Tests 3 Total Cost $0.070 Response Time (avg) 1.84s
#173	Step 3.7 Flash low	Stepfun	0.6	0.7	$0.449	1/3	1.84s
Total Tests 3 Wrong Tests 2 Total Cost $0.449 Response Time (avg) 1.84s
#164	Gemini 3.5 Flash Lite medium	Google	0.8	0.7	$0.440	2/3	1.82s
Total Tests 3 Wrong Tests 1 Total Cost $0.440 Response Time (avg) 1.82s
#436	LFM2-24B-A2B default	Liquid	0.4	0.2	$0.001	0/3	1.78s
Total Tests 3 Wrong Tests 3 Total Cost $0.001 Response Time (avg) 1.78s
#112	Qwen3.8 Flash Next low	Qwen	0.9	0.8	~$0.045	2/3	1.72s
Total Tests 3 Wrong Tests 1 Total Cost ~$0.045 Response Time (avg) 1.72s
#128	Qwen3.7 Plus none	Qwen	0.8	0.8	$0.178	2/3	1.71s
Total Tests 3 Wrong Tests 1 Total Cost $0.178 Response Time (avg) 1.71s
#248	Gemini 3.1 Flash Lite Preview low	Google	1.0	0.6	$0.736	3/3	1.69s
Total Tests 3 Wrong Tests 0 Total Cost $0.736 Response Time (avg) 1.69s
#277	MiMo-V2.6-Pro none	Xiaomi	0.8	0.6	$0.193	2/3	1.67s
Total Tests 3 Wrong Tests 1 Total Cost $0.193 Response Time (avg) 1.67s
#437	Solar Decide Flash default	Upstage	1.0	0.2	$0.003	0/1	1.66s
Total Tests 1 Wrong Tests 1 Total Cost $0.003 Response Time (avg) 1.66s
#349	Laguna S 2.1 high	Poolside	0.3	0.5	$0.145	0/3	1.62s
Total Tests 3 Wrong Tests 3 Total Cost $0.145 Response Time (avg) 1.62s
#371	Mimo V2 PRO default	Xiaomi	0.6	0.5	$0.045	1/3	1.61s
Total Tests 3 Wrong Tests 2 Total Cost $0.045 Response Time (avg) 1.61s
#345	KAT Coder AIR V2.5 low	Kwaipilot	0.3	0.5	$0.046	0/3	1.57s
Total Tests 3 Wrong Tests 3 Total Cost $0.046 Response Time (avg) 1.57s
#328	Inkling Small low	Thinkingmachines	0.5	0.5	$0.055	1/3	1.56s
Total Tests 3 Wrong Tests 2 Total Cost $0.055 Response Time (avg) 1.56s
#343	Dots 3 Note Preview default	Dots Studio	0.3	0.5	$0.000	0/3	1.50s
Total Tests 3 Wrong Tests 3 Total Cost $0.000 Response Time (avg) 1.50s
#211	GPT-5.6 Sol none	OpenAI	0.8	0.7	$0.795	2/3	1.49s
Total Tests 3 Wrong Tests 1 Total Cost $0.795 Response Time (avg) 1.49s

Puzzle Solving Ranking

Filter models

Top Models by Puzzle Solving Score

Puzzle Solving Score vs Total Cost

Top Models by Response Time (avg)

Puzzle Solving Ranking

Filter models

Top Models by Puzzle Solving Score

Puzzle Solving Score vs Total CostEstimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.4535 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.044834.

Top Models by Response Time (avg)

Puzzle Solving Score vs Total Cost