Puzzle Solving Model Ranking

See which AI models perform best on Puzzle Solving, which ones stay reliable, and where the biggest gaps appear.

Models Shown

Average Puzzle Solving Score

0.7

Best Model

Failure Reasons

With failure reason Wrong answer344 With failure reason Did not follow instructions160 With failure reason API error35 With failure reason Extra formatting16 With failure reason No answer14 With failure reason Timed out11

442/442

Rank	Model	Company	Puzzle Solving Score	Score	Total Cost	Tests Correct	Response Time (avg)
#244	LongCat 2.0 none	Meituan	0.4	0.6	$0.104	0/3	2.74s
Total Tests 3 Wrong Tests 3 Total Cost $0.104 Response Time (avg) 2.74s
#232	Qwen3.5-122B-A10B none	Qwen	0.4	0.6	$0.308	0/3	1.00s
Total Tests 3 Wrong Tests 3 Total Cost $0.308 Response Time (avg) 1.00s
#436	LFM2-24B-A2B default	Liquid	0.4	0.2	$0.001	0/3	1.78s
Total Tests 3 Wrong Tests 3 Total Cost $0.001 Response Time (avg) 1.78s
#304	Qwen3.5-35B-A3B none	Qwen	0.4	0.6	$0.120	0/3	1.35s
Total Tests 3 Wrong Tests 3 Total Cost $0.120 Response Time (avg) 1.35s
#318	MiMo-V2.6-Flash none	Xiaomi	0.4	0.5	$0.060	0/3	739ms
Total Tests 3 Wrong Tests 3 Total Cost $0.060 Response Time (avg) 739ms
#388	Mercury 2.5 none	Inception	0.4	0.4	$0.026	0/3	515ms
Total Tests 3 Wrong Tests 3 Total Cost $0.026 Response Time (avg) 515ms
#286	Qwen3.7 Flash none	Qwen	0.4	0.6	$0.028	0/3	1.39s
Total Tests 3 Wrong Tests 3 Total Cost $0.028 Response Time (avg) 1.39s
#330	Nemotron 3.5 Lightning high	NVIDIA	0.4	0.5	$0.168	0/3	6.09s
Total Tests 3 Wrong Tests 3 Total Cost $0.168 Response Time (avg) 6.09s
#337	KAT Coder AIR V2.5 medium	Kwaipilot	0.4	0.5	$0.048	0/3	1.87s
Total Tests 3 Wrong Tests 3 Total Cost $0.048 Response Time (avg) 1.87s
#369	Nemotron 3.5 Lightning low	NVIDIA	0.4	0.5	$0.175	0/3	6.21s
Total Tests 3 Wrong Tests 3 Total Cost $0.175 Response Time (avg) 6.21s
#381	Cobuddy medium	Baidu	0.4	0.4	$0.000	0/3	12.8s
Total Tests 3 Wrong Tests 3 Total Cost $0.000 Response Time (avg) 12.8s
#401	Ling 3.0 Tiny medium	Inclusionai	0.4	0.4	$0.000	0/3	34.7s
Total Tests 3 Wrong Tests 3 Total Cost $0.000 Response Time (avg) 34.7s
#379	Trinity Large Preview default	Arcee AI	0.4	0.4	$0.008	0/3	1.97s
Total Tests 3 Wrong Tests 3 Total Cost $0.008 Response Time (avg) 1.97s
#331	KAT Coder AIR V2.5 high	Kwaipilot	0.4	0.5	$0.077	0/3	2.47s
Total Tests 3 Wrong Tests 3 Total Cost $0.077 Response Time (avg) 2.47s
#283	Qwen3.6 Flash none	Qwen	0.4	0.6	$0.139	0/3	1.21s
Total Tests 3 Wrong Tests 3 Total Cost $0.139 Response Time (avg) 1.21s

Puzzle Solving Ranking

Filter models

Top Models by Puzzle Solving Score

Puzzle Solving Score vs Total Cost

Top Models by Response Time (avg)