Puzzle Solving Model Ranking

See which AI models perform best on Puzzle Solving, which ones stay reliable, and where the biggest gaps appear.

Models Shown

Average Puzzle Solving Score

0.7

Best Model

Failure Reasons

With failure reason Wrong answer352 With failure reason Did not follow instructions166 With failure reason API error35 With failure reason Extra formatting16 With failure reason No answer14 With failure reason Timed out11

451/451

Rank	Model	Company	Puzzle Solving Score	Score	Total Cost	Tests Correct	Response Time (avg)
#351	MiniMax M2.7 medium	Minimax	0.6	0.5	$0.326	1/3	24.9s
Total Tests 3 Wrong Tests 2 Total Cost $0.326 Response Time (avg) 24.9s
#364	Mimo V2 Omni medium	Xiaomi	0.6	0.5	$0.683	1/3	2.38s
Total Tests 3 Wrong Tests 2 Total Cost $0.683 Response Time (avg) 2.38s
#187	Kimi K2.7 Code medium	Moonshot AI	0.6	0.7	$1.136	1/3	41.0s
Total Tests 3 Wrong Tests 2 Total Cost $1.136 Response Time (avg) 41.0s
#286	Inkling Small medium	Thinkingmachines	0.6	0.6	$0.113	1/3	5.24s
Total Tests 3 Wrong Tests 2 Total Cost $0.113 Response Time (avg) 5.24s
#189	Step 5 Preview high	Stepfun	0.6	0.7	$4.513	1/3	143.2s
Total Tests 3 Wrong Tests 2 Total Cost $4.513 Response Time (avg) 143.2s
#232	Beam 1.0 501B A23B xhigh	Reflection	0.6	0.6	$0.688	1/3	4.46s
Total Tests 3 Wrong Tests 2 Total Cost $0.688 Response Time (avg) 4.46s
#415	Hunter Alpha default	OpenRouter	0.6	0.3	$0.000	1/3	3.71s
Total Tests 3 Wrong Tests 2 Total Cost $0.000 Response Time (avg) 3.71s
#375	Gemini 3.1 Flash Lite high	Google	0.6	0.5	$2.044	1/3	50.8s
Total Tests 3 Wrong Tests 2 Total Cost $2.044 Response Time (avg) 50.8s
#129	Step 3.7 Flash medium	Stepfun	0.6	0.8	$0.571	1/3	6.19s
Total Tests 3 Wrong Tests 2 Total Cost $0.571 Response Time (avg) 6.19s
#84	GPT-5 Mini medium	OpenAI	0.6	0.8	$0.315	1/3	15.2s
Total Tests 3 Wrong Tests 2 Total Cost $0.315 Response Time (avg) 15.2s
#277	Inkling none	Thinkingmachines	0.6	0.6	$0.292	1/3	931ms
Total Tests 3 Wrong Tests 2 Total Cost $0.292 Response Time (avg) 931ms
#309	GPT-5.4 none	OpenAI	0.6	0.6	$0.690	1/3	1.44s
Total Tests 3 Wrong Tests 2 Total Cost $0.690 Response Time (avg) 1.44s
#367	Mercury 2.5 Preview default	Inception	0.6	0.5	$0.023	1/3	684ms
Total Tests 3 Wrong Tests 2 Total Cost $0.023 Response Time (avg) 684ms
#71	DeepSeek V4.1 Flash max	DeepSeek	0.6	0.9	$1.204	1/3	30.8s
Total Tests 3 Wrong Tests 2 Total Cost $1.204 Response Time (avg) 30.8s
#249	Dots 3 Note Preview high	Dots Studio	0.6	0.6	$0.000	1/3	12.7s
Total Tests 3 Wrong Tests 2 Total Cost $0.000 Response Time (avg) 12.7s

Puzzle Solving Ranking

Filter models

Top Models by Puzzle Solving Score

Puzzle Solving Score vs Total Cost

Top Models by Response Time (avg)