Puzzle Solving Model Ranking

See which AI models perform best on Puzzle Solving, which ones stay reliable, and where the biggest gaps appear. Sort by: Metric ↑.

Models Shown

Average Puzzle Solving Score

0.7

Best Model

Step 3.5 Flash 0.0

Failure Reasons

With failure reason Wrong answer344 With failure reason Did not follow instructions160 With failure reason API error35 With failure reason Extra formatting16 With failure reason No answer14 With failure reason Timed out11

442/442

Rank	Model	Company	Puzzle Solving Score	Score	Total Cost	Tests Correct	Response Time (avg)
#430	Classify-1 default	Scaledown	1.0	0.2	$0.008	0/1	1.37s
Total Tests 1 Wrong Tests 1 Total Cost $0.008 Response Time (avg) 1.37s
#432	Decider Flash V1.2 default	Perplexity	1.0	0.2	$0.001	0/1	424ms
Total Tests 1 Wrong Tests 1 Total Cost $0.001 Response Time (avg) 424ms
#437	Solar Decide Flash default	Upstage	1.0	0.2	$0.003	0/1	1.66s
Total Tests 1 Wrong Tests 1 Total Cost $0.003 Response Time (avg) 1.66s
#439	Solar Decide default	Upstage	1.0	0.1	$0.009	0/1	3.47s
Total Tests 1 Wrong Tests 1 Total Cost $0.009 Response Time (avg) 3.47s
#192	Gemma 4 31B medium	Google	1.0	0.7	$0.144	3/3	26.9s
Total Tests 3 Wrong Tests 0 Total Cost $0.144 Response Time (avg) 26.9s
#59	Qwen3.8 MAX low	Qwen	1.0	0.9	$1.089	3/3	4.11s
Total Tests 3 Wrong Tests 0 Total Cost $1.089 Response Time (avg) 4.11s
#68	Seed 2.1 Turbo medium	Bytedance Seed	1.0	0.9	$2.042	3/3	21.0s
Total Tests 3 Wrong Tests 0 Total Cost $2.042 Response Time (avg) 21.0s
#103	Seed-2.0-Code low	Bytedance Seed	1.0	0.8	$0.881	3/3	12.5s
Total Tests 3 Wrong Tests 0 Total Cost $0.881 Response Time (avg) 12.5s
#1	Gemini 3.6 Flash high	Google	1.0	1.0	$0.900	3/3	3.36s
Total Tests 3 Wrong Tests 0 Total Cost $0.900 Response Time (avg) 3.36s
#2	Gemini 3.8 Flash high	Google	1.0	1.0	$1.927	3/3	3.44s
Total Tests 3 Wrong Tests 0 Total Cost $1.927 Response Time (avg) 3.44s
#3	GPT-6 Sol high	OpenAI	1.0	1.0	$0.921	3/3	16.9s
Total Tests 3 Wrong Tests 0 Total Cost $0.921 Response Time (avg) 16.9s
#4	GPT-6.1 Sol max	OpenAI	1.0	1.0	$1.006	3/3	7.67s
Total Tests 3 Wrong Tests 0 Total Cost $1.006 Response Time (avg) 7.67s
#5	GPT-6 Astra max	OpenAI	1.0	1.0	$5.044	3/3	7.32s
Total Tests 3 Wrong Tests 0 Total Cost $5.044 Response Time (avg) 7.32s
#6	GPT-6.1 Sol xhigh	OpenAI	1.0	1.0	$1.377	3/3	4.87s
Total Tests 3 Wrong Tests 0 Total Cost $1.377 Response Time (avg) 4.87s
#7	GPT-6 Astra high	OpenAI	1.0	1.0	$4.458	3/3	3.60s
Total Tests 3 Wrong Tests 0 Total Cost $4.458 Response Time (avg) 3.60s

Puzzle Solving Ranking

Filter models

Top Models by Puzzle Solving Score

Puzzle Solving Score vs Total Cost

Top Models by Response Time (avg)