Puzzle Solving Model Ranking

See which AI models perform best on Puzzle Solving, which ones stay reliable, and where the biggest gaps appear. Sort by: Metric ↑.

Models Shown

Average Puzzle Solving Score

0.7

Best Model

Step 3.5 Flash 0.0

Failure Reasons

With failure reason Wrong answer344 With failure reason Did not follow instructions160 With failure reason API error35 With failure reason Extra formatting16 With failure reason No answer14 With failure reason Timed out11

442/442

Rank	Model	Company	Puzzle Solving Score	Score	Total Cost	Tests Correct	Response Time (avg)
#433	Step 3.5 Flash none	Stepfun	0.0	0.2	$0.020	0/0	0ms
Total Tests 0 Wrong Tests 0 Total Cost $0.020 Response Time (avg) 0ms
#435	Gemini 3 Flash Preview high	Google	0.0	0.2	$0.105	0/0	0ms
Total Tests 0 Wrong Tests 0 Total Cost $0.105 Response Time (avg) 0ms
#442	Claude Opus 5.5 none	Anthropic	0.0	0.2	$0.015	0/0	0ms
Total Tests 0 Wrong Tests 0 Total Cost $0.015 Response Time (avg) 0ms
#421	d1-ultra default	Liquid	0.2	0.3	$0.003	0/1	485ms
Total Tests 1 Wrong Tests 1 Total Cost $0.003 Response Time (avg) 485ms
#424	Decider V1.2 default	Perplexity	0.2	0.3	$0.001	0/1	490ms
Total Tests 1 Wrong Tests 1 Total Cost $0.001 Response Time (avg) 490ms
#425	Decider V1.1 27B default	Perplexity	0.2	0.3	$0.002	0/1	422ms
Total Tests 1 Wrong Tests 1 Total Cost $0.002 Response Time (avg) 422ms
#427	GPT-6 Luna Decisions default	OpenAI	0.2	0.2	$0.005	0/1	414ms
Total Tests 1 Wrong Tests 1 Total Cost $0.005 Response Time (avg) 414ms
#429	Jev 1.14 default	Typesafe	0.2	0.2	$0.003	0/1	270ms
Total Tests 1 Wrong Tests 1 Total Cost $0.003 Response Time (avg) 270ms
#431	Clef Omni default	Cloudflare	0.2	0.2	$0.011	0/1	572ms
Total Tests 1 Wrong Tests 1 Total Cost $0.011 Response Time (avg) 572ms
#434	D1 default	Liquid	0.2	0.2	$0.003	0/1	570ms
Total Tests 1 Wrong Tests 1 Total Cost $0.003 Response Time (avg) 570ms
#438	Microsoft-Decision-1 default	Microsoft	0.2	0.1	$0.002	0/1	669ms
Total Tests 1 Wrong Tests 1 Total Cost $0.002 Response Time (avg) 669ms
#440	Tev1 4B Experimental default	Togethercomputer	0.2	1.0	$0.002	0/1	432ms
Total Tests 1 Wrong Tests 1 Total Cost $0.002 Response Time (avg) 432ms
#441	Nimble v3 9B default	Bespoke Labs	0.2	0.8	~$0.001	0/1	79ms
Total Tests 1 Wrong Tests 1 Total Cost ~$0.001 Response Time (avg) 79ms
#428	Kev 4B default	Jaredpalmer	0.2	0.2	$0.002	0/1	646ms
Total Tests 1 Wrong Tests 1 Total Cost $0.002 Response Time (avg) 646ms
#362	Granite 4.2 8B high	IBM Granite	0.3	0.5	$0.111	0/3	202.7s
Total Tests 3 Wrong Tests 3 Total Cost $0.111 Response Time (avg) 202.7s

Puzzle Solving Ranking

Filter models

Top Models by Puzzle Solving Score

Puzzle Solving Score vs Total Cost

Top Models by Response Time (avg)

Puzzle Solving Ranking

Filter models

Top Models by Puzzle Solving Score

Puzzle Solving Score vs Total CostEstimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.0021 h × 0.377 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.000263.

Top Models by Response Time (avg)

Puzzle Solving Score vs Total Cost