Puzzle Solving Model Ranking

See which AI models perform best on Puzzle Solving, which ones stay reliable, and where the biggest gaps appear. Sort by: Total Cost ↑.

Models Shown

Average Puzzle Solving Score

0.7

Best Model

Ling 3.1 Flash 0.8

Failure Reasons

With failure reason Wrong answer344 With failure reason Did not follow instructions160 With failure reason API error35 With failure reason Extra formatting16 With failure reason No answer14 With failure reason Timed out11

442/442

Rank	Model	Company	Puzzle Solving Score	Score	Total Cost	Tests Correct	Response Time (avg)
#438	Microsoft-Decision-1 default	Microsoft	0.2	0.1	$0.002	0/1	669ms
Total Tests 1 Wrong Tests 1 Total Cost $0.002 Response Time (avg) 669ms
#428	Kev 4B default	Jaredpalmer	0.2	0.2	$0.002	0/1	646ms
Total Tests 1 Wrong Tests 1 Total Cost $0.002 Response Time (avg) 646ms
#434	D1 default	Liquid	0.2	0.2	$0.003	0/1	570ms
Total Tests 1 Wrong Tests 1 Total Cost $0.003 Response Time (avg) 570ms
#421	d1-ultra default	Liquid	0.2	0.3	$0.003	0/1	485ms
Total Tests 1 Wrong Tests 1 Total Cost $0.003 Response Time (avg) 485ms
#437	Solar Decide Flash default	Upstage	1.0	0.2	$0.003	0/1	1.66s
Total Tests 1 Wrong Tests 1 Total Cost $0.003 Response Time (avg) 1.66s
#423	Jev 1.13 default	Typesafe	0.3	0.3	$0.003	1/1	573ms
Total Tests 1 Wrong Tests 0 Total Cost $0.003 Response Time (avg) 573ms
#429	Jev 1.14 default	Typesafe	0.2	0.2	$0.003	0/1	270ms
Total Tests 1 Wrong Tests 1 Total Cost $0.003 Response Time (avg) 270ms
#329	Ling 3.0 Flash none	Inclusionai	0.5	0.5	$0.004	1/3	1.49s
Total Tests 3 Wrong Tests 2 Total Cost $0.004 Response Time (avg) 1.49s
#416	Laguna Xs.2 default	Poolside	0.5	0.3	$0.004	1/3	650ms
Total Tests 3 Wrong Tests 2 Total Cost $0.004 Response Time (avg) 650ms
#427	GPT-6 Luna Decisions default	OpenAI	0.2	0.2	$0.005	0/1	414ms
Total Tests 1 Wrong Tests 1 Total Cost $0.005 Response Time (avg) 414ms
#396	Granite 4.1 8b default	IBM Granite	0.3	0.4	$0.007	0/3	608ms
Total Tests 3 Wrong Tests 3 Total Cost $0.007 Response Time (avg) 608ms
#410	Hy3 preview none	Tencent	0.3	0.3	$0.007	0/3	4.56s
Total Tests 3 Wrong Tests 3 Total Cost $0.007 Response Time (avg) 4.56s
#415	Grok 4.1 Fast default	X AI	0.3	0.3	$0.008	0/3	1.10s
Total Tests 3 Wrong Tests 3 Total Cost $0.008 Response Time (avg) 1.10s
#379	Trinity Large Preview default	Arcee AI	0.4	0.4	$0.008	0/3	1.97s
Total Tests 3 Wrong Tests 3 Total Cost $0.008 Response Time (avg) 1.97s
#430	Classify-1 default	Scaledown	1.0	0.2	$0.008	0/1	1.37s
Total Tests 1 Wrong Tests 1 Total Cost $0.008 Response Time (avg) 1.37s

Puzzle Solving Ranking

Filter models

Top Models by Puzzle Solving Score

Puzzle Solving Score vs Total Cost

Top Models by Response Time (avg)