Puzzle Solving Model Ranking

See which AI models perform best on Puzzle Solving, which ones stay reliable, and where the biggest gaps appear. Sort by: Metric ↑.

Models Shown

Average Puzzle Solving Score

0.7

Best Model

Step 3.5 Flash 0.0

Failure Reasons

With failure reason Wrong answer344 With failure reason Did not follow instructions160 With failure reason API error35 With failure reason Extra formatting16 With failure reason No answer14 With failure reason Timed out11

442/442

Rank	Model	Company	Puzzle Solving Score	Score	Total Cost	Tests Correct	Response Time (avg)
#327	Qwen3.6 35B A3B none	Qwen	0.3	0.5	$0.105	0/3	1.07s
Total Tests 3 Wrong Tests 3 Total Cost $0.105 Response Time (avg) 1.07s
#316	North Mini Code medium	Cohere	0.3	0.5	$0.000	0/3	19.7s
Total Tests 3 Wrong Tests 3 Total Cost $0.000 Response Time (avg) 19.7s
#343	Dots 3 Note Preview default	Dots Studio	0.3	0.5	$0.000	0/3	1.50s
Total Tests 3 Wrong Tests 3 Total Cost $0.000 Response Time (avg) 1.50s
#423	Jev 1.13 default	Typesafe	0.3	0.3	$0.003	1/1	573ms
Total Tests 1 Wrong Tests 0 Total Cost $0.003 Response Time (avg) 573ms
#334	Mistral Small 4 medium	Mistral	0.3	0.5	$0.126	0/3	2.17s
Total Tests 3 Wrong Tests 3 Total Cost $0.126 Response Time (avg) 2.17s
#283	Qwen3.6 Flash none	Qwen	0.4	0.6	$0.139	0/3	1.21s
Total Tests 3 Wrong Tests 3 Total Cost $0.139 Response Time (avg) 1.21s
#344	GPT-4o-mini default	OpenAI	0.4	0.5	$0.024	0/3	1.21s
Total Tests 3 Wrong Tests 3 Total Cost $0.024 Response Time (avg) 1.21s
#360	North Mini Code default	Cohere	0.4	0.5	$0.000	0/3	24.4s
Total Tests 3 Wrong Tests 3 Total Cost $0.000 Response Time (avg) 24.4s
#331	KAT Coder AIR V2.5 high	Kwaipilot	0.4	0.5	$0.077	0/3	2.47s
Total Tests 3 Wrong Tests 3 Total Cost $0.077 Response Time (avg) 2.47s
#379	Trinity Large Preview default	Arcee AI	0.4	0.4	$0.008	0/3	1.97s
Total Tests 3 Wrong Tests 3 Total Cost $0.008 Response Time (avg) 1.97s
#381	Cobuddy medium	Baidu	0.4	0.4	$0.000	0/3	12.8s
Total Tests 3 Wrong Tests 3 Total Cost $0.000 Response Time (avg) 12.8s
#401	Ling 3.0 Tiny medium	Inclusionai	0.4	0.4	$0.000	0/3	34.7s
Total Tests 3 Wrong Tests 3 Total Cost $0.000 Response Time (avg) 34.7s
#369	Nemotron 3.5 Lightning low	NVIDIA	0.4	0.5	$0.175	0/3	6.21s
Total Tests 3 Wrong Tests 3 Total Cost $0.175 Response Time (avg) 6.21s
#337	KAT Coder AIR V2.5 medium	Kwaipilot	0.4	0.5	$0.048	0/3	1.87s
Total Tests 3 Wrong Tests 3 Total Cost $0.048 Response Time (avg) 1.87s
#330	Nemotron 3.5 Lightning high	NVIDIA	0.4	0.5	$0.168	0/3	6.09s
Total Tests 3 Wrong Tests 3 Total Cost $0.168 Response Time (avg) 6.09s

Puzzle Solving Ranking

Filter models

Top Models by Puzzle Solving Score

Puzzle Solving Score vs Total Cost

Top Models by Response Time (avg)