Puzzle Solving Model Ranking

See which AI models perform best on Puzzle Solving, which ones stay reliable, and where the biggest gaps appear. Sort by: Total Cost ↑.

Models Shown

Average Puzzle Solving Score

0.7

Best Model

Ling 3.1 Flash 0.8

Failure Reasons

With failure reason Wrong answer344 With failure reason Did not follow instructions160 With failure reason API error35 With failure reason Extra formatting16 With failure reason No answer14 With failure reason Timed out11

442/442

Rank	Model	Company	Puzzle Solving Score	Score	Total Cost	Tests Correct	Response Time (avg)
#433	Step 3.5 Flash none	Stepfun	0.0	0.2	$0.020	0/0	0ms
Total Tests 0 Wrong Tests 0 Total Cost $0.020 Response Time (avg) 0ms
#290	Ling 3.0 Flash high	Inclusionai	1.0	0.6	$0.021	3/3	4.33s
Total Tests 3 Wrong Tests 0 Total Cost $0.021 Response Time (avg) 4.33s
#376	Mimo V2 Omni default	Xiaomi	1.0	0.4	$0.021	3/3	1.16s
Total Tests 3 Wrong Tests 0 Total Cost $0.021 Response Time (avg) 1.16s
#301	Solar Pro 4 none	Upstage	0.5	0.6	$0.022	1/3	2.33s
Total Tests 3 Wrong Tests 2 Total Cost $0.022 Response Time (avg) 2.33s
#358	Mercury 2.5 Preview default	Inception	0.6	0.5	$0.023	1/3	684ms
Total Tests 3 Wrong Tests 2 Total Cost $0.023 Response Time (avg) 684ms
#344	GPT-4o-mini default	OpenAI	0.4	0.5	$0.024	0/3	1.21s
Total Tests 3 Wrong Tests 3 Total Cost $0.024 Response Time (avg) 1.21s
#411	MiMo-V2-Flash default	Xiaomi	0.5	0.3	$0.025	1/3	1.86s
Total Tests 3 Wrong Tests 2 Total Cost $0.025 Response Time (avg) 1.86s
#310	GPT-6 Luna none	OpenAI	0.5	0.5	$0.026	1/3	26.0s
Total Tests 3 Wrong Tests 2 Total Cost $0.026 Response Time (avg) 26.0s
#375	Ring 2.6 1t default	Inclusionai	0.8	0.4	$0.026	2/3	31.5s
Total Tests 3 Wrong Tests 1 Total Cost $0.026 Response Time (avg) 31.5s
#388	Mercury 2.5 none	Inception	0.4	0.4	$0.026	0/3	515ms
Total Tests 3 Wrong Tests 3 Total Cost $0.026 Response Time (avg) 515ms
#357	GLM 4.7 Flash none	Z.ai	0.6	0.5	$0.027	1/3	1.20s
Total Tests 3 Wrong Tests 2 Total Cost $0.027 Response Time (avg) 1.20s
#286	Qwen3.7 Flash none	Qwen	0.4	0.6	$0.028	0/3	1.39s
Total Tests 3 Wrong Tests 3 Total Cost $0.028 Response Time (avg) 1.39s
#272	Granite 4.2 8B medium	IBM Granite	0.3	0.6	$0.029	0/3	76.0s
Total Tests 3 Wrong Tests 3 Total Cost $0.029 Response Time (avg) 76.0s
#281	gpt-oss-120b medium	OpenAI	0.5	0.6	$0.030	1/3	21.7s
Total Tests 3 Wrong Tests 2 Total Cost $0.030 Response Time (avg) 21.7s
#311	Gemma 4 26B A4B none	Google	0.6	0.5	$0.031	1/3	744ms
Total Tests 3 Wrong Tests 2 Total Cost $0.031 Response Time (avg) 744ms

Puzzle Solving Ranking

Filter models

Top Models by Puzzle Solving Score

Puzzle Solving Score vs Total Cost

Top Models by Response Time (avg)