Puzzle Solving Model Ranking

AI BENCHY Category

See which AI models perform best on Puzzle Solving, which ones stay reliable, and where the biggest gaps appear. Sort by: Score ↓.

Models Shown

Average Puzzle Solving Score

6.7

Best Model

Failure Reasons

With failure reason Wrong answer147 With failure reason Did not follow instructions78 With failure reason API error13 With failure reason Extra formatting5 With failure reason Timed out5 With failure reason No answer1

Rank	Model	Company	Puzzle Solving Score	Score	Tests Correct	Response Time (avg)
#1	Gemini 3 Flash Preview medium	Google	10.0	9.8	3/3	4.05s
#2	Gemini 3.5 Flash high	Google	10.0	9.6	3/3	3.23s
#3	Gemini 3.5 Flash low	Google	10.0	9.4	3/3	2.35s
#4	Gemini 3.1 Pro Preview medium	Google	10.0	9.4	3/3	6.90s
#5	Qwen3.7 Max medium	Qwen	10.0	9.1	3/3	8.84s
#6	GPT-5.5 low	OpenAI	10.0	9.0	3/3	4.74s
#7	Gemini 3.5 Flash medium	Google	7.7	9.0	2/3	2.38s
#8	Claude Opus 4.7 none	Anthropic	10.0	8.9	3/3	2.46s
#9	GPT-5.5 medium	OpenAI	10.0	8.8	3/3	6.76s
#10	Claude Opus 4.8 medium	Anthropic	10.0	8.7	3/3	3.95s
#11	Claude Opus 4.7 medium	Anthropic	10.0	8.7	3/3	2.43s
#12	Gemini 3.1 Flash Lite Preview high	Google	7.7	8.6	2/3	46.7s
#13	Grok 4.20 Beta medium	X AI	10.0	8.5	3/3	3.52s
#14	Qwen3.6 Max Preview medium	Qwen	10.0	8.5	3/3	24.3s
#15	GPT-5.3-Codex medium	OpenAI	9.0	8.4	2/3	5.05s

Puzzle Solving Ranking