Instructions following Model Ranking

See which AI models perform best on Instructions following, which ones stay reliable, and where the biggest gaps appear.

Models Shown

Average Instructions following Score

8.6

Best Model

Gemini 3 Flash Preview 10.0

Failure Reasons

With failure reason Wrong answer61 With failure reason Did not follow instructions19 With failure reason Extra formatting3 With failure reason No answer2 With failure reason API error1 With failure reason Timed out1

216/216

Rank	Model	Company	Instructions following Score	Score	Total Cost	Tests Correct	Response Time (avg)
#23	Grok 4.5 low	X AI	9.8	8.4	$0.935	2/2	2.80s
Total Tests 2 Wrong Tests 0 Total Cost $0.935 Response Time (avg) 2.80s
#25	Grok 4.5 medium	X AI	9.8	8.3	$1.928	2/2	6.06s
Total Tests 2 Wrong Tests 0 Total Cost $1.928 Response Time (avg) 6.06s
#28	Gemini 2.5 Flash medium	Google	9.8	8.2	$0.643	2/2	2.62s
Total Tests 2 Wrong Tests 0 Total Cost $0.643 Response Time (avg) 2.62s
#33	Step 3.7 Flash medium	Stepfun	9.8	8.0	$0.515	2/2	1.83s
Total Tests 2 Wrong Tests 0 Total Cost $0.515 Response Time (avg) 1.83s
#34	GPT-5.2 Chat none	OpenAI	9.8	8.0	$0.604	2/2	5.51s
Total Tests 2 Wrong Tests 0 Total Cost $0.604 Response Time (avg) 5.51s
#36	Inkling medium	Thinkingmachines	9.8	8.0	$0.391	2/2	6.17s
Total Tests 2 Wrong Tests 0 Total Cost $0.391 Response Time (avg) 6.17s
#55	Nemotron 3 Ultra medium	NVIDIA	9.8	7.5	$0.774	2/2	6.35s
Total Tests 2 Wrong Tests 0 Total Cost $0.774 Response Time (avg) 6.35s
#58	GPT-5.3 Chat none	OpenAI	9.8	7.5	$0.571	2/2	3.51s
Total Tests 2 Wrong Tests 0 Total Cost $0.571 Response Time (avg) 3.51s
#60	GPT-5.4 Mini medium	OpenAI	9.8	7.5	$0.756	2/2	2.13s
Total Tests 2 Wrong Tests 0 Total Cost $0.756 Response Time (avg) 2.13s
#71	Step 3.7 Flash low	Stepfun	9.8	7.3	$0.454	2/2	1.58s
Total Tests 2 Wrong Tests 0 Total Cost $0.454 Response Time (avg) 1.58s
#79	Grok 4.20 medium	X AI	9.8	7.1	$0.777	2/2	4.26s
Total Tests 2 Wrong Tests 0 Total Cost $0.777 Response Time (avg) 4.26s
#90	Step 3.7 Flash high	Stepfun	9.8	6.9	$1.207	2/2	1.52s
Total Tests 2 Wrong Tests 0 Total Cost $1.207 Response Time (avg) 1.52s
#95	Gemini 3.5 Flash-Lite low	Google	9.8	6.7	$0.145	2/2	869ms
Total Tests 2 Wrong Tests 0 Total Cost $0.145 Response Time (avg) 869ms
#101	GLM 5.2 none	Z.ai	9.8	6.6	$0.128	2/2	3.84s
Total Tests 2 Wrong Tests 0 Total Cost $0.128 Response Time (avg) 3.84s
#103	Qwen3.6 Max Preview none	Qwen	9.8	6.6	$0.231	2/2	1.40s
Total Tests 2 Wrong Tests 0 Total Cost $0.231 Response Time (avg) 1.40s

Instructions following Ranking

Filter models

Top Models by Instructions following Score

Instructions following Score vs Total Cost

Top Models by Response Time (avg)