Instructions following Model Ranking

See which AI models perform best on Instructions following, which ones stay reliable, and where the biggest gaps appear.

Models Shown

Average Instructions following Score

0.8

Best Model

Gemini 3.6 Flash 1.0

Failure Reasons

With failure reason Wrong answer118 With failure reason Did not follow instructions82 With failure reason API error25 With failure reason Extra formatting8 With failure reason Timed out5 With failure reason No answer2

461/461

Rank	Model	Company	Instructions following Score	Score	Total Cost	Tests Correct	Response Time (avg)
#217	Grok 4.7 xhigh	X AI	1.0	0.7	$3.398	2/2	17.3s
Total Tests 2 Wrong Tests 0 Total Cost $3.398 Response Time (avg) 17.3s
#224	GPT 5.3 Chat default	OpenAI	1.0	0.7	$0.533	2/2	3.51s
Total Tests 2 Wrong Tests 0 Total Cost $0.533 Response Time (avg) 3.51s
#229	GLM 5.2 none	Z.ai	1.0	0.7	$0.250	2/2	3.84s
Total Tests 2 Wrong Tests 0 Total Cost $0.250 Response Time (avg) 3.84s
#233	Step 3.7 Flash high	Stepfun	1.0	0.7	$1.478	2/2	1.52s
Total Tests 2 Wrong Tests 0 Total Cost $1.478 Response Time (avg) 1.52s
#234	Beam 1.0 501B A23B medium	Reflection	1.0	0.7	$0.499	2/2	1.24s
Total Tests 2 Wrong Tests 0 Total Cost $0.499 Response Time (avg) 1.24s
#239	Mercury 2.5 Preview high	Inception	1.0	0.6	$0.040	2/2	1.05s
Total Tests 2 Wrong Tests 0 Total Cost $0.040 Response Time (avg) 1.05s
#241	Beam 1.0 501B A23B xhigh	Reflection	1.0	0.6	$0.688	2/2	1.15s
Total Tests 2 Wrong Tests 0 Total Cost $0.688 Response Time (avg) 1.15s
#243	GLM 5.1 none	Z.ai	1.0	0.6	$0.451	2/2	1.98s
Total Tests 2 Wrong Tests 0 Total Cost $0.451 Response Time (avg) 1.98s
#246	Laguna XS 2.1 medium	Poolside	1.0	0.6	$0.083	2/2	2.57s
Total Tests 2 Wrong Tests 0 Total Cost $0.083 Response Time (avg) 2.57s
#269	Ling 3.1 Flash low	Inclusionai	1.0	0.6	$0.000	2/2	3.82s
Total Tests 2 Wrong Tests 0 Total Cost $0.000 Response Time (avg) 3.82s
#275	Grok 4.20 medium	X AI	1.0	0.6	$1.246	2/2	4.26s
Total Tests 2 Wrong Tests 0 Total Cost $1.246 Response Time (avg) 4.26s
#283	Beam 1.0 501B A23B high	Reflection	1.0	0.6	$0.674	2/2	1.27s
Total Tests 2 Wrong Tests 0 Total Cost $0.674 Response Time (avg) 1.27s
#285	Apodex 1.1 Mini low	Apodex	1.0	0.6	$0.000	2/2	7.71s
Total Tests 2 Wrong Tests 0 Total Cost $0.000 Response Time (avg) 7.71s
#294	MiMo-V2.6-Pro none	Xiaomi	1.0	0.6	$0.193	2/2	803ms
Total Tests 2 Wrong Tests 0 Total Cost $0.193 Response Time (avg) 803ms
#309	Ring 2.6 1t medium	Inclusionai	1.0	0.6	$0.102	2/2	11.8s
Total Tests 2 Wrong Tests 0 Total Cost $0.102 Response Time (avg) 11.8s

Instructions following Ranking

Filter models

Top Models by Instructions following Score

Instructions following Score vs Total Cost

Top Models by Response Time (avg)