Instructions following Model Ranking

See which AI models perform best on Instructions following, which ones stay reliable, and where the biggest gaps appear. Sort by: Total Cost ↑.

Models Shown

Average Instructions following Score

0.8

Best Model

Ling 3.1 Flash 1.0

Failure Reasons

With failure reason Wrong answer118 With failure reason Did not follow instructions82 With failure reason API error25 With failure reason Extra formatting8 With failure reason Timed out5 With failure reason No answer2

461/461

Rank	Model	Company	Instructions following Score	Score	Total Cost	Tests Correct	Response Time (avg)
#96	Muse Spark 1.1 high	Meta	0.6	0.8	$2.570	1/2	7.81s
Total Tests 2 Wrong Tests 1 Total Cost $2.570 Response Time (avg) 7.81s
#85	Grok 4.6 high	X AI	1.0	0.9	$2.629	2/2	13.8s
Total Tests 2 Wrong Tests 0 Total Cost $2.629 Response Time (avg) 13.8s
#46	Muse Wonder low	Meta	0.7	0.9	$2.637	1/2	2.08s
Total Tests 2 Wrong Tests 1 Total Cost $2.637 Response Time (avg) 2.08s
#109	Grok 4.5 high	X AI	1.0	0.8	$2.687	2/2	6.23s
Total Tests 2 Wrong Tests 0 Total Cost $2.687 Response Time (avg) 6.23s
#23	GPT-6 Astra medium	OpenAI	1.0	0.9	$2.707	2/2	2.86s
Total Tests 2 Wrong Tests 0 Total Cost $2.707 Response Time (avg) 2.86s
#101	Gemini 3.5 Flash high	Google	1.0	0.8	$2.737	2/2	3.35s
Total Tests 2 Wrong Tests 0 Total Cost $2.737 Response Time (avg) 3.35s
#187	Claude Opus 5 none	Anthropic	1.0	0.7	$2.766	2/2	2.81s
Total Tests 2 Wrong Tests 0 Total Cost $2.766 Response Time (avg) 2.81s
#31	Claude Opus 5 medium	Anthropic	1.0	0.9	$2.870	2/2	4.16s
Total Tests 2 Wrong Tests 0 Total Cost $2.870 Response Time (avg) 4.16s
#172	Grok 4.7 medium	X AI	0.8	0.7	$2.938	1/2	6.68s
Total Tests 2 Wrong Tests 1 Total Cost $2.938 Response Time (avg) 6.68s
#131	Qwen3.8 2.4T A95B high	Qwen	1.0	0.8	$2.949	2/2	11.4s
Total Tests 2 Wrong Tests 0 Total Cost $2.949 Response Time (avg) 11.4s
#270	Claude Opus 4.6 medium	Anthropic	1.0	0.6	$2.961	2/2	2.43s
Total Tests 2 Wrong Tests 0 Total Cost $2.961 Response Time (avg) 2.43s
#136	Grok 4.5 medium	X AI	1.0	0.8	$2.996	2/2	6.06s
Total Tests 2 Wrong Tests 0 Total Cost $2.996 Response Time (avg) 6.06s
#221	Grok 4.7 high	X AI	0.8	0.7	$3.037	1/2	14.1s
Total Tests 2 Wrong Tests 1 Total Cost $3.037 Response Time (avg) 14.1s
#171	Claude Fable 5.1 medium	Anthropic	0.7	0.7	$3.197	1/2	5.77s
Total Tests 2 Wrong Tests 1 Total Cost $3.197 Response Time (avg) 5.77s
#223	Ember-1 max	Fireworks	0.6	0.7	$3.264	1/2	33.0s
Total Tests 2 Wrong Tests 1 Total Cost $3.264 Response Time (avg) 33.0s

Instructions following Ranking

Filter models

Top Models by Instructions following Score

Instructions following Score vs Total Cost

Top Models by Response Time (avg)