Instructions following Model Ranking

See which AI models perform best on Instructions following, which ones stay reliable, and where the biggest gaps appear. Sort by: Total Cost ↓.

Models Shown

Average Instructions following Score

0.8

Best Model

Claude Sonnet 5.5 0.9

Failure Reasons

With failure reason Wrong answer118 With failure reason Did not follow instructions82 With failure reason API error25 With failure reason Extra formatting8 With failure reason Timed out5 With failure reason No answer2

461/461

Rank	Model	Company	Instructions following Score	Score	Total Cost	Tests Correct	Response Time (avg)
#189	GLM 5.3 FlashX medium	Z.ai	1.0	0.7	$0.114	2/2	1.51s
Total Tests 2 Wrong Tests 0 Total Cost $0.114 Response Time (avg) 1.51s
#295	Inkling Small medium	Thinkingmachines	0.8	0.6	$0.113	1/2	3.78s
Total Tests 2 Wrong Tests 1 Total Cost $0.113 Response Time (avg) 3.78s
#380	Granite 4.2 8B high	IBM Granite	0.6	0.5	$0.111	1/2	87.5s
Total Tests 2 Wrong Tests 1 Total Cost $0.111 Response Time (avg) 87.5s
#386	Laguna S 2.1 low	Poolside	0.4	0.5	$0.108	0/2	423ms
Total Tests 2 Wrong Tests 2 Total Cost $0.108 Response Time (avg) 423ms
#408	Qwen3.5-9B medium	Qwen	0.7	0.4	$0.106	1/2	5.75s
Total Tests 2 Wrong Tests 1 Total Cost $0.106 Response Time (avg) 5.75s
#454	Gemini 3 Flash Preview high	Google	0.0	0.2	$0.105	0/0	0ms
Total Tests 0 Wrong Tests 0 Total Cost $0.105 Response Time (avg) 0ms
#337	Step 3.5 Flash medium	Stepfun	0.8	0.5	$0.105	1/2	4.78s
Total Tests 2 Wrong Tests 1 Total Cost $0.105 Response Time (avg) 4.78s
#345	Qwen3.6 35B A3B none	Qwen	0.6	0.5	$0.105	1/2	1.86s
Total Tests 2 Wrong Tests 1 Total Cost $0.105 Response Time (avg) 1.86s
#260	LongCat 2.0 none	Meituan	0.7	0.6	$0.104	1/2	2.82s
Total Tests 2 Wrong Tests 1 Total Cost $0.104 Response Time (avg) 2.82s
#309	Ring 2.6 1t medium	Inclusionai	1.0	0.6	$0.102	2/2	11.8s
Total Tests 2 Wrong Tests 0 Total Cost $0.102 Response Time (avg) 11.8s
#169	Gemma 4 26B A4B medium	Google	1.0	0.7	$0.101	2/2	17.5s
Total Tests 2 Wrong Tests 0 Total Cost $0.101 Response Time (avg) 17.5s
#220	Solar Pro 4 low	Upstage	0.8	0.7	$0.101	1/2	56.4s
Total Tests 2 Wrong Tests 1 Total Cost $0.101 Response Time (avg) 56.4s
#250	Solar Pro 4 medium	Upstage	1.0	0.6	$0.098	2/2	40.1s
Total Tests 2 Wrong Tests 0 Total Cost $0.098 Response Time (avg) 40.1s
#358	Laguna S 2.1 medium	Poolside	0.4	0.5	$0.092	0/2	400ms
Total Tests 2 Wrong Tests 2 Total Cost $0.092 Response Time (avg) 400ms
#280	Gemini 3.1 Flash Lite Preview none	Google	1.0	0.6	$0.090	2/2	1.13s
Total Tests 2 Wrong Tests 0 Total Cost $0.090 Response Time (avg) 1.13s

Instructions following Ranking

Filter models

Top Models by Instructions following Score

Instructions following Score vs Total Cost

Top Models by Response Time (avg)