Instructions following Model Ranking

See which AI models perform best on Instructions following, which ones stay reliable, and where the biggest gaps appear.

Models Shown

Average Instructions following Score

0.8

Best Model

Gemini 3.6 Flash 1.0

Failure Reasons

With failure reason Wrong answer118 With failure reason Did not follow instructions82 With failure reason API error25 With failure reason Extra formatting8 With failure reason Timed out5 With failure reason No answer2

461/461

Rank	Model	Company	Instructions following Score	Score	Total Cost	Tests Correct	Response Time (avg)
#189	GLM 5.3 FlashX medium	Z.ai	1.0	0.7	$0.114	2/2	1.51s
Total Tests 2 Wrong Tests 0 Total Cost $0.114 Response Time (avg) 1.51s
#194	Qwen3.6 Max Preview medium	Qwen	1.0	0.7	$1.132	2/2	24.3s
Total Tests 2 Wrong Tests 0 Total Cost $1.132 Response Time (avg) 24.3s
#195	Gemini 3.1 Flash Lite Preview medium	Google	1.0	0.7	$0.158	2/2	1.91s
Total Tests 2 Wrong Tests 0 Total Cost $0.158 Response Time (avg) 1.91s
#199	Qwen3.5-122B-A10B medium	Qwen	1.0	0.7	$1.152	2/2	9.88s
Total Tests 2 Wrong Tests 0 Total Cost $1.152 Response Time (avg) 9.88s
#206	Gemma 4 31B medium	Google	1.0	0.7	$0.144	2/2	12.8s
Total Tests 2 Wrong Tests 0 Total Cost $0.144 Response Time (avg) 12.8s
#210	Kimi K2.6 medium	Moonshot AI	1.0	0.7	$1.594	2/2	12.5s
Total Tests 2 Wrong Tests 0 Total Cost $1.594 Response Time (avg) 12.5s
#211	Qwen3.5-Flash medium	Qwen	1.0	0.7	$0.184	2/2	63.5s
Total Tests 2 Wrong Tests 0 Total Cost $0.184 Response Time (avg) 63.5s
#214	GPT-6 Sol none	OpenAI	1.0	0.7	$0.551	2/2	1.23s
Total Tests 2 Wrong Tests 0 Total Cost $0.551 Response Time (avg) 1.23s
#227	GLM 5.3 Flash low	Z.ai	1.0	0.7	$0.038	2/2	1.65s
Total Tests 2 Wrong Tests 0 Total Cost $0.038 Response Time (avg) 1.65s
#232	Mercury 2 medium	Inception	1.0	0.7	$0.121	2/2	1.07s
Total Tests 2 Wrong Tests 0 Total Cost $0.121 Response Time (avg) 1.07s
#235	KAT-Coder-Pro V2.5 low	Kwaipilot	1.0	0.7	$0.568	2/2	2.53s
Total Tests 2 Wrong Tests 0 Total Cost $0.568 Response Time (avg) 2.53s
#238	Qwen3.6 35B A3B medium	Qwen	1.0	0.7	$0.834	2/2	7.50s
Total Tests 2 Wrong Tests 0 Total Cost $0.834 Response Time (avg) 7.50s
#242	GLM 5.3 low	Z.ai	1.0	0.6	$0.215	2/2	3.40s
Total Tests 2 Wrong Tests 0 Total Cost $0.215 Response Time (avg) 3.40s
#251	Claude Sonnet 4.6 medium	Anthropic	1.0	0.6	$2.126	2/2	2.61s
Total Tests 2 Wrong Tests 0 Total Cost $2.126 Response Time (avg) 2.61s
#253	Kimi K2.5 medium	Moonshot AI	1.0	0.6	$0.841	2/2	92.5s
Total Tests 2 Wrong Tests 0 Total Cost $0.841 Response Time (avg) 92.5s

Instructions following Ranking

Filter models

Top Models by Instructions following Score

Instructions following Score vs Total Cost

Top Models by Response Time (avg)