Instructions following Model Ranking

See which AI models perform best on Instructions following, which ones stay reliable, and where the biggest gaps appear. Sort by: Total Cost ↑.

Models Shown

Average Instructions following Score

0.8

Best Model

Ling 3.1 Flash 1.0

Failure Reasons

With failure reason Wrong answer118 With failure reason Did not follow instructions82 With failure reason API error25 With failure reason Extra formatting8 With failure reason Timed out5 With failure reason No answer2

461/461

Rank	Model	Company	Instructions following Score	Score	Total Cost	Tests Correct	Response Time (avg)
#69	DeepSeek V4.1 Flash high	DeepSeek	1.0	0.9	$0.617	2/2	7.06s
Total Tests 2 Wrong Tests 0 Total Cost $0.617 Response Time (avg) 7.06s
#126	GLM 5.3 FlashX max	Z.ai	1.0	0.8	$0.623	2/2	2.23s
Total Tests 2 Wrong Tests 0 Total Cost $0.623 Response Time (avg) 2.23s
#54	Gemini 3.5 Flash Lite high	Google	1.0	0.9	$0.624	2/2	2.16s
Total Tests 2 Wrong Tests 0 Total Cost $0.624 Response Time (avg) 2.16s
#231	LongCat 2.0 low	Meituan	0.7	0.7	$0.630	1/2	6.39s
Total Tests 2 Wrong Tests 1 Total Cost $0.630 Response Time (avg) 6.39s
#292	Claude Sonnet 4.6 none	Anthropic	0.7	0.6	$0.661	1/2	1.96s
Total Tests 2 Wrong Tests 1 Total Cost $0.661 Response Time (avg) 1.96s
#277	KAT-Coder-Pro V2.5 medium	Kwaipilot	1.0	0.6	$0.669	2/2	2.58s
Total Tests 2 Wrong Tests 0 Total Cost $0.669 Response Time (avg) 2.58s
#55	Gemini 4 Argon medium	Google	1.0	0.9	$0.674	2/2	2.71s
Total Tests 2 Wrong Tests 0 Total Cost $0.674 Response Time (avg) 2.71s
#283	Beam 1.0 501B A23B high	Reflection	1.0	0.6	$0.674	2/2	1.27s
Total Tests 2 Wrong Tests 0 Total Cost $0.674 Response Time (avg) 1.27s
#120	Nemotron 3 Ultra medium	NVIDIA	1.0	0.8	$0.674	2/2	6.35s
Total Tests 2 Wrong Tests 0 Total Cost $0.674 Response Time (avg) 6.35s
#173	Gemini 2.5 Flash medium	Google	1.0	0.7	$0.680	2/2	2.62s
Total Tests 2 Wrong Tests 0 Total Cost $0.680 Response Time (avg) 2.62s
#373	Mimo V2 Omni medium	Xiaomi	0.8	0.5	$0.683	1/2	4.99s
Total Tests 2 Wrong Tests 1 Total Cost $0.683 Response Time (avg) 4.99s
#241	Beam 1.0 501B A23B xhigh	Reflection	1.0	0.6	$0.688	2/2	1.15s
Total Tests 2 Wrong Tests 0 Total Cost $0.688 Response Time (avg) 1.15s
#318	GPT-5.4 none	OpenAI	0.7	0.6	$0.690	1/2	1.07s
Total Tests 2 Wrong Tests 1 Total Cost $0.690 Response Time (avg) 1.07s
#99	GPT-5.6 Terra high	OpenAI	1.0	0.8	$0.698	2/2	2.14s
Total Tests 2 Wrong Tests 0 Total Cost $0.698 Response Time (avg) 2.14s
#20	GPT-6 Sol medium	OpenAI	1.0	0.9	$0.703	2/2	2.00s
Total Tests 2 Wrong Tests 0 Total Cost $0.703 Response Time (avg) 2.00s

Instructions following Ranking

Filter models

Top Models by Instructions following Score

Instructions following Score vs Total Cost

Top Models by Response Time (avg)