Instructions following Model Ranking

See which AI models perform best on Instructions following, which ones stay reliable, and where the biggest gaps appear. Sort by: Tests Correct ↑.

Models Shown

Average Instructions following Score

0.8

Best Model

Minimax M3.1 Flash 0.5

Failure Reasons

With failure reason Wrong answer118 With failure reason Did not follow instructions82 With failure reason API error25 With failure reason Extra formatting8 With failure reason Timed out5 With failure reason No answer2

461/461

Rank	Model	Company	Instructions following Score	Score	Total Cost	Tests Correct	Response Time (avg)
#277	KAT-Coder-Pro V2.5 medium	Kwaipilot	1.0	0.6	$0.669	2/2	2.58s
Total Tests 2 Wrong Tests 0 Total Cost $0.669 Response Time (avg) 2.58s
#278	GLM 5 Turbo medium	Z.ai	1.0	0.6	$0.323	2/2	5.38s
Total Tests 2 Wrong Tests 0 Total Cost $0.323 Response Time (avg) 5.38s
#280	Gemini 3.1 Flash Lite Preview none	Google	1.0	0.6	$0.090	2/2	1.13s
Total Tests 2 Wrong Tests 0 Total Cost $0.090 Response Time (avg) 1.13s
#282	Gemini 3.5 Flash none	Google	1.0	0.6	$1.752	2/2	3.38s
Total Tests 2 Wrong Tests 0 Total Cost $1.752 Response Time (avg) 3.38s
#283	Beam 1.0 501B A23B high	Reflection	1.0	0.6	$0.674	2/2	1.27s
Total Tests 2 Wrong Tests 0 Total Cost $0.674 Response Time (avg) 1.27s
#285	Apodex 1.1 Mini low	Apodex	1.0	0.6	$0.000	2/2	7.71s
Total Tests 2 Wrong Tests 0 Total Cost $0.000 Response Time (avg) 7.71s
#288	Step 5 Preview medium	Stepfun	1.0	0.6	$4.136	2/2	4.23s
Total Tests 2 Wrong Tests 0 Total Cost $4.136 Response Time (avg) 4.23s
#290	KAT-Coder-Pro V2.5 default	Kwaipilot	1.0	0.6	$0.742	2/2	2.61s
Total Tests 2 Wrong Tests 0 Total Cost $0.742 Response Time (avg) 2.61s
#293	GLM 5.3 FlashX low	Z.ai	1.0	0.6	$0.157	2/2	1.34s
Total Tests 2 Wrong Tests 0 Total Cost $0.157 Response Time (avg) 1.34s
#294	MiMo-V2.6-Pro none	Xiaomi	1.0	0.6	$0.193	2/2	803ms
Total Tests 2 Wrong Tests 0 Total Cost $0.193 Response Time (avg) 803ms
#296	Seed-2.0-Lite none	Bytedance Seed	1.0	0.6	$0.114	2/2	1.06s
Total Tests 2 Wrong Tests 0 Total Cost $0.114 Response Time (avg) 1.06s
#297	Gemini 3.1 Flash Lite minimal	Google	1.0	0.6	$0.080	2/2	932ms
Total Tests 2 Wrong Tests 0 Total Cost $0.080 Response Time (avg) 932ms
#298	gpt-oss-120b medium	OpenAI	1.0	0.6	$0.030	2/2	7.63s
Total Tests 2 Wrong Tests 0 Total Cost $0.030 Response Time (avg) 7.63s
#299	Gemini 3.1 Flash Lite none	Google	1.0	0.6	$0.069	2/2	859ms
Total Tests 2 Wrong Tests 0 Total Cost $0.069 Response Time (avg) 859ms
#302	Nemotron 3 Ultra none	NVIDIA	1.0	0.6	$0.164	2/2	1.46s
Total Tests 2 Wrong Tests 0 Total Cost $0.164 Response Time (avg) 1.46s

Instructions following Ranking

Filter models

Top Models by Instructions following Score

Instructions following Score vs Total Cost

Top Models by Response Time (avg)