Instructions following Model Ranking

See which AI models perform best on Instructions following, which ones stay reliable, and where the biggest gaps appear. Sort by: Metric ↑.

Models Shown

Average Instructions following Score

0.8

Best Model

Gemini 3 Flash Preview 0.0

Failure Reasons

With failure reason Wrong answer118 With failure reason Did not follow instructions82 With failure reason API error25 With failure reason Extra formatting8 With failure reason Timed out5 With failure reason No answer2

461/461

Rank	Model	Company	Instructions following Score	Score	Total Cost	Tests Correct	Response Time (avg)
#266	Gemini 3.1 Flash Lite low	Google	1.0	0.6	$0.717	2/2	1.52s
Total Tests 2 Wrong Tests 0 Total Cost $0.717 Response Time (avg) 1.52s
#268	Qwen3.5 Plus 2026-02-15 none	Qwen	1.0	0.6	$0.176	2/2	1.67s
Total Tests 2 Wrong Tests 0 Total Cost $0.176 Response Time (avg) 1.67s
#270	Claude Opus 4.6 medium	Anthropic	1.0	0.6	$2.961	2/2	2.43s
Total Tests 2 Wrong Tests 0 Total Cost $2.961 Response Time (avg) 2.43s
#272	DeepSeek V3.2 medium	DeepSeek	1.0	0.6	$0.152	2/2	35.8s
Total Tests 2 Wrong Tests 0 Total Cost $0.152 Response Time (avg) 35.8s
#278	GLM 5 Turbo medium	Z.ai	1.0	0.6	$0.323	2/2	5.38s
Total Tests 2 Wrong Tests 0 Total Cost $0.323 Response Time (avg) 5.38s
#280	Gemini 3.1 Flash Lite Preview none	Google	1.0	0.6	$0.090	2/2	1.13s
Total Tests 2 Wrong Tests 0 Total Cost $0.090 Response Time (avg) 1.13s
#288	Step 5 Preview medium	Stepfun	1.0	0.6	$4.136	2/2	4.23s
Total Tests 2 Wrong Tests 0 Total Cost $4.136 Response Time (avg) 4.23s
#293	GLM 5.3 FlashX low	Z.ai	1.0	0.6	$0.157	2/2	1.34s
Total Tests 2 Wrong Tests 0 Total Cost $0.157 Response Time (avg) 1.34s
#296	Seed-2.0-Lite none	Bytedance Seed	1.0	0.6	$0.114	2/2	1.06s
Total Tests 2 Wrong Tests 0 Total Cost $0.114 Response Time (avg) 1.06s
#297	Gemini 3.1 Flash Lite minimal	Google	1.0	0.6	$0.080	2/2	932ms
Total Tests 2 Wrong Tests 0 Total Cost $0.080 Response Time (avg) 932ms
#299	Gemini 3.1 Flash Lite none	Google	1.0	0.6	$0.069	2/2	859ms
Total Tests 2 Wrong Tests 0 Total Cost $0.069 Response Time (avg) 859ms
#302	Nemotron 3 Ultra none	NVIDIA	1.0	0.6	$0.164	2/2	1.46s
Total Tests 2 Wrong Tests 0 Total Cost $0.164 Response Time (avg) 1.46s
#308	Ling 3.0 Flash high	Inclusionai	1.0	0.6	$0.021	2/2	1.85s
Total Tests 2 Wrong Tests 0 Total Cost $0.021 Response Time (avg) 1.85s
#320	Step 5 Preview low	Stepfun	1.0	0.6	$4.110	2/2	6.78s
Total Tests 2 Wrong Tests 0 Total Cost $4.110 Response Time (avg) 6.78s
#321	GLM 5 none	Z.ai	1.0	0.6	$0.140	2/2	1.48s
Total Tests 2 Wrong Tests 0 Total Cost $0.140 Response Time (avg) 1.48s

Instructions following Ranking

Filter models

Top Models by Instructions following Score

Instructions following Score vs Total Cost

Top Models by Response Time (avg)