Instructions following Model Ranking

See which AI models perform best on Instructions following, which ones stay reliable, and where the biggest gaps appear. Sort by: Response Time (avg) ↑.

Models Shown

Average Instructions following Score

0.8

Best Model

Gemini 3 Flash Preview 0.0

Failure Reasons

With failure reason Wrong answer118 With failure reason Did not follow instructions82 With failure reason API error25 With failure reason Extra formatting8 With failure reason Timed out5 With failure reason No answer2

461/461

Rank	Model	Company	Instructions following Score	Score	Total Cost	Tests Correct	Response Time (avg)
#132	MiMo-V2.6-Flash medium	Xiaomi	1.0	0.8	$0.218	2/2	1.13s
Total Tests 2 Wrong Tests 0 Total Cost $0.218 Response Time (avg) 1.13s
#280	Gemini 3.1 Flash Lite Preview none	Google	1.0	0.6	$0.090	2/2	1.13s
Total Tests 2 Wrong Tests 0 Total Cost $0.090 Response Time (avg) 1.13s
#254	Beam 1.0 501B A23B low	Reflection	0.8	0.6	$0.432	1/2	1.14s
Total Tests 2 Wrong Tests 1 Total Cost $0.432 Response Time (avg) 1.14s
#241	Beam 1.0 501B A23B xhigh	Reflection	1.0	0.6	$0.688	2/2	1.15s
Total Tests 2 Wrong Tests 0 Total Cost $0.688 Response Time (avg) 1.15s
#306	GPT-5.6 Terra none	OpenAI	0.9	0.6	$0.377	1/2	1.15s
Total Tests 2 Wrong Tests 1 Total Cost $0.377 Response Time (avg) 1.15s
#228	GPT-5.5 none	OpenAI	0.6	0.7	$1.212	1/2	1.15s
Total Tests 2 Wrong Tests 1 Total Cost $1.212 Response Time (avg) 1.15s
#313	Mistral Large 4 none	Mistral	0.7	0.6	$0.290	1/2	1.16s
Total Tests 2 Wrong Tests 1 Total Cost $0.290 Response Time (avg) 1.16s
#287	Qwen3.5 Plus 2026-04-20 none	Qwen	0.6	0.6	$0.216	1/2	1.17s
Total Tests 2 Wrong Tests 1 Total Cost $0.216 Response Time (avg) 1.17s
#326	Ling 3.1 Flash none	Inclusionai	0.8	0.5	$0.000	1/2	1.22s
Total Tests 2 Wrong Tests 1 Total Cost $0.000 Response Time (avg) 1.22s
#214	GPT-6 Sol none	OpenAI	1.0	0.7	$0.551	2/2	1.23s
Total Tests 2 Wrong Tests 0 Total Cost $0.551 Response Time (avg) 1.23s
#340	GPT-5.6 Luna none	OpenAI	0.7	0.5	$0.042	1/2	1.23s
Total Tests 2 Wrong Tests 1 Total Cost $0.042 Response Time (avg) 1.23s
#234	Beam 1.0 501B A23B medium	Reflection	1.0	0.7	$0.499	2/2	1.24s
Total Tests 2 Wrong Tests 0 Total Cost $0.499 Response Time (avg) 1.24s
#41	DeepSeek V4.1 Flash 1017 low	DeepSeek	1.0	0.9	$0.355	2/2	1.25s
Total Tests 2 Wrong Tests 0 Total Cost $0.355 Response Time (avg) 1.25s
#376	Mercury 2.5 Preview default	Inception	0.6	0.5	$0.023	1/2	1.26s
Total Tests 2 Wrong Tests 1 Total Cost $0.023 Response Time (avg) 1.26s
#283	Beam 1.0 501B A23B high	Reflection	1.0	0.6	$0.674	2/2	1.27s
Total Tests 2 Wrong Tests 0 Total Cost $0.674 Response Time (avg) 1.27s

Instructions following Ranking

Filter models

Top Models by Instructions following Score

Instructions following Score vs Total Cost

Top Models by Response Time (avg)