Instructions following Model Ranking

See which AI models perform best on Instructions following, which ones stay reliable, and where the biggest gaps appear. Sort by: Total Cost ↑.

Models Shown

Average Instructions following Score

0.8

Best Model

Ling 3.1 Flash 1.0

Failure Reasons

With failure reason Wrong answer118 With failure reason Did not follow instructions82 With failure reason API error25 With failure reason Extra formatting8 With failure reason Timed out5 With failure reason No answer2

461/461

Rank	Model	Company	Instructions following Score	Score	Total Cost	Tests Correct	Response Time (avg)
#369	Ling 2.6 1t default	Inclusionai	0.6	0.5	$0.016	1/2	5.36s
Total Tests 2 Wrong Tests 1 Total Cost $0.016 Response Time (avg) 5.36s
#404	gpt-oss-120b none	OpenAI	1.0	0.4	$0.016	2/2	5.06s
Total Tests 2 Wrong Tests 0 Total Cost $0.016 Response Time (avg) 5.06s
#395	Nemotron 3 Super none	NVIDIA	0.6	0.4	$0.016	1/2	804ms
Total Tests 2 Wrong Tests 1 Total Cost $0.016 Response Time (avg) 804ms
#327	Gemini 2.5 Flash none	Google	1.0	0.5	$0.017	2/2	590ms
Total Tests 2 Wrong Tests 0 Total Cost $0.017 Response Time (avg) 590ms
#344	Laguna XS 2.1 none	Poolside	0.4	0.5	$0.020	0/2	364ms
Total Tests 2 Wrong Tests 2 Total Cost $0.020 Response Time (avg) 364ms
#354	Mercury 2.5 low	Inception	0.3	0.5	$0.020	0/2	972ms
Total Tests 2 Wrong Tests 2 Total Cost $0.020 Response Time (avg) 972ms
#452	Step 3.5 Flash none	Stepfun	0.5	0.2	$0.020	1/1	9.30s
Total Tests 1 Wrong Tests 0 Total Cost $0.020 Response Time (avg) 9.30s
#308	Ling 3.0 Flash high	Inclusionai	1.0	0.6	$0.021	2/2	1.85s
Total Tests 2 Wrong Tests 0 Total Cost $0.021 Response Time (avg) 1.85s
#394	Mimo V2 Omni default	Xiaomi	0.7	0.4	$0.021	1/2	4.26s
Total Tests 2 Wrong Tests 1 Total Cost $0.021 Response Time (avg) 4.26s
#319	Solar Pro 4 none	Upstage	0.6	0.6	$0.022	1/2	1.67s
Total Tests 2 Wrong Tests 1 Total Cost $0.022 Response Time (avg) 1.67s
#376	Mercury 2.5 Preview default	Inception	0.6	0.5	$0.023	1/2	1.26s
Total Tests 2 Wrong Tests 1 Total Cost $0.023 Response Time (avg) 1.26s
#362	GPT-4o-mini default	OpenAI	0.6	0.5	$0.024	1/2	1.11s
Total Tests 2 Wrong Tests 1 Total Cost $0.024 Response Time (avg) 1.11s
#429	MiMo-V2-Flash default	Xiaomi	0.7	0.3	$0.025	1/2	857ms
Total Tests 2 Wrong Tests 1 Total Cost $0.025 Response Time (avg) 857ms
#328	GPT-6 Luna none	OpenAI	0.6	0.5	$0.026	1/2	17.0s
Total Tests 2 Wrong Tests 1 Total Cost $0.026 Response Time (avg) 17.0s
#393	Ring 2.6 1t default	Inclusionai	1.0	0.4	$0.026	2/2	27.4s
Total Tests 2 Wrong Tests 0 Total Cost $0.026 Response Time (avg) 27.4s

Instructions following Ranking

Filter models

Top Models by Instructions following Score

Instructions following Score vs Total Cost

Top Models by Response Time (avg)