Instructions following Model Ranking

See which AI models perform best on Instructions following, which ones stay reliable, and where the biggest gaps appear. Sort by: Total Cost ↑.

Models Shown

Average Instructions following Score

0.8

Best Model

Ling 3.1 Flash 1.0

Failure Reasons

With failure reason Wrong answer118 With failure reason Did not follow instructions82 With failure reason API error25 With failure reason Extra formatting8 With failure reason Timed out5 With failure reason No answer2

461/461

Rank	Model	Company	Instructions following Score	Score	Total Cost	Tests Correct	Response Time (avg)
#437	Span-02 default	Respan	0.5	0.3	$0.001	1/1	2.30s
Total Tests 1 Wrong Tests 0 Total Cost $0.001 Response Time (avg) 2.30s
#442	Decider V1.2 default	Perplexity	0.2	0.3	$0.001	0/1	508ms
Total Tests 1 Wrong Tests 1 Total Cost $0.001 Response Time (avg) 508ms
#459	Tev1 4B Experimental default	Togethercomputer	0.2	1.0	$0.002	0/1	555ms
Total Tests 1 Wrong Tests 1 Total Cost $0.002 Response Time (avg) 555ms
#443	Decider V1.1 27B default	Perplexity	0.2	0.3	$0.002	0/1	333ms
Total Tests 1 Wrong Tests 1 Total Cost $0.002 Response Time (avg) 333ms
#391	Ling 2.6 Flash default	Inclusionai	1.0	0.5	$0.002	2/2	5.52s
Total Tests 2 Wrong Tests 0 Total Cost $0.002 Response Time (avg) 5.52s
#444	Drex v1.5 default	Nace AI	0.2	0.2	$0.002	0/1	1.33s
Total Tests 1 Wrong Tests 1 Total Cost $0.002 Response Time (avg) 1.33s
#457	Microsoft-Decision-1 default	Microsoft	0.2	0.1	$0.002	0/1	997ms
Total Tests 1 Wrong Tests 1 Total Cost $0.002 Response Time (avg) 997ms
#446	Kev 4B default	Jaredpalmer	0.2	0.2	$0.002	0/1	17.3s
Total Tests 1 Wrong Tests 1 Total Cost $0.002 Response Time (avg) 17.3s
#453	D1 default	Liquid	0.2	0.2	$0.003	0/1	820ms
Total Tests 1 Wrong Tests 1 Total Cost $0.003 Response Time (avg) 820ms
#439	d1-ultra default	Liquid	0.2	0.3	$0.003	0/1	571ms
Total Tests 1 Wrong Tests 1 Total Cost $0.003 Response Time (avg) 571ms
#456	Solar Decide Flash default	Upstage	0.2	0.2	$0.003	0/1	1.66s
Total Tests 1 Wrong Tests 1 Total Cost $0.003 Response Time (avg) 1.66s
#441	Jev 1.13 default	Typesafe	0.2	0.3	$0.003	0/1	557ms
Total Tests 1 Wrong Tests 1 Total Cost $0.003 Response Time (avg) 557ms
#447	Jev 1.14 default	Typesafe	0.2	0.2	$0.003	0/1	543ms
Total Tests 1 Wrong Tests 1 Total Cost $0.003 Response Time (avg) 543ms
#347	Ling 3.0 Flash none	Inclusionai	0.5	0.5	$0.004	0/2	836ms
Total Tests 2 Wrong Tests 2 Total Cost $0.004 Response Time (avg) 836ms
#434	Laguna Xs.2 default	Poolside	0.7	0.3	$0.004	1/2	439ms
Total Tests 2 Wrong Tests 1 Total Cost $0.004 Response Time (avg) 439ms

Instructions following Ranking

Filter models

Top Models by Instructions following Score

Instructions following Score vs Total Cost

Top Models by Response Time (avg)