Instructions following Model Ranking

See which AI models perform best on Instructions following, which ones stay reliable, and where the biggest gaps appear. Sort by: Total Cost ↓.

Models Shown

Average Instructions following Score

0.8

Best Model

Claude Sonnet 5.5 0.9

Failure Reasons

With failure reason Wrong answer118 With failure reason Did not follow instructions82 With failure reason API error25 With failure reason Extra formatting8 With failure reason Timed out5 With failure reason No answer2

461/461

Rank	Model	Company	Instructions following Score	Score	Total Cost	Tests Correct	Response Time (avg)
#456	Solar Decide Flash default	Upstage	0.2	0.2	$0.003	0/1	1.66s
Total Tests 1 Wrong Tests 1 Total Cost $0.003 Response Time (avg) 1.66s
#439	d1-ultra default	Liquid	0.2	0.3	$0.003	0/1	571ms
Total Tests 1 Wrong Tests 1 Total Cost $0.003 Response Time (avg) 571ms
#453	D1 default	Liquid	0.2	0.2	$0.003	0/1	820ms
Total Tests 1 Wrong Tests 1 Total Cost $0.003 Response Time (avg) 820ms
#446	Kev 4B default	Jaredpalmer	0.2	0.2	$0.002	0/1	17.3s
Total Tests 1 Wrong Tests 1 Total Cost $0.002 Response Time (avg) 17.3s
#457	Microsoft-Decision-1 default	Microsoft	0.2	0.1	$0.002	0/1	997ms
Total Tests 1 Wrong Tests 1 Total Cost $0.002 Response Time (avg) 997ms
#444	Drex v1.5 default	Nace AI	0.2	0.2	$0.002	0/1	1.33s
Total Tests 1 Wrong Tests 1 Total Cost $0.002 Response Time (avg) 1.33s
#391	Ling 2.6 Flash default	Inclusionai	1.0	0.5	$0.002	2/2	5.52s
Total Tests 2 Wrong Tests 0 Total Cost $0.002 Response Time (avg) 5.52s
#443	Decider V1.1 27B default	Perplexity	0.2	0.3	$0.002	0/1	333ms
Total Tests 1 Wrong Tests 1 Total Cost $0.002 Response Time (avg) 333ms
#459	Tev1 4B Experimental default	Togethercomputer	0.2	1.0	$0.002	0/1	555ms
Total Tests 1 Wrong Tests 1 Total Cost $0.002 Response Time (avg) 555ms
#442	Decider V1.2 default	Perplexity	0.2	0.3	$0.001	0/1	508ms
Total Tests 1 Wrong Tests 1 Total Cost $0.001 Response Time (avg) 508ms
#437	Span-02 default	Respan	0.5	0.3	$0.001	1/1	2.30s
Total Tests 1 Wrong Tests 0 Total Cost $0.001 Response Time (avg) 2.30s
#451	Decider Flash V1.2 default	Perplexity	0.2	0.2	$0.001	0/1	424ms
Total Tests 1 Wrong Tests 1 Total Cost $0.001 Response Time (avg) 424ms
#455	LFM2-24B-A2B default	Liquid	0.6	0.2	$0.001	1/2	752ms
Total Tests 2 Wrong Tests 1 Total Cost $0.001 Response Time (avg) 752ms
#460	Nimble v3 9B default	Bespoke Labs	0.2	0.8	~$0.001	0/1	469ms
Total Tests 1 Wrong Tests 1 Total Cost ~$0.001 Response Time (avg) 469ms
#105	Ling 3.1 Flash medium	Inclusionai	1.0	0.8	$0.000	2/2	3.57s
Total Tests 2 Wrong Tests 0 Total Cost $0.000 Response Time (avg) 3.57s

Instructions following Ranking

Filter models

Top Models by Instructions following Score

Instructions following Score vs Total Cost

Top Models by Response Time (avg)

Instructions following Ranking

Filter models

Top Models by Instructions following Score

Instructions following Score vs Total CostEstimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.0021 h × 0.377 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.000263.

Top Models by Response Time (avg)

Instructions following Score vs Total Cost