Instructions following Model Ranking

See which AI models perform best on Instructions following, which ones stay reliable, and where the biggest gaps appear. Sort by: Total Cost ↓.

Models Shown

Average Instructions following Score

0.8

Best Model

Claude Sonnet 5.5 0.9

Failure Reasons

With failure reason Wrong answer118 With failure reason Did not follow instructions82 With failure reason API error25 With failure reason Extra formatting8 With failure reason Timed out5 With failure reason No answer2

461/461

Rank	Model	Company	Instructions following Score	Score	Total Cost	Tests Correct	Response Time (avg)
#450	Clef Omni default	Cloudflare	0.2	0.2	$0.011	0/1	904ms
Total Tests 1 Wrong Tests 1 Total Cost $0.011 Response Time (avg) 904ms
#333	Qwen3.8 27B none	Qwen	0.6	0.5	~$0.010	1/2	582ms
Total Tests 2 Wrong Tests 1 Total Cost ~$0.010 Response Time (avg) 582ms
#458	Solar Decide default	Upstage	0.5	0.1	$0.009	1/1	11.7s
Total Tests 1 Wrong Tests 0 Total Cost $0.009 Response Time (avg) 11.7s
#421	Laguna M.1 default	Poolside	0.6	0.4	$0.009	1/2	683ms
Total Tests 2 Wrong Tests 1 Total Cost $0.009 Response Time (avg) 683ms
#415	Nemotron 3.5 Lightning none	NVIDIA	0.7	0.4	$0.009	1/2	511ms
Total Tests 2 Wrong Tests 1 Total Cost $0.009 Response Time (avg) 511ms
#449	Classify-1 default	Scaledown	0.2	0.2	$0.008	0/1	4.26s
Total Tests 1 Wrong Tests 1 Total Cost $0.008 Response Time (avg) 4.26s
#397	Trinity Large Preview default	Arcee AI	0.4	0.4	$0.008	0/2	822ms
Total Tests 2 Wrong Tests 2 Total Cost $0.008 Response Time (avg) 822ms
#433	Grok 4.1 Fast default	X AI	0.3	0.3	$0.008	0/2	685ms
Total Tests 2 Wrong Tests 2 Total Cost $0.008 Response Time (avg) 685ms
#428	Hy3 preview none	Tencent	0.6	0.3	$0.007	1/2	13.0s
Total Tests 2 Wrong Tests 1 Total Cost $0.007 Response Time (avg) 13.0s
#414	Granite 4.1 8b default	IBM Granite	0.4	0.4	$0.007	0/2	344ms
Total Tests 2 Wrong Tests 2 Total Cost $0.007 Response Time (avg) 344ms
#445	GPT-6 Luna Decisions default	OpenAI	0.2	0.2	$0.005	0/1	842ms
Total Tests 1 Wrong Tests 1 Total Cost $0.005 Response Time (avg) 842ms
#434	Laguna Xs.2 default	Poolside	0.7	0.3	$0.004	1/2	439ms
Total Tests 2 Wrong Tests 1 Total Cost $0.004 Response Time (avg) 439ms
#347	Ling 3.0 Flash none	Inclusionai	0.5	0.5	$0.004	0/2	836ms
Total Tests 2 Wrong Tests 2 Total Cost $0.004 Response Time (avg) 836ms
#441	Jev 1.13 default	Typesafe	0.2	0.3	$0.003	0/1	557ms
Total Tests 1 Wrong Tests 1 Total Cost $0.003 Response Time (avg) 557ms
#447	Jev 1.14 default	Typesafe	0.2	0.2	$0.003	0/1	543ms
Total Tests 1 Wrong Tests 1 Total Cost $0.003 Response Time (avg) 543ms

Instructions following Ranking

Filter models

Top Models by Instructions following Score

Instructions following Score vs Total Cost

Top Models by Response Time (avg)

Instructions following Ranking

Filter models

Top Models by Instructions following Score

Instructions following Score vs Total CostEstimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.0968 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.009566.

Top Models by Response Time (avg)

Instructions following Score vs Total Cost