Coding Model Ranking

See which AI models perform best on Coding, which ones stay reliable, and where the biggest gaps appear. Sort by: Response Time (avg) ↑.

Models Shown

Average Coding Score

0.6

Best Model

Failure Reasons

With failure reason Wrong answer456 With failure reason API error64 With failure reason No answer47 With failure reason Did not follow instructions44 With failure reason Extra formatting36 With failure reason Timed out24

408/408

Rank	Model	Company	Coding Score	Score	Total Cost	Tests Correct	Response Time (avg)
#146	LongCat 2.0 high	Meituan	0.8	0.7	$0.778	2/3	505.3s
Total Tests 3 Wrong Tests 1 Total Cost $0.778 Response Time (avg) 505.3s
#340	Granite 4.2 8B high	IBM Granite	0.4	0.5	$0.111	0/3	515.3s
Total Tests 3 Wrong Tests 3 Total Cost $0.111 Response Time (avg) 515.3s
#130	Mistral Large 4 high	Mistral	0.3	0.8	$1.391	0/3	1277.8s
Total Tests 3 Wrong Tests 3 Total Cost $1.391 Response Time (avg) 1277.8s

Coding Ranking