Coding Model Ranking

See which AI models perform best on Coding, which ones stay reliable, and where the biggest gaps appear. Sort by: Metric ↑.

Models Shown

Average Coding Score

0.6

Best Model

Gemini 3.1 Flash Lite Preview 0.0

Failure Reasons

With failure reason Wrong answer456 With failure reason API error64 With failure reason Did not follow instructions41 With failure reason No answer41 With failure reason Extra formatting36 With failure reason Timed out24

404/404

Rank	Model	Company	Coding Score	Score	Total Cost	Tests Correct	Response Time (avg)
#7	GPT-6 Astra high	OpenAI	1.0	1.0	$4.458	3/3	5.86s
Total Tests 3 Wrong Tests 0 Total Cost $4.458 Response Time (avg) 5.86s
#8	GPT-6 Astra xhigh	OpenAI	1.0	1.0	$6.213	3/3	8.27s
Total Tests 3 Wrong Tests 0 Total Cost $6.213 Response Time (avg) 8.27s
#9	Gemini 3.7 Flash high	Google	1.0	1.0	$0.528	3/3	13.6s
Total Tests 3 Wrong Tests 0 Total Cost $0.528 Response Time (avg) 13.6s
#10	Gemini 3.6 Flash medium	Google	1.0	1.0	$0.577	3/3	14.8s
Total Tests 3 Wrong Tests 0 Total Cost $0.577 Response Time (avg) 14.8s
#11	GPT-6.1 Sol medium	OpenAI	1.0	1.0	$0.530	3/3	4.74s
Total Tests 3 Wrong Tests 0 Total Cost $0.530 Response Time (avg) 4.74s
#12	GPT-6.1 Sol high	OpenAI	1.0	1.0	$0.755	3/3	5.18s
Total Tests 3 Wrong Tests 0 Total Cost $0.755 Response Time (avg) 5.18s
#13	GPT-5.6 Sol low	OpenAI	1.0	1.0	$1.244	3/3	11.3s
Total Tests 3 Wrong Tests 0 Total Cost $1.244 Response Time (avg) 11.3s
#14	GPT-6 Astra low	OpenAI	1.0	1.0	$2.160	3/3	3.97s
Total Tests 3 Wrong Tests 0 Total Cost $2.160 Response Time (avg) 3.97s
#16	GPT-6.1 Sol low	OpenAI	1.0	1.0	$0.460	3/3	4.48s
Total Tests 3 Wrong Tests 0 Total Cost $0.460 Response Time (avg) 4.48s
#19	GPT-5.6 Sol medium	OpenAI	1.0	0.9	$1.700	3/3	9.40s
Total Tests 3 Wrong Tests 0 Total Cost $1.700 Response Time (avg) 9.40s
#20	GPT-6 Astra medium	OpenAI	1.0	0.9	$2.707	3/3	4.95s
Total Tests 3 Wrong Tests 0 Total Cost $2.707 Response Time (avg) 4.95s
#21	GPT-5.6 Sol high	OpenAI	1.0	0.9	$1.595	3/3	12.5s
Total Tests 3 Wrong Tests 0 Total Cost $1.595 Response Time (avg) 12.5s
#22	GPT-5.5 low	OpenAI	1.0	0.9	$1.822	3/3	15.0s
Total Tests 3 Wrong Tests 0 Total Cost $1.822 Response Time (avg) 15.0s
#23	Claude Opus 5.5 low	Anthropic	1.0	0.9	$1.733	3/3	12.2s
Total Tests 3 Wrong Tests 0 Total Cost $1.733 Response Time (avg) 12.2s
#24	Claude Opus 5.5 high	Anthropic	1.0	0.9	$2.133	3/3	13.4s
Total Tests 3 Wrong Tests 0 Total Cost $2.133 Response Time (avg) 13.4s

Coding Ranking

Filter models

Top Models by Coding Score

Coding Score vs Total Cost

Top Models by Response Time (avg)