Coding Model Ranking

See which AI models perform best on Coding, which ones stay reliable, and where the biggest gaps appear.

Models Shown

Average Coding Score

0.6

Best Model

Failure Reasons

With failure reason Wrong answer456 With failure reason API error64 With failure reason Did not follow instructions41 With failure reason No answer41 With failure reason Extra formatting36 With failure reason Timed out24

404/404

Rank	Model	Company	Coding Score	Score	Total Cost	Tests Correct	Response Time (avg)
#289	Claude Opus 4.7 none	Anthropic	0.3	0.5	$0.505	1/1	2.84s
Total Tests 1 Wrong Tests 0 Total Cost $0.505 Response Time (avg) 2.84s
#321	Grok 4.20 Beta medium	X AI	0.3	0.5	$0.750	1/1	31.4s
Total Tests 1 Wrong Tests 0 Total Cost $0.750 Response Time (avg) 31.4s
#341	Gemini 3.1 Flash Lite high	Google	0.3	0.5	$2.044	1/1	137.6s
Total Tests 1 Wrong Tests 0 Total Cost $2.044 Response Time (avg) 137.6s
#366	Grok 4.20 Multi Agent Beta medium	X AI	0.3	0.4	$5.599	1/1	27.1s
Total Tests 1 Wrong Tests 0 Total Cost $5.599 Response Time (avg) 27.1s
#386	Grok Build 0.1 none	X AI	0.3	0.3	$0.547	1/1	21.4s
Total Tests 1 Wrong Tests 0 Total Cost $0.547 Response Time (avg) 21.4s
#393	Nemotron 3 Nano Omni 30b A3b Reasoning default	NVIDIA	0.3	0.3	$0.000	1/1	1.27s
Total Tests 1 Wrong Tests 0 Total Cost $0.000 Response Time (avg) 1.27s
#353	KAT Coder AIR V2.5 default	Kwaipilot	0.3	0.4	$0.070	0/3	14.3s
Total Tests 3 Wrong Tests 3 Total Cost $0.070 Response Time (avg) 14.3s
#352	Nemotron 3 Super none	NVIDIA	0.3	0.4	$0.016	0/3	2.64s
Total Tests 3 Wrong Tests 3 Total Cost $0.016 Response Time (avg) 2.64s
#330	Mimo V2 Omni medium	Xiaomi	0.3	0.5	$0.683	0/3	183.9s
Total Tests 3 Wrong Tests 3 Total Cost $0.683 Response Time (avg) 183.9s
#360	GLM 4.7 Flash medium	Z.ai	0.3	0.4	$0.193	0/3	55.3s
Total Tests 3 Wrong Tests 3 Total Cost $0.193 Response Time (avg) 55.3s
#177	Claude Sonnet 5.5 low	Anthropic	0.3	0.7	$0.909	0/3	5.81s
Total Tests 3 Wrong Tests 3 Total Cost $0.909 Response Time (avg) 5.81s
#319	GPT-4o-mini default	OpenAI	0.3	0.5	$0.024	0/3	1.63s
Total Tests 3 Wrong Tests 3 Total Cost $0.024 Response Time (avg) 1.63s
#281	Nemotron 3 Super medium	NVIDIA	0.3	0.6	$0.081	0/3	147.3s
Total Tests 3 Wrong Tests 3 Total Cost $0.081 Response Time (avg) 147.3s
#372	Nemotron 3.5 Lightning none	NVIDIA	0.3	0.4	$0.009	0/3	1.55s
Total Tests 3 Wrong Tests 3 Total Cost $0.009 Response Time (avg) 1.55s
#339	DeepSeek V3.2 none	DeepSeek	0.3	0.5	$0.119	0/3	14.5s
Total Tests 3 Wrong Tests 3 Total Cost $0.119 Response Time (avg) 14.5s

Coding Ranking

Filter models

Top Models by Coding Score

Coding Score vs Total Cost

Top Models by Response Time (avg)