Coding x Wrong answer Ranking

See which AI models are most likely to hit Wrong answer on Coding, so you can spot weak points faster. Sort by: Tests Correct ↓.

Models Shown

Total Failures

456

Most Affected Model

Failure Reasons

Wrong answer456 API error64 Did not follow instructions41 No answer41 Extra formatting36 Timed out24

Categories

Domain specific811 Anti-AI Tricks470 Coding456 Puzzle Solving323 Trivia289 Combined121 General Intelligence121 Agentic120 Instructions following101 Data parsing and extraction77

265/265

Rank	Model	Company	Wrong answer Count	Category Score	Total Cost	Tests Correct	Response Time (avg)
#381	Grok 4.20 none	X AI	1	0.1	$0.057	0/1	1.22s
Total Tests 1 Wrong Tests 1 Total Cost $0.057 Response Time (avg) 1.22s
#383	Laguna Xs.2 medium	Poolside	1	0.2	$0.015	0/1	14.4s
Total Tests 1 Wrong Tests 1 Total Cost $0.015 Response Time (avg) 14.4s
#384	Hy3 preview none	Tencent	1	0.3	$0.007	0/3	4.56s
Total Tests 3 Wrong Tests 3 Total Cost $0.007 Response Time (avg) 4.56s
#385	MiMo-V2-Flash default	Xiaomi	2	0.4	$0.025	0/3	2.64s
Total Tests 3 Wrong Tests 3 Total Cost $0.025 Response Time (avg) 2.64s
#388	Grok 4.1 Fast default	X AI	1	0.2	$0.008	0/1	1.79s
Total Tests 1 Wrong Tests 1 Total Cost $0.008 Response Time (avg) 1.79s
#389	Laguna Xs.2 default	Poolside	1	0.8	$0.004	0/1	1.96s
Total Tests 1 Wrong Tests 1 Total Cost $0.004 Response Time (avg) 1.96s
#392	Nemotron 3 Nano Omni 30b A3b Reasoning medium	NVIDIA	1	0.1	$0.000	0/1	38.1s
Total Tests 1 Wrong Tests 1 Total Cost $0.000 Response Time (avg) 38.1s
#394	Jev 1.13 default	Typesafe	2	0.2	$0.003	0/2	598ms
Total Tests 2 Wrong Tests 2 Total Cost $0.003 Response Time (avg) 598ms
#396	GPT-6 Luna Decisions default	OpenAI	2	0.3	$0.005	0/2	447ms
Total Tests 2 Wrong Tests 2 Total Cost $0.005 Response Time (avg) 447ms
#399	D1 default	Liquid	2	0.2	$0.003	0/2	456ms
Total Tests 2 Wrong Tests 2 Total Cost $0.003 Response Time (avg) 456ms

Filter models