Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Response Time (avg) ↓.

Models Shown

Total Failures

1585

Most Affected Model

Categories

In category Domain specific421 In category Anti-AI Tricks293 In category Coding259 In category Puzzle Solving204 In category Trivia172 In category Combined69 In category General Intelligence62 In category Instructions following61 In category Data parsing and extraction41 In category Tool Calling3

215/215

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#203	Grok 4.20 none	X AI	10	4.1	$0.057	6/18	1.11s
Total Tests 18 Wrong Tests 12 Total Cost $0.057 Response Time (avg) 1.11s
#195	Mercury 2 none	Inception	17	4.6	$0.030	4/22	829ms
Total Tests 22 Wrong Tests 18 Total Cost $0.030 Response Time (avg) 829ms
#211	Laguna Xs.2 none	Poolside	8	3.8	$0.004	5/19	806ms
Total Tests 19 Wrong Tests 14 Total Cost $0.004 Response Time (avg) 806ms
#216	LFM2-24B-A2B none	Liquid	9	2.2	$0.001	2/16	782ms
Total Tests 16 Wrong Tests 14 Total Cost $0.001 Response Time (avg) 782ms
#214	Nemotron 3 Nano Omni 30b A3b Reasoning none	NVIDIA	9	3.2	$0.000	2/19	728ms
Total Tests 19 Wrong Tests 17 Total Cost $0.000 Response Time (avg) 728ms

←

1 14 15

Wrong answer Failures