Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one.

Models Shown

Total Failures

3190

Most Affected Model

Categories

In category Domain specific900 In category Anti-AI Tricks521 In category Coding485 In category Puzzle Solving355 In category Trivia317 In category General Intelligence134 In category Combined130 In category Agentic128 In category Instructions following118 In category Data parsing and extraction93

447/447

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#201	GPT-5.6 Luna low	OpenAI	10	0.7	$0.049	11/23	6.96s
Total Tests 23 Wrong Tests 12 Total Cost $0.049 Response Time (avg) 6.96s
#208	GPT-6 Sol none	OpenAI	10	0.7	$0.551	13/23	9.02s
Total Tests 23 Wrong Tests 10 Total Cost $0.551 Response Time (avg) 9.02s
#209	Space Bunny Alpha max	Stealth	10	0.7	$0.000	11/23	36.2s
Total Tests 23 Wrong Tests 12 Total Cost $0.000 Response Time (avg) 36.2s
#219	GPT-5.6 Sol none	OpenAI	10	0.7	$0.795	12/23	4.61s
Total Tests 23 Wrong Tests 11 Total Cost $0.795 Response Time (avg) 4.61s
#229	KAT-Coder-Pro V2.5 low	Kwaipilot	10	0.7	$0.568	11/23	19.4s
Total Tests 23 Wrong Tests 12 Total Cost $0.568 Response Time (avg) 19.4s
#238	KAT-Coder-Pro V2.5 high	Kwaipilot	10	0.6	$0.506	11/23	21.2s
Total Tests 23 Wrong Tests 12 Total Cost $0.506 Response Time (avg) 21.2s
#240	Laguna XS 2.1 medium	Poolside	10	0.6	$0.083	9/23	49.0s
Total Tests 23 Wrong Tests 14 Total Cost $0.083 Response Time (avg) 49.0s
#284	KAT-Coder-Pro V2.5 default	Kwaipilot	10	0.6	$0.742	11/23	25.0s
Total Tests 23 Wrong Tests 12 Total Cost $0.742 Response Time (avg) 25.0s
#287	GLM 5.3 FlashX low	Z.ai	10	0.6	$0.157	11/23	9.69s
Total Tests 23 Wrong Tests 12 Total Cost $0.157 Response Time (avg) 9.69s
#288	MiMo-V2.6-Pro none	Xiaomi	10	0.6	$0.193	9/23	9.66s
Total Tests 23 Wrong Tests 14 Total Cost $0.193 Response Time (avg) 9.66s
#292	gpt-oss-120b medium	OpenAI	10	0.6	$0.030	9/23	31.6s
Total Tests 23 Wrong Tests 14 Total Cost $0.030 Response Time (avg) 31.6s
#304	Trinity Large Thinking high	Arcee AI	10	0.6	$0.794	6/23	74.5s
Total Tests 23 Wrong Tests 17 Total Cost $0.794 Response Time (avg) 74.5s
#309	Dots 3 Note Preview medium	Dots Studio	10	0.6	$0.000	8/23	70.3s
Total Tests 23 Wrong Tests 15 Total Cost $0.000 Response Time (avg) 70.3s
#323	Gemma 4 26B A4B none	Google	10	0.5	$0.031	9/23	10.5s
Total Tests 23 Wrong Tests 14 Total Cost $0.031 Response Time (avg) 10.5s
#328	North Mini Code medium	Cohere	10	0.5	$0.000	8/23	140.4s
Total Tests 23 Wrong Tests 15 Total Cost $0.000 Response Time (avg) 140.4s

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)