Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Failure Count ↑.

Models Shown

Total Failures

3190

Most Affected Model

Gemini 3.6 Flash 1

Categories

In category Domain specific900 In category Anti-AI Tricks521 In category Coding485 In category Puzzle Solving355 In category Trivia317 In category General Intelligence134 In category Combined130 In category Agentic128 In category Instructions following118 In category Data parsing and extraction93

447/447

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#445	Decider Flash V1.2 default	Perplexity	9	0.2	$0.001	3/12	462ms
Total Tests 12 Wrong Tests 9 Total Cost $0.001 Response Time (avg) 462ms
#449	LFM2-24B-A2B default	Liquid	9	0.2	$0.001	2/16	782ms
Total Tests 16 Wrong Tests 14 Total Cost $0.001 Response Time (avg) 782ms
#149	Space Bunny Alpha high	Stealth	10	0.8	$0.000	13/23	29.4s
Total Tests 23 Wrong Tests 10 Total Cost $0.000 Response Time (avg) 29.4s
#201	GPT-5.6 Luna low	OpenAI	10	0.7	$0.049	11/23	6.96s
Total Tests 23 Wrong Tests 12 Total Cost $0.049 Response Time (avg) 6.96s
#208	GPT-6 Sol none	OpenAI	10	0.7	$0.551	13/23	9.02s
Total Tests 23 Wrong Tests 10 Total Cost $0.551 Response Time (avg) 9.02s
#209	Space Bunny Alpha max	Stealth	10	0.7	$0.000	11/23	36.2s
Total Tests 23 Wrong Tests 12 Total Cost $0.000 Response Time (avg) 36.2s
#219	GPT-5.6 Sol none	OpenAI	10	0.7	$0.795	12/23	4.61s
Total Tests 23 Wrong Tests 11 Total Cost $0.795 Response Time (avg) 4.61s
#229	KAT-Coder-Pro V2.5 low	Kwaipilot	10	0.7	$0.568	11/23	19.4s
Total Tests 23 Wrong Tests 12 Total Cost $0.568 Response Time (avg) 19.4s
#238	KAT-Coder-Pro V2.5 high	Kwaipilot	10	0.6	$0.506	11/23	21.2s
Total Tests 23 Wrong Tests 12 Total Cost $0.506 Response Time (avg) 21.2s
#240	Laguna XS 2.1 medium	Poolside	10	0.6	$0.083	9/23	49.0s
Total Tests 23 Wrong Tests 14 Total Cost $0.083 Response Time (avg) 49.0s
#284	KAT-Coder-Pro V2.5 default	Kwaipilot	10	0.6	$0.742	11/23	25.0s
Total Tests 23 Wrong Tests 12 Total Cost $0.742 Response Time (avg) 25.0s
#287	GLM 5.3 FlashX low	Z.ai	10	0.6	$0.157	11/23	9.69s
Total Tests 23 Wrong Tests 12 Total Cost $0.157 Response Time (avg) 9.69s
#288	MiMo-V2.6-Pro none	Xiaomi	10	0.6	$0.193	9/23	9.66s
Total Tests 23 Wrong Tests 14 Total Cost $0.193 Response Time (avg) 9.66s
#292	gpt-oss-120b medium	OpenAI	10	0.6	$0.030	9/23	31.6s
Total Tests 23 Wrong Tests 14 Total Cost $0.030 Response Time (avg) 31.6s
#304	Trinity Large Thinking high	Arcee AI	10	0.6	$0.794	6/23	74.5s
Total Tests 23 Wrong Tests 17 Total Cost $0.794 Response Time (avg) 74.5s

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)