Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Tests Correct ↓.

Models Shown

Total Failures

3190

Most Affected Model

Gemini 3.6 Flash 1

Categories

In category Domain specific900 In category Anti-AI Tricks521 In category Coding485 In category Puzzle Solving355 In category Trivia317 In category General Intelligence134 In category Combined130 In category Agentic128 In category Instructions following118 In category Data parsing and extraction93

447/447

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#376	DeepSeek V3.2 none	DeepSeek	9	0.5	$0.119	6/23	22.4s
Total Tests 23 Wrong Tests 17 Total Cost $0.119 Response Time (avg) 22.4s
#385	Ling 2.6 Flash default	Inclusionai	9	0.5	$0.002	6/23	10.2s
Total Tests 23 Wrong Tests 17 Total Cost $0.002 Response Time (avg) 10.2s
#439	GPT-6 Luna Decisions default	OpenAI	8	0.2	$0.005	3/12	495ms
Total Tests 12 Wrong Tests 9 Total Cost $0.005 Response Time (avg) 495ms
#440	Kev 4B default	Jaredpalmer	9	0.2	$0.002	3/12	5.63s
Total Tests 12 Wrong Tests 9 Total Cost $0.002 Response Time (avg) 5.63s
#442	Mammoth 1 default	Baseten	6	0.2	$0.000	3/12	1.80s
Total Tests 12 Wrong Tests 9 Total Cost $0.000 Response Time (avg) 1.80s
#443	Classify-1 default	Scaledown	8	0.2	$0.008	3/12	4.58s
Total Tests 12 Wrong Tests 9 Total Cost $0.008 Response Time (avg) 4.58s
#445	Decider Flash V1.2 default	Perplexity	9	0.2	$0.001	3/12	462ms
Total Tests 12 Wrong Tests 9 Total Cost $0.001 Response Time (avg) 462ms
#416	Elephant Alpha default	Openrouter	9	0.4	$0.000	5/21	1.22s
Total Tests 21 Wrong Tests 16 Total Cost $0.000 Response Time (avg) 1.22s
#268	DeepSeek V4 Flash 0423 none	DeepSeek	13	0.6	$0.149	5/23	38.6s
Total Tests 23 Wrong Tests 18 Total Cost $0.149 Response Time (avg) 38.6s
#273	DeepSeek V4 Flash 0731 none	DeepSeek	13	0.6	$0.053	5/23	27.4s
Total Tests 23 Wrong Tests 18 Total Cost $0.053 Response Time (avg) 27.4s
#320	Ling 3.1 Flash none	Inclusionai	9	0.5	$0.000	5/23	15.7s
Total Tests 23 Wrong Tests 18 Total Cost $0.000 Response Time (avg) 15.7s
#336	Kimi K2.5 none	Moonshot AI	17	0.5	$0.262	5/23	35.9s
Total Tests 23 Wrong Tests 18 Total Cost $0.262 Response Time (avg) 35.9s
#338	Laguna XS 2.1 none	Poolside	14	0.5	$0.020	5/23	4.56s
Total Tests 23 Wrong Tests 18 Total Cost $0.020 Response Time (avg) 4.56s
#342	Nemotron 3.5 Lightning high	NVIDIA	11	0.5	$0.168	5/23	77.1s
Total Tests 23 Wrong Tests 18 Total Cost $0.168 Response Time (avg) 77.1s
#346	Mistral Small 4 medium	Mistral	14	0.5	$0.126	5/23	12.7s
Total Tests 23 Wrong Tests 18 Total Cost $0.126 Response Time (avg) 12.7s

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)