Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Total Cost ↑.

Models Shown

Total Failures

3190

Most Affected Model

Ling 3.1 Flash 3

Categories

In category Domain specific900 In category Anti-AI Tricks521 In category Coding485 In category Puzzle Solving355 In category Trivia317 In category General Intelligence134 In category Combined130 In category Agentic128 In category Instructions following118 In category Data parsing and extraction93

447/447

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#436	Decider V1.2 default	Perplexity	5	0.3	$0.001	5/12	517ms
Total Tests 12 Wrong Tests 7 Total Cost $0.001 Response Time (avg) 517ms
#453	Tev1 4B Experimental default	Togethercomputer	4	1.0	$0.002	3/7	498ms
Total Tests 7 Wrong Tests 4 Total Cost $0.002 Response Time (avg) 498ms
#437	Decider V1.1 27B default	Perplexity	8	0.3	$0.002	4/12	320ms
Total Tests 12 Wrong Tests 8 Total Cost $0.002 Response Time (avg) 320ms
#385	Ling 2.6 Flash default	Inclusionai	9	0.5	$0.002	6/23	10.2s
Total Tests 23 Wrong Tests 17 Total Cost $0.002 Response Time (avg) 10.2s
#438	Drex v1.5 default	Nace AI	8	0.2	$0.002	4/12	986ms
Total Tests 12 Wrong Tests 8 Total Cost $0.002 Response Time (avg) 986ms
#451	Microsoft-Decision-1 default	Microsoft	11	0.1	$0.002	1/12	982ms
Total Tests 12 Wrong Tests 11 Total Cost $0.002 Response Time (avg) 982ms
#440	Kev 4B default	Jaredpalmer	9	0.2	$0.002	3/12	5.63s
Total Tests 12 Wrong Tests 9 Total Cost $0.002 Response Time (avg) 5.63s
#447	D1 default	Liquid	10	0.2	$0.003	2/12	508ms
Total Tests 12 Wrong Tests 10 Total Cost $0.003 Response Time (avg) 508ms
#433	d1-ultra default	Liquid	7	0.3	$0.003	4/12	531ms
Total Tests 12 Wrong Tests 8 Total Cost $0.003 Response Time (avg) 531ms
#450	Solar Decide Flash default	Upstage	4	0.2	$0.003	3/7	1.33s
Total Tests 7 Wrong Tests 4 Total Cost $0.003 Response Time (avg) 1.33s
#435	Jev 1.13 default	Typesafe	6	0.3	$0.003	6/12	698ms
Total Tests 12 Wrong Tests 6 Total Cost $0.003 Response Time (avg) 698ms
#441	Jev 1.14 default	Typesafe	7	0.2	$0.003	4/12	377ms
Total Tests 12 Wrong Tests 8 Total Cost $0.003 Response Time (avg) 377ms
#341	Ling 3.0 Flash none	Inclusionai	13	0.5	$0.004	6/23	3.40s
Total Tests 23 Wrong Tests 17 Total Cost $0.004 Response Time (avg) 3.40s
#428	Laguna Xs.2 default	Poolside	8	0.3	$0.004	5/19	806ms
Total Tests 19 Wrong Tests 14 Total Cost $0.004 Response Time (avg) 806ms
#439	GPT-6 Luna Decisions default	OpenAI	8	0.2	$0.005	3/12	495ms
Total Tests 12 Wrong Tests 9 Total Cost $0.005 Response Time (avg) 495ms

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)