Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Response Time (avg) ↑.

Models Shown

Total Failures

3190

Most Affected Model

Decider V1.1 27B 8

Categories

In category Domain specific900 In category Anti-AI Tricks521 In category Coding485 In category Puzzle Solving355 In category Trivia317 In category General Intelligence134 In category Combined130 In category Agentic128 In category Instructions following118 In category Data parsing and extraction93

447/447

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#423	MiMo-V2-Flash default	Xiaomi	13	0.3	$0.025	4/21	2.76s
Total Tests 21 Wrong Tests 17 Total Cost $0.025 Response Time (avg) 2.76s
#399	GLM 5 Turbo none	Z.ai	13	0.4	$0.047	6/21	2.82s
Total Tests 21 Wrong Tests 15 Total Cost $0.047 Response Time (avg) 2.82s
#391	Trinity Large Preview default	Arcee AI	12	0.4	$0.008	4/22	2.83s
Total Tests 22 Wrong Tests 18 Total Cost $0.008 Response Time (avg) 2.83s
#415	Laguna M.1 default	Poolside	10	0.4	$0.009	4/19	2.89s
Total Tests 19 Wrong Tests 15 Total Cost $0.009 Response Time (avg) 2.89s
#379	GLM 5V Turbo none	Z.ai	11	0.5	$0.052	8/21	2.99s
Total Tests 21 Wrong Tests 13 Total Cost $0.052 Response Time (avg) 2.99s
#326	Claude Opus 4.7 none	Anthropic	3	0.5	$0.505	16/19	3.02s
Total Tests 19 Wrong Tests 3 Total Cost $0.505 Response Time (avg) 3.02s
#347	Mistral Small 4 none	Mistral	17	0.5	$0.047	5/23	3.12s
Total Tests 23 Wrong Tests 18 Total Cost $0.047 Response Time (avg) 3.12s
#348	Mercury 2.5 low	Inception	14	0.5	$0.020	6/23	3.34s
Total Tests 23 Wrong Tests 17 Total Cost $0.020 Response Time (avg) 3.34s
#306	GPT-5.4 Mini none	OpenAI	14	0.6	$0.170	6/23	3.34s
Total Tests 23 Wrong Tests 17 Total Cost $0.170 Response Time (avg) 3.34s
#341	Ling 3.0 Flash none	Inclusionai	13	0.5	$0.004	6/23	3.40s
Total Tests 23 Wrong Tests 17 Total Cost $0.004 Response Time (avg) 3.40s
#299	DeepSeek V4.1 Flash 1017 none	DeepSeek	14	0.6	$0.055	8/23	3.46s
Total Tests 23 Wrong Tests 15 Total Cost $0.055 Response Time (avg) 3.46s
#293	Gemini 3.1 Flash Lite none	Google	12	0.6	$0.069	9/23	3.58s
Total Tests 23 Wrong Tests 14 Total Cost $0.069 Response Time (avg) 3.58s
#274	Gemini 3.1 Flash Lite Preview none	Google	8	0.6	$0.090	12/23	3.60s
Total Tests 23 Wrong Tests 11 Total Cost $0.090 Response Time (avg) 3.60s
#334	GPT-5.6 Luna none	OpenAI	15	0.5	$0.042	6/23	3.78s
Total Tests 23 Wrong Tests 17 Total Cost $0.042 Response Time (avg) 3.78s
#312	GPT-5.4 none	OpenAI	15	0.6	$0.690	7/23	3.89s
Total Tests 23 Wrong Tests 16 Total Cost $0.690 Response Time (avg) 3.89s

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)