Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Failure Count ↑.

Models Shown

Total Failures

3190

Most Affected Model

Gemini 3.6 Flash 1

Categories

In category Domain specific900 In category Anti-AI Tricks521 In category Coding485 In category Puzzle Solving355 In category Trivia317 In category General Intelligence134 In category Combined130 In category Agentic128 In category Instructions following118 In category Data parsing and extraction93

447/447

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#407	Ling 3.0 Tiny default	Inclusionai	13	0.4	$0.000	2/23	13.4s
Total Tests 23 Wrong Tests 21 Total Cost $0.000 Response Time (avg) 13.4s
#408	Granite 4.1 8b default	IBM Granite	13	0.4	$0.007	2/23	1.38s
Total Tests 23 Wrong Tests 21 Total Cost $0.007 Response Time (avg) 1.38s
#423	MiMo-V2-Flash default	Xiaomi	13	0.3	$0.025	4/21	2.76s
Total Tests 21 Wrong Tests 17 Total Cost $0.025 Response Time (avg) 2.76s
#424	Xing4.0 29b A4b none	Xingchen AGI	13	0.3	$0.000	0/23	42.7s
Total Tests 23 Wrong Tests 23 Total Cost $0.000 Response Time (avg) 42.7s
#427	Grok 4.1 Fast default	X AI	13	0.3	$0.008	3/19	1.62s
Total Tests 19 Wrong Tests 16 Total Cost $0.008 Response Time (avg) 1.62s
#213	Qwen3.5-Flash none	Qwen	14	0.7	$0.089	8/23	26.5s
Total Tests 23 Wrong Tests 15 Total Cost $0.089 Response Time (avg) 26.5s
#290	Seed-2.0-Lite none	Bytedance Seed	14	0.6	$0.114	8/23	7.49s
Total Tests 23 Wrong Tests 15 Total Cost $0.114 Response Time (avg) 7.49s
#297	Qwen3.7 Flash none	Qwen	14	0.6	$0.028	7/23	14.7s
Total Tests 23 Wrong Tests 16 Total Cost $0.028 Response Time (avg) 14.7s
#298	Qwen3.8 Flash Next none	Qwen	14	0.6	~$0.011	8/23	5.71s
Total Tests 23 Wrong Tests 15 Total Cost ~$0.011 Response Time (avg) 5.71s
#299	DeepSeek V4.1 Flash 1017 none	DeepSeek	14	0.6	$0.055	8/23	3.46s
Total Tests 23 Wrong Tests 15 Total Cost $0.055 Response Time (avg) 3.46s
#306	GPT-5.4 Mini none	OpenAI	14	0.6	$0.170	6/23	3.34s
Total Tests 23 Wrong Tests 17 Total Cost $0.170 Response Time (avg) 3.34s
#313	Solar Pro 4 none	Upstage	14	0.6	$0.022	7/23	8.14s
Total Tests 23 Wrong Tests 16 Total Cost $0.022 Response Time (avg) 8.14s
#316	Qwen3.5-35B-A3B none	Qwen	14	0.6	$0.120	6/23	18.3s
Total Tests 23 Wrong Tests 17 Total Cost $0.120 Response Time (avg) 18.3s
#338	Laguna XS 2.1 none	Poolside	14	0.5	$0.020	5/23	4.56s
Total Tests 23 Wrong Tests 18 Total Cost $0.020 Response Time (avg) 4.56s
#346	Mistral Small 4 medium	Mistral	14	0.5	$0.126	5/23	12.7s
Total Tests 23 Wrong Tests 18 Total Cost $0.126 Response Time (avg) 12.7s

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)