Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Failure Count ↑.

Models Shown

Total Failures

3190

Most Affected Model

Gemini 3.6 Flash 1

Categories

In category Domain specific900 In category Anti-AI Tricks521 In category Coding485 In category Puzzle Solving355 In category Trivia317 In category General Intelligence134 In category Combined130 In category Agentic128 In category Instructions following118 In category Data parsing and extraction93

447/447

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#215	Grok 4.7 high	X AI	2	0.7	$3.037	13/23	122.2s
Total Tests 23 Wrong Tests 10 Total Cost $3.037 Response Time (avg) 122.2s
#263	Ling 3.1 Flash low	Inclusionai	2	0.6	$0.000	12/23	85.2s
Total Tests 23 Wrong Tests 11 Total Cost $0.000 Response Time (avg) 85.2s
#314	Step 5 Preview low	Stepfun	2	0.6	$4.110	10/23	138.3s
Total Tests 23 Wrong Tests 13 Total Cost $4.110 Response Time (avg) 138.3s
#395	Gemini 3.1 Flash Lite Preview high	Google	2	0.4	$2.310	13/16	68.1s
Total Tests 16 Wrong Tests 3 Total Cost $2.310 Response Time (avg) 68.1s
#401	Qwen3.6 Plus Preview medium	Qwen	2	0.4	$0.000	9/19	15.2s
Total Tests 19 Wrong Tests 10 Total Cost $0.000 Response Time (avg) 15.2s
#402	Qwen3.5-9B medium	Qwen	2	0.4	$0.106	3/23	110.2s
Total Tests 23 Wrong Tests 20 Total Cost $0.106 Response Time (avg) 110.2s
#21	GPT-6 Astra medium	OpenAI	3	0.9	$2.707	20/23	9.90s
Total Tests 23 Wrong Tests 3 Total Cost $2.707 Response Time (avg) 9.90s
#23	GPT-5.5 low	OpenAI	3	0.9	$1.822	20/23	11.9s
Total Tests 23 Wrong Tests 3 Total Cost $1.822 Response Time (avg) 11.9s
#28	Claude Opus 5 medium	Anthropic	3	0.9	$2.870	19/23	13.2s
Total Tests 23 Wrong Tests 4 Total Cost $2.870 Response Time (avg) 13.2s
#29	Seed 2.1 Turbo low	Bytedance Seed	3	0.9	$1.645	18/23	161.2s
Total Tests 23 Wrong Tests 5 Total Cost $1.645 Response Time (avg) 161.2s
#40	Muse Spark 1.3 high	Meta	3	0.9	$1.891	17/23	52.9s
Total Tests 23 Wrong Tests 6 Total Cost $1.891 Response Time (avg) 52.9s
#42	Pareto default	Unbiased	3	0.9	$1.520	19/23	33.5s
Total Tests 23 Wrong Tests 4 Total Cost $1.520 Response Time (avg) 33.5s
#44	Muse Wonder minimal	Meta	3	0.9	$1.639	17/23	7.72s
Total Tests 23 Wrong Tests 6 Total Cost $1.639 Response Time (avg) 7.72s
#46	Gemini 3.5 Flash low	Google	3	0.9	$0.752	19/23	7.85s
Total Tests 23 Wrong Tests 4 Total Cost $0.752 Response Time (avg) 7.85s
#56	Muse Spark 1.2 medium	Meta	3	0.9	$1.590	15/23	21.3s
Total Tests 23 Wrong Tests 8 Total Cost $1.590 Response Time (avg) 21.3s

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)