Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Total Cost ↑.

Models Shown

Total Failures

3190

Most Affected Model

Ling 3.1 Flash 3

Categories

In category Domain specific900 In category Anti-AI Tricks521 In category Coding485 In category Puzzle Solving355 In category Trivia317 In category General Intelligence134 In category Combined130 In category Agentic128 In category Instructions following118 In category Data parsing and extraction93

447/447

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#204	Kimi K2.6 medium	Moonshot AI	4	0.7	$1.594	12/23	121.3s
Total Tests 23 Wrong Tests 11 Total Cost $1.594 Response Time (avg) 121.3s
#22	GPT-5.6 Sol high	OpenAI	4	0.9	$1.595	19/23	13.6s
Total Tests 23 Wrong Tests 4 Total Cost $1.595 Response Time (avg) 13.6s
#44	Muse Wonder minimal	Meta	3	0.9	$1.639	17/23	7.72s
Total Tests 23 Wrong Tests 6 Total Cost $1.639 Response Time (avg) 7.72s
#29	Seed 2.1 Turbo low	Bytedance Seed	3	0.9	$1.645	18/23	161.2s
Total Tests 23 Wrong Tests 5 Total Cost $1.645 Response Time (avg) 161.2s
#107	Kimi K3.1 Pro high	Moonshot AI	5	0.8	$1.646	16/23	54.3s
Total Tests 23 Wrong Tests 7 Total Cost $1.646 Response Time (avg) 54.3s
#57	Muse Spark 1.1 medium	Meta	4	0.9	$1.665	16/23	27.0s
Total Tests 23 Wrong Tests 7 Total Cost $1.665 Response Time (avg) 27.0s
#82	Qwen3.7 Max medium	Qwen	5	0.9	$1.689	17/23	48.4s
Total Tests 23 Wrong Tests 6 Total Cost $1.689 Response Time (avg) 48.4s
#20	GPT-5.6 Sol medium	OpenAI	4	0.9	$1.700	19/23	14.6s
Total Tests 23 Wrong Tests 4 Total Cost $1.700 Response Time (avg) 14.6s
#48	Muse Spark 1.3 medium	Meta	4	0.9	$1.712	18/23	39.8s
Total Tests 23 Wrong Tests 5 Total Cost $1.712 Response Time (avg) 39.8s
#24	Claude Opus 5.5 low	Anthropic	2	0.9	$1.733	19/23	25.7s
Total Tests 23 Wrong Tests 4 Total Cost $1.733 Response Time (avg) 25.7s
#276	Gemini 3.5 Flash none	Google	4	0.6	$1.752	14/23	14.1s
Total Tests 23 Wrong Tests 9 Total Cost $1.752 Response Time (avg) 14.1s
#30	Muse Spark Open high	Meta	2	0.9	$1.782	17/23	152.0s
Total Tests 23 Wrong Tests 6 Total Cost $1.782 Response Time (avg) 152.0s
#17	Gemini 4 Argon high	Google	1	1.0	$1.802	21/23	19.0s
Total Tests 23 Wrong Tests 2 Total Cost $1.802 Response Time (avg) 19.0s
#31	Claude Opus 5.5 medium	Anthropic	2	0.9	$1.804	20/23	25.9s
Total Tests 23 Wrong Tests 3 Total Cost $1.804 Response Time (avg) 25.9s
#23	GPT-5.5 low	OpenAI	3	0.9	$1.822	20/23	11.9s
Total Tests 23 Wrong Tests 3 Total Cost $1.822 Response Time (avg) 11.9s

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)