Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Tests Correct ↓.

Models Shown

Total Failures

3190

Most Affected Model

Gemini 3.6 Flash 1

Categories

In category Domain specific900 In category Anti-AI Tricks521 In category Coding485 In category Puzzle Solving355 In category Trivia317 In category General Intelligence134 In category Combined130 In category Agentic128 In category Instructions following118 In category Data parsing and extraction93

447/447

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#44	Muse Wonder minimal	Meta	3	0.9	$1.639	17/23	7.72s
Total Tests 23 Wrong Tests 6 Total Cost $1.639 Response Time (avg) 7.72s
#53	GLM 5.3 Flash max	Z.ai	2	0.9	$0.089	17/23	54.0s
Total Tests 23 Wrong Tests 6 Total Cost $0.089 Response Time (avg) 54.0s
#60	Kimi K3.1 Pro low	Moonshot AI	5	0.9	$1.836	17/23	47.5s
Total Tests 23 Wrong Tests 6 Total Cost $1.836 Response Time (avg) 47.5s
#61	Qwen3.8 MAX low	Qwen	5	0.9	$1.089	17/23	25.1s
Total Tests 23 Wrong Tests 6 Total Cost $1.089 Response Time (avg) 25.1s
#66	Kimi K3.1 Pro max	Moonshot AI	2	0.9	$3.578	17/23	152.7s
Total Tests 23 Wrong Tests 6 Total Cost $3.578 Response Time (avg) 152.7s
#69	Qwen3.8 27B high	Qwen	2	0.9	~$0.298	17/23	166.3s
Total Tests 23 Wrong Tests 6 Total Cost ~$0.298 Response Time (avg) 166.3s
#82	Qwen3.7 Max medium	Qwen	5	0.9	$1.689	17/23	48.4s
Total Tests 23 Wrong Tests 6 Total Cost $1.689 Response Time (avg) 48.4s
#98	Claude Opus 4.8 medium	Anthropic	5	0.8	$3.490	17/23	16.7s
Total Tests 23 Wrong Tests 6 Total Cost $3.490 Response Time (avg) 16.7s
#103	Grok 4.5 high	X AI	3	0.8	$2.687	17/23	72.5s
Total Tests 23 Wrong Tests 6 Total Cost $2.687 Response Time (avg) 72.5s
#130	Grok 4.5 medium	X AI	6	0.8	$2.996	17/23	68.4s
Total Tests 23 Wrong Tests 6 Total Cost $2.996 Response Time (avg) 68.4s
#104	GLM 5.2 medium	Z.ai	3	0.8	$1.007	16/22	26.9s
Total Tests 22 Wrong Tests 6 Total Cost $1.007 Response Time (avg) 26.9s
#36	DeepSeek V4.1 Flash 1017 low	DeepSeek	5	0.9	$0.355	16/23	32.5s
Total Tests 23 Wrong Tests 7 Total Cost $0.355 Response Time (avg) 32.5s
#45	Muse Spark Open xhigh	Meta	2	0.9	$2.081	16/23	92.4s
Total Tests 23 Wrong Tests 7 Total Cost $2.081 Response Time (avg) 92.4s
#54	Muse Spark Open low	Meta	4	0.9	$0.600	16/23	21.6s
Total Tests 23 Wrong Tests 7 Total Cost $0.600 Response Time (avg) 21.6s
#57	Muse Spark 1.1 medium	Meta	4	0.9	$1.665	16/23	27.0s
Total Tests 23 Wrong Tests 7 Total Cost $1.665 Response Time (avg) 27.0s

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)