Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Failure Count ↑.

Models Shown

Total Failures

3190

Most Affected Model

Gemini 3.6 Flash 1

Categories

In category Domain specific900 In category Anti-AI Tricks521 In category Coding485 In category Puzzle Solving355 In category Trivia317 In category General Intelligence134 In category Combined130 In category Agentic128 In category Instructions following118 In category Data parsing and extraction93

447/447

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#37	Qwen3.8 Max (0902) high	Qwen	2	0.9	$3.306	18/23	186.1s
Total Tests 23 Wrong Tests 5 Total Cost $3.306 Response Time (avg) 186.1s
#39	Claude Haiku 5.5 xhigh	Anthropic	2	0.9	$0.140	18/23	16.6s
Total Tests 23 Wrong Tests 5 Total Cost $0.140 Response Time (avg) 16.6s
#45	Muse Spark Open xhigh	Meta	2	0.9	$2.081	16/23	92.4s
Total Tests 23 Wrong Tests 7 Total Cost $2.081 Response Time (avg) 92.4s
#53	GLM 5.3 Flash max	Z.ai	2	0.9	$0.089	17/23	54.0s
Total Tests 23 Wrong Tests 6 Total Cost $0.089 Response Time (avg) 54.0s
#66	Kimi K3.1 Pro max	Moonshot AI	2	0.9	$3.578	17/23	152.7s
Total Tests 23 Wrong Tests 6 Total Cost $3.578 Response Time (avg) 152.7s
#69	Qwen3.8 27B high	Qwen	2	0.9	~$0.298	17/23	166.3s
Total Tests 23 Wrong Tests 6 Total Cost ~$0.298 Response Time (avg) 166.3s
#88	Gemini 3.1 Pro Preview medium	Google	2	0.8	$1.585	20/23	22.7s
Total Tests 23 Wrong Tests 3 Total Cost $1.585 Response Time (avg) 22.7s
#95	Gemini 3.5 Flash high	Google	2	0.8	$2.737	19/23	18.6s
Total Tests 23 Wrong Tests 4 Total Cost $2.737 Response Time (avg) 18.6s
#116	Gemini 3.8 Flash medium	Google	2	0.8	$0.769	19/23	16.6s
Total Tests 23 Wrong Tests 4 Total Cost $0.769 Response Time (avg) 16.6s
#120	GLM 5.3 FlashX max	Z.ai	2	0.8	$0.623	15/23	44.0s
Total Tests 23 Wrong Tests 8 Total Cost $0.623 Response Time (avg) 44.0s
#127	Muse Wonder max	Meta	2	0.8	$4.766	16/23	44.4s
Total Tests 23 Wrong Tests 7 Total Cost $4.766 Response Time (avg) 44.4s
#128	Ling 3.1 Flash high	Inclusionai	2	0.8	$0.000	15/23	87.4s
Total Tests 23 Wrong Tests 8 Total Cost $0.000 Response Time (avg) 87.4s
#137	Muse Wonder high	Meta	2	0.8	$3.426	15/23	23.0s
Total Tests 23 Wrong Tests 8 Total Cost $3.426 Response Time (avg) 23.0s
#163	Gemma 4 26B A4B medium	Google	2	0.7	$0.101	16/23	105.0s
Total Tests 23 Wrong Tests 7 Total Cost $0.101 Response Time (avg) 105.0s
#199	Ember-1 high	Fireworks	2	0.7	$2.405	12/23	58.1s
Total Tests 23 Wrong Tests 11 Total Cost $2.405 Response Time (avg) 58.1s

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)