Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Score ↓.

Models Shown

Total Failures

3190

Most Affected Model

Gemini 3.6 Flash 1

Categories

In category Domain specific900 In category Anti-AI Tricks521 In category Coding485 In category Puzzle Solving355 In category Trivia317 In category General Intelligence134 In category Combined130 In category Agentic128 In category Instructions following118 In category Data parsing and extraction93

447/447

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#125	Qwen3.8 2.4T A95B high	Qwen	4	0.8	$2.949	15/23	120.9s
Total Tests 23 Wrong Tests 8 Total Cost $2.949 Response Time (avg) 120.9s
#126	MiMo-V2.6-Flash medium	Xiaomi	6	0.8	$0.218	12/23	61.9s
Total Tests 23 Wrong Tests 11 Total Cost $0.218 Response Time (avg) 61.9s
#127	Muse Wonder max	Meta	2	0.8	$4.766	16/23	44.4s
Total Tests 23 Wrong Tests 7 Total Cost $4.766 Response Time (avg) 44.4s
#128	Ling 3.1 Flash high	Inclusionai	2	0.8	$0.000	15/23	87.4s
Total Tests 23 Wrong Tests 8 Total Cost $0.000 Response Time (avg) 87.4s
#129	DeepSeek V4.1 Flash 1017 high	DeepSeek	5	0.8	$0.589	13/23	58.6s
Total Tests 23 Wrong Tests 10 Total Cost $0.589 Response Time (avg) 58.6s
#130	Grok 4.5 medium	X AI	6	0.8	$2.996	17/23	68.4s
Total Tests 23 Wrong Tests 6 Total Cost $2.996 Response Time (avg) 68.4s
#131	GLM 5.3 high	Z.ai	6	0.8	$0.495	14/23	28.4s
Total Tests 23 Wrong Tests 9 Total Cost $0.495 Response Time (avg) 28.4s
#132	Step 3.7 Flash medium	Stepfun	6	0.8	$0.571	13/23	26.6s
Total Tests 23 Wrong Tests 10 Total Cost $0.571 Response Time (avg) 26.6s
#133	Grok 4.6 medium	X AI	6	0.8	$2.270	16/23	74.8s
Total Tests 23 Wrong Tests 7 Total Cost $2.270 Response Time (avg) 74.8s
#134	Qwen3.7 Plus none	Qwen	9	0.8	$0.178	13/23	17.8s
Total Tests 23 Wrong Tests 10 Total Cost $0.178 Response Time (avg) 17.8s
#135	Grok 4.5 low	X AI	7	0.8	$1.345	16/23	18.1s
Total Tests 23 Wrong Tests 7 Total Cost $1.345 Response Time (avg) 18.1s
#136	DeepSeek V4 Flash 0731 medium	DeepSeek	5	0.8	$0.460	12/23	94.2s
Total Tests 23 Wrong Tests 11 Total Cost $0.460 Response Time (avg) 94.2s
#137	Muse Wonder high	Meta	2	0.8	$3.426	15/23	23.0s
Total Tests 23 Wrong Tests 8 Total Cost $3.426 Response Time (avg) 23.0s
#138	GPT-6 Luna high	OpenAI	6	0.8	$0.074	15/23	20.4s
Total Tests 23 Wrong Tests 8 Total Cost $0.074 Response Time (avg) 20.4s
#139	Muse Glimmer 30B high	Meta	7	0.8	$0.506	11/23	69.9s
Total Tests 23 Wrong Tests 12 Total Cost $0.506 Response Time (avg) 69.9s

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)