Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Failure Count ↑.

Models Shown

Total Failures

2265

Most Affected Model

Gemini 3.6 Flash 1

Categories

In category Domain specific659 In category Anti-AI Tricks386 In category Coding361 In category Puzzle Solving275 In category Trivia246 In category Combined95 In category General Intelligence90 In category Instructions following82 In category Data parsing and extraction66 In category Tool Calling5

313/313

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#183	Seed-2.0-Lite none	Bytedance Seed	13	6.2	$0.066	8/22	4.37s
Total Tests 22 Wrong Tests 14 Total Cost $0.066 Response Time (avg) 4.37s
#190	Qwen3.7 Flash none	Qwen	13	6.1	$0.019	7/22	10.1s
Total Tests 22 Wrong Tests 15 Total Cost $0.019 Response Time (avg) 10.1s
#200	Gemini 2.5 Flash none	Google	13	6.0	$0.017	8/22	6.19s
Total Tests 22 Wrong Tests 14 Total Cost $0.017 Response Time (avg) 6.19s
#206	Qwen3.5-35B-A3B none	Qwen	13	5.9	$0.076	6/22	12.7s
Total Tests 22 Wrong Tests 16 Total Cost $0.076 Response Time (avg) 12.7s
#212	GPT-5.4 Mini none	OpenAI	13	5.9	$0.095	6/22	1.58s
Total Tests 22 Wrong Tests 16 Total Cost $0.095 Response Time (avg) 1.58s
#220	Ling-3.0-flash none	Inclusionai	13	5.7	$0.004	6/22	3.56s
Total Tests 22 Wrong Tests 16 Total Cost $0.004 Response Time (avg) 3.56s
#223	Qwen3.5-122B-A10B none	Qwen	13	5.7	$0.283	6/22	12.9s
Total Tests 22 Wrong Tests 16 Total Cost $0.283 Response Time (avg) 12.9s
#238	DeepSeek V4 Flash 0423 none	DeepSeek	13	5.4	$0.039	4/22	36.2s
Total Tests 22 Wrong Tests 18 Total Cost $0.039 Response Time (avg) 36.2s
#239	Laguna S 2.1 medium	Poolside	13	5.4	$0.053	4/22	58.4s
Total Tests 22 Wrong Tests 18 Total Cost $0.053 Response Time (avg) 58.4s
#244	DeepSeek V4 Flash 0731 none	DeepSeek	13	5.4	$0.011	4/22	20.7s
Total Tests 22 Wrong Tests 18 Total Cost $0.011 Response Time (avg) 20.7s
#251	Qwen3.6 35B A3B none	Qwen	13	5.3	$0.051	4/22	5.57s
Total Tests 22 Wrong Tests 18 Total Cost $0.051 Response Time (avg) 5.57s
#253	Inkling none	Thinkingmachines	13	5.2	$0.147	6/22	3.47s
Total Tests 22 Wrong Tests 16 Total Cost $0.147 Response Time (avg) 3.47s
#255	Nemotron 3.5 Lightning medium	NVIDIA	13	5.1	$0.156	5/22	70.1s
Total Tests 22 Wrong Tests 17 Total Cost $0.156 Response Time (avg) 70.1s
#257	Mistral Small 4 medium	Mistral	13	5.1	$0.097	5/22	10.8s
Total Tests 22 Wrong Tests 17 Total Cost $0.097 Response Time (avg) 10.8s
#262	GLM 5 Turbo none	Z.ai	13	5.1	$0.047	6/21	2.82s
Total Tests 21 Wrong Tests 15 Total Cost $0.047 Response Time (avg) 2.82s

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)