Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one.

Models Shown

Total Failures

3207

Most Affected Model

Categories

In category Domain specific907 In category Anti-AI Tricks521 In category Coding486 In category Puzzle Solving357 In category Trivia323 In category General Intelligence134 In category Combined131 In category Agentic128 In category Instructions following118 In category Data parsing and extraction93

453/453

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#363	KAT Coder AIR V2.5 low	Kwaipilot	7	0.5	$0.046	7/23	10.2s
Total Tests 23 Wrong Tests 16 Total Cost $0.046 Response Time (avg) 10.2s
#380	Granite 4.2 8B high	IBM Granite	7	0.5	$0.111	4/23	235.4s
Total Tests 23 Wrong Tests 19 Total Cost $0.111 Response Time (avg) 235.4s
#402	MiniMax M2.5 medium	Minimax	7	0.4	$0.440	5/23	102.3s
Total Tests 23 Wrong Tests 18 Total Cost $0.440 Response Time (avg) 102.3s
#431	Grok Build 0.1 none	X AI	7	0.3	$0.547	7/19	28.7s
Total Tests 19 Wrong Tests 12 Total Cost $0.547 Response Time (avg) 28.7s
#438	Nemotron 3 Nano Omni 30b A3b Reasoning medium	NVIDIA	7	0.3	$0.000	4/19	17.1s
Total Tests 19 Wrong Tests 15 Total Cost $0.000 Response Time (avg) 17.1s
#439	d1-ultra default	Liquid	7	0.3	$0.003	4/12	531ms
Total Tests 12 Wrong Tests 8 Total Cost $0.003 Response Time (avg) 531ms
#447	Jev 1.14 default	Typesafe	7	0.2	$0.003	4/12	377ms
Total Tests 12 Wrong Tests 8 Total Cost $0.003 Response Time (avg) 377ms
#64	Pareto 26.9 default	Unbiased	6	0.9	$1.864	15/23	28.3s
Total Tests 23 Wrong Tests 8 Total Cost $1.864 Response Time (avg) 28.3s
#78	DeepSeek V4.1 Flash max	DeepSeek	6	0.9	$1.204	15/23	61.6s
Total Tests 23 Wrong Tests 8 Total Cost $1.204 Response Time (avg) 61.6s
#106	Qwen3.7 Plus medium	Qwen	6	0.8	$0.415	16/23	59.7s
Total Tests 23 Wrong Tests 7 Total Cost $0.415 Response Time (avg) 59.7s
#112	Seed-2.0-Lite medium	Bytedance Seed	6	0.8	$0.271	14/23	48.9s
Total Tests 23 Wrong Tests 9 Total Cost $0.271 Response Time (avg) 48.9s
#117	DeepSeek V4 Flash 0423 high	DeepSeek	6	0.8	$0.261	14/23	56.0s
Total Tests 23 Wrong Tests 9 Total Cost $0.261 Response Time (avg) 56.0s
#123	Qwen3.8 Flash Next low	Qwen	6	0.8	~$0.045	15/23	23.7s
Total Tests 23 Wrong Tests 8 Total Cost ~$0.045 Response Time (avg) 23.7s
#128	GPT-5.4 Mini medium	OpenAI	6	0.8	$1.102	13/23	29.9s
Total Tests 23 Wrong Tests 10 Total Cost $1.102 Response Time (avg) 29.9s
#132	MiMo-V2.6-Flash medium	Xiaomi	6	0.8	$0.218	12/23	61.9s
Total Tests 23 Wrong Tests 11 Total Cost $0.218 Response Time (avg) 61.9s

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)