Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Response Time (avg) ↓.

Models Shown

Total Failures

2265

Most Affected Model

Granite 4.2 8B 6

Categories

In category Domain specific659 In category Anti-AI Tricks386 In category Coding361 In category Puzzle Solving275 In category Trivia246 In category Combined95 In category General Intelligence90 In category Instructions following82 In category Data parsing and extraction66 In category Tool Calling5

313/313

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#181	Mimo V2 PRO medium	Xiaomi	5	6.3	$0.333	12/21	22.2s
Total Tests 21 Wrong Tests 9 Total Cost $0.333 Response Time (avg) 22.2s
#122	KAT-Coder-Pro V2.5 high	Kwaipilot	10	7.2	$0.506	11/22	22.1s
Total Tests 22 Wrong Tests 11 Total Cost $0.506 Response Time (avg) 22.1s
#46	Qwen3.8 Max low	Qwen	5	8.6	$0.702	16/22	21.8s
Total Tests 22 Wrong Tests 6 Total Cost $0.702 Response Time (avg) 21.8s
#312	gpt-oss-120b none	OpenAI	8	3.7	$0.010	6/19	21.6s
Total Tests 19 Wrong Tests 13 Total Cost $0.010 Response Time (avg) 21.6s
#58	Gemini 2.5 Flash medium	Google	6	8.2	$0.644	15/22	21.1s
Total Tests 22 Wrong Tests 7 Total Cost $0.644 Response Time (avg) 21.1s
#189	gpt-oss-120b medium	OpenAI	9	6.1	$0.020	9/22	20.8s
Total Tests 22 Wrong Tests 13 Total Cost $0.020 Response Time (avg) 20.8s
#244	DeepSeek V4 Flash 0731 none	DeepSeek	13	5.4	$0.011	4/22	20.7s
Total Tests 22 Wrong Tests 18 Total Cost $0.011 Response Time (avg) 20.7s
#18	Gemini 3.1 Pro Preview medium	Google	2	9.2	$1.352	20/22	20.6s
Total Tests 22 Wrong Tests 2 Total Cost $1.352 Response Time (avg) 20.6s
#115	KAT-Coder-Pro V2.5 low	Kwaipilot	10	7.3	$0.400	11/22	20.2s
Total Tests 22 Wrong Tests 11 Total Cost $0.400 Response Time (avg) 20.2s
#182	MiMo-V2-Flash medium	Xiaomi	5	6.3	$0.043	12/21	20.1s
Total Tests 21 Wrong Tests 9 Total Cost $0.043 Response Time (avg) 20.1s
#10	Gemini 3 Flash Preview medium	Google	2	9.5	$0.763	20/22	19.9s
Total Tests 22 Wrong Tests 2 Total Cost $0.763 Response Time (avg) 19.9s
#42	Muse Spark 1.2 medium	Meta	3	8.6	$1.339	14/22	19.7s
Total Tests 22 Wrong Tests 8 Total Cost $1.339 Response Time (avg) 19.7s
#222	Kimi K2.6 none	Moonshot AI	12	5.7	$0.233	6/22	19.6s
Total Tests 22 Wrong Tests 16 Total Cost $0.233 Response Time (avg) 19.6s
#261	Qwen3.5-9B none	Qwen	14	5.1	$0.021	4/22	19.2s
Total Tests 22 Wrong Tests 18 Total Cost $0.021 Response Time (avg) 19.2s
#4	GPT-6 Astra high	OpenAI	1	9.9	$3.474	21/22	18.6s
Total Tests 22 Wrong Tests 1 Total Cost $3.474 Response Time (avg) 18.6s

←

1 9 10 11 21

→

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)