Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Failure Count ↑.

Models Shown

Total Failures

3190

Most Affected Model

Gemini 3.6 Flash 1

Categories

In category Domain specific900 In category Anti-AI Tricks521 In category Coding485 In category Puzzle Solving355 In category Trivia317 In category General Intelligence134 In category Combined130 In category Agentic128 In category Instructions following118 In category Data parsing and extraction93

447/447

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#218	GPT 5.3 Chat default	OpenAI	6	0.7	$0.533	13/23	6.31s
Total Tests 23 Wrong Tests 10 Total Cost $0.533 Response Time (avg) 6.31s
#228	Beam 1.0 501B A23B medium	Reflection	6	0.7	$0.499	14/23	6.27s
Total Tests 23 Wrong Tests 9 Total Cost $0.499 Response Time (avg) 6.27s
#232	Qwen3.6 35B A3B medium	Qwen	6	0.7	$0.834	12/23	59.9s
Total Tests 23 Wrong Tests 11 Total Cost $0.834 Response Time (avg) 59.9s
#233	Mercury 2.5 Preview high	Inception	6	0.6	$0.040	12/23	7.61s
Total Tests 23 Wrong Tests 11 Total Cost $0.040 Response Time (avg) 7.61s
#239	Grok 4.3 medium	X AI	6	0.6	$0.989	12/23	44.5s
Total Tests 23 Wrong Tests 11 Total Cost $0.989 Response Time (avg) 44.5s
#243	Beam 1.0 501B A23B max	Reflection	6	0.6	$0.799	12/23	11.1s
Total Tests 23 Wrong Tests 11 Total Cost $0.799 Response Time (avg) 11.1s
#244	Solar Pro 4 medium	Upstage	6	0.6	$0.098	12/23	133.9s
Total Tests 23 Wrong Tests 11 Total Cost $0.098 Response Time (avg) 133.9s
#248	Beam 1.0 501B A23B low	Reflection	6	0.6	$0.432	11/23	4.89s
Total Tests 23 Wrong Tests 12 Total Cost $0.432 Response Time (avg) 4.89s
#261	Solar Pro 4 high	Upstage	6	0.6	$0.077	11/23	128.9s
Total Tests 23 Wrong Tests 12 Total Cost $0.077 Response Time (avg) 128.9s
#266	DeepSeek V3.2 medium	DeepSeek	6	0.6	$0.152	11/23	70.1s
Total Tests 23 Wrong Tests 12 Total Cost $0.152 Response Time (avg) 70.1s
#289	Inkling Small medium	Thinkingmachines	6	0.6	$0.113	10/23	6.03s
Total Tests 23 Wrong Tests 13 Total Cost $0.113 Response Time (avg) 6.03s
#303	Ring 2.6 1t medium	Inclusionai	6	0.6	$0.102	11/23	65.5s
Total Tests 23 Wrong Tests 12 Total Cost $0.102 Response Time (avg) 65.5s
#318	Nemotron 3 Super medium	NVIDIA	6	0.6	$0.081	8/23	56.4s
Total Tests 23 Wrong Tests 15 Total Cost $0.081 Response Time (avg) 56.4s
#331	Step 3.5 Flash medium	Stepfun	6	0.5	$0.105	10/22	190.5s
Total Tests 22 Wrong Tests 12 Total Cost $0.105 Response Time (avg) 190.5s
#354	MiniMax M2.7 medium	Minimax	6	0.5	$0.326	5/23	50.3s
Total Tests 23 Wrong Tests 18 Total Cost $0.326 Response Time (avg) 50.3s

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)