Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Total Cost ↓.

Models Shown

Total Failures

2144

Most Affected Model

Grok 4.20 Multi Agent Beta 4

Categories

In category Domain specific615 In category Anti-AI Tricks375 In category Coding340 In category Puzzle Solving267 In category Trivia230 In category Combined89 In category General Intelligence86 In category Instructions following78 In category Data parsing and extraction59 In category Tool Calling5

291/291

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#288	gpt-oss-120b none	OpenAI	8	3.7	$0.010	6/19	21.6s
Total Tests 19 Wrong Tests 13 Total Cost $0.010 Response Time (avg) 21.6s
#227	DeepSeek V4 Flash 0731 none	DeepSeek	13	5.4	$0.009	4/22	20.7s
Total Tests 22 Wrong Tests 18 Total Cost $0.009 Response Time (avg) 20.7s
#269	Laguna M.1 none	Poolside	10	4.4	$0.009	4/19	2.89s
Total Tests 19 Wrong Tests 15 Total Cost $0.009 Response Time (avg) 2.89s
#251	Nemotron 3 Super none	NVIDIA	15	4.8	$0.008	5/22	6.04s
Total Tests 22 Wrong Tests 17 Total Cost $0.008 Response Time (avg) 6.04s
#259	Trinity Large Preview none	Arcee AI	12	4.8	$0.008	4/21	2.98s
Total Tests 21 Wrong Tests 17 Total Cost $0.008 Response Time (avg) 2.98s
#284	Grok 4.1 Fast none	X AI	13	3.8	$0.008	3/19	1.62s
Total Tests 19 Wrong Tests 16 Total Cost $0.008 Response Time (avg) 1.62s
#230	Laguna XS 2.1 none	Poolside	14	5.3	$0.008	5/22	1.55s
Total Tests 22 Wrong Tests 17 Total Cost $0.008 Response Time (avg) 1.55s
#276	Hy3 preview none	Tencent	8	4.0	$0.007	4/21	12.9s
Total Tests 21 Wrong Tests 17 Total Cost $0.007 Response Time (avg) 12.9s
#280	Nemotron 3.5 Lightning none	NVIDIA	16	4.0	$0.007	3/22	1.21s
Total Tests 22 Wrong Tests 19 Total Cost $0.007 Response Time (avg) 1.21s
#279	Granite 4.1 8B none	IBM Granite	13	4.0	$0.007	2/22	1.44s
Total Tests 22 Wrong Tests 20 Total Cost $0.007 Response Time (avg) 1.44s
#219	Qwen3.8 27B none	Qwen	11	5.5	~$0.006	9/22	3.12s
Total Tests 22 Wrong Tests 13 Total Cost ~$0.006 Response Time (avg) 3.12s
#199	Solar Pro 4 none	Upstage	14	5.8	$0.006	7/22	5.37s
Total Tests 22 Wrong Tests 15 Total Cost $0.006 Response Time (avg) 5.37s
#287	Laguna Xs.2 none	Poolside	8	3.8	$0.004	5/19	806ms
Total Tests 19 Wrong Tests 14 Total Cost $0.004 Response Time (avg) 806ms
#204	Ling-3.0-flash none	Inclusionai	13	5.7	$0.004	6/22	3.56s
Total Tests 22 Wrong Tests 16 Total Cost $0.004 Response Time (avg) 3.56s
#250	Ling-2.6-flash none	Inclusionai	9	4.9	$0.002	6/22	10.7s
Total Tests 22 Wrong Tests 16 Total Cost $0.002 Response Time (avg) 10.7s

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)