Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one.

Models Shown

Total Failures

2144

Most Affected Model

Categories

In category Domain specific615 In category Anti-AI Tricks375 In category Coding340 In category Puzzle Solving267 In category Trivia230 In category Combined89 In category General Intelligence86 In category Instructions following78 In category Data parsing and extraction59 In category Tool Calling5

291/291

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#2	Gemini 3.7 Flash high	Google	2	9.8	$0.323	20/22	12.2s
Total Tests 22 Wrong Tests 2 Total Cost $0.323 Response Time (avg) 12.2s
#3	Gemini 3.6 Flash medium	Google	2	9.8	$0.427	20/22	11.9s
Total Tests 22 Wrong Tests 2 Total Cost $0.427 Response Time (avg) 11.9s
#5	Gemini 3 Flash Preview medium	Google	2	9.5	$0.763	20/22	19.9s
Total Tests 22 Wrong Tests 2 Total Cost $0.763 Response Time (avg) 19.9s
#6	Gemini 3.5 Flash high	Google	2	9.4	$2.011	19/22	15.5s
Total Tests 22 Wrong Tests 3 Total Cost $2.011 Response Time (avg) 15.5s
#7	Gemini 3.7 Flash medium	Google	2	9.4	$0.155	20/22	5.87s
Total Tests 22 Wrong Tests 2 Total Cost $0.155 Response Time (avg) 5.87s
#11	Grok 4.6 high	X AI	2	9.3	$1.908	19/22	84.1s
Total Tests 22 Wrong Tests 3 Total Cost $1.908 Response Time (avg) 84.1s
#12	Gemini 3.1 Pro Preview medium	Google	2	9.2	$1.352	20/22	20.6s
Total Tests 22 Wrong Tests 2 Total Cost $1.352 Response Time (avg) 20.6s
#13	Gemini 3.7 Flash low	Google	2	9.2	$0.104	20/22	3.85s
Total Tests 22 Wrong Tests 2 Total Cost $0.104 Response Time (avg) 3.85s
#14	Claude Opus 5 high	Anthropic	2	9.2	$3.070	18/22	22.5s
Total Tests 22 Wrong Tests 4 Total Cost $3.070 Response Time (avg) 22.5s
#21	Grok 4.5 high	X AI	2	9.0	$2.252	17/22	72.3s
Total Tests 22 Wrong Tests 5 Total Cost $2.252 Response Time (avg) 72.3s
#29	GLM 5.3 Flash max	Z.ai	2	8.7	$0.059	16/22	52.1s
Total Tests 22 Wrong Tests 6 Total Cost $0.059 Response Time (avg) 52.1s
#43	Qwen3.8 27B high	Qwen	2	8.4	~$0.287	16/22	167.9s
Total Tests 22 Wrong Tests 6 Total Cost ~$0.287 Response Time (avg) 167.9s
#56	GLM 5.2 high	Z.ai	2	8.0	$1.463	14/22	69.9s
Total Tests 22 Wrong Tests 8 Total Cost $1.463 Response Time (avg) 69.9s
#139	Gemma 4 26B A4B medium	Google	2	6.8	$0.092	15/22	104.9s
Total Tests 22 Wrong Tests 7 Total Cost $0.092 Response Time (avg) 104.9s
#172	Qwen3.5-35B-A3B medium	Qwen	2	6.1	$1.140	11/22	110.8s
Total Tests 22 Wrong Tests 11 Total Cost $1.140 Response Time (avg) 110.8s

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)