Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Failure Count ↑.

Models Shown

Total Failures

3190

Most Affected Model

Gemini 3.6 Flash 1

Categories

In category Domain specific900 In category Anti-AI Tricks521 In category Coding485 In category Puzzle Solving355 In category Trivia317 In category General Intelligence134 In category Combined130 In category Agentic128 In category Instructions following118 In category Data parsing and extraction93

447/447

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#280	Inkling none	Thinkingmachines	13	0.6	$0.292	7/23	5.30s
Total Tests 23 Wrong Tests 16 Total Cost $0.292 Response Time (avg) 5.30s
#294	Qwen3.6 Flash none	Qwen	13	0.6	$0.139	7/23	7.63s
Total Tests 23 Wrong Tests 16 Total Cost $0.139 Response Time (avg) 7.63s
#311	Space Bunny Alpha low	Stealth	13	0.6	$0.000	8/23	30.6s
Total Tests 23 Wrong Tests 15 Total Cost $0.000 Response Time (avg) 30.6s
#315	GLM 5 none	Z.ai	13	0.6	$0.140	9/22	8.74s
Total Tests 22 Wrong Tests 13 Total Cost $0.140 Response Time (avg) 8.74s
#319	Kimi K2.6 none	Moonshot AI	13	0.5	$0.486	6/23	26.3s
Total Tests 23 Wrong Tests 17 Total Cost $0.486 Response Time (avg) 26.3s
#321	Gemini 2.5 Flash none	Google	13	0.5	$0.017	8/23	6.00s
Total Tests 23 Wrong Tests 15 Total Cost $0.017 Response Time (avg) 6.00s
#322	GPT-6 Luna none	OpenAI	13	0.5	$0.026	7/23	20.5s
Total Tests 23 Wrong Tests 16 Total Cost $0.026 Response Time (avg) 20.5s
#329	Hy4 preview low	Tencent	13	0.5	$1.844	3/23	207.2s
Total Tests 23 Wrong Tests 20 Total Cost $1.844 Response Time (avg) 207.2s
#339	Qwen3.6 35B A3B none	Qwen	13	0.5	$0.105	4/23	8.43s
Total Tests 23 Wrong Tests 19 Total Cost $0.105 Response Time (avg) 8.43s
#341	Ling 3.0 Flash none	Inclusionai	13	0.5	$0.004	6/23	3.40s
Total Tests 23 Wrong Tests 17 Total Cost $0.004 Response Time (avg) 3.40s
#353	Mercury 2.5 Preview low	Inception	13	0.5	$0.015	6/23	4.92s
Total Tests 23 Wrong Tests 17 Total Cost $0.015 Response Time (avg) 4.92s
#371	Nemotron 3.5 Lightning medium	NVIDIA	13	0.5	$0.195	5/23	81.9s
Total Tests 23 Wrong Tests 18 Total Cost $0.195 Response Time (avg) 81.9s
#372	North Mini Code default	Cohere	13	0.5	$0.000	4/23	29.5s
Total Tests 23 Wrong Tests 19 Total Cost $0.000 Response Time (avg) 29.5s
#390	KAT Coder AIR V2.5 default	Kwaipilot	13	0.4	$0.070	5/23	12.0s
Total Tests 23 Wrong Tests 18 Total Cost $0.070 Response Time (avg) 12.0s
#399	GLM 5 Turbo none	Z.ai	13	0.4	$0.047	6/21	2.82s
Total Tests 21 Wrong Tests 15 Total Cost $0.047 Response Time (avg) 2.82s

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)