Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Tests Correct ↓.

Models Shown

Total Failures

3190

Most Affected Model

Gemini 3.6 Flash 1

Categories

In category Domain specific900 In category Anti-AI Tricks521 In category Coding485 In category Puzzle Solving355 In category Trivia317 In category General Intelligence134 In category Combined130 In category Agentic128 In category Instructions following118 In category Data parsing and extraction93

447/447

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#199	Ember-1 high	Fireworks	2	0.7	$2.405	12/23	58.1s
Total Tests 23 Wrong Tests 11 Total Cost $2.405 Response Time (avg) 58.1s
#204	Kimi K2.6 medium	Moonshot AI	4	0.7	$1.594	12/23	121.3s
Total Tests 23 Wrong Tests 11 Total Cost $1.594 Response Time (avg) 121.3s
#205	Qwen3.5-Flash medium	Qwen	5	0.7	$0.184	12/23	83.7s
Total Tests 23 Wrong Tests 11 Total Cost $0.184 Response Time (avg) 83.7s
#210	Solar Pro 4 xhigh	Upstage	5	0.7	$0.067	12/23	142.8s
Total Tests 23 Wrong Tests 11 Total Cost $0.067 Response Time (avg) 142.8s
#219	GPT-5.6 Sol none	OpenAI	10	0.7	$0.795	12/23	4.61s
Total Tests 23 Wrong Tests 11 Total Cost $0.795 Response Time (avg) 4.61s
#222	GPT-5.5 none	OpenAI	11	0.7	$1.212	12/23	4.75s
Total Tests 23 Wrong Tests 11 Total Cost $1.212 Response Time (avg) 4.75s
#232	Qwen3.6 35B A3B medium	Qwen	6	0.7	$0.834	12/23	59.9s
Total Tests 23 Wrong Tests 11 Total Cost $0.834 Response Time (avg) 59.9s
#233	Mercury 2.5 Preview high	Inception	6	0.6	$0.040	12/23	7.61s
Total Tests 23 Wrong Tests 11 Total Cost $0.040 Response Time (avg) 7.61s
#234	Mercury 2.5 high	Inception	9	0.6	$0.044	12/23	7.62s
Total Tests 23 Wrong Tests 11 Total Cost $0.044 Response Time (avg) 7.62s
#235	Beam 1.0 501B A23B xhigh	Reflection	8	0.6	$0.688	12/23	9.18s
Total Tests 23 Wrong Tests 11 Total Cost $0.688 Response Time (avg) 9.18s
#236	GLM 5.3 low	Z.ai	8	0.6	$0.215	12/23	15.2s
Total Tests 23 Wrong Tests 11 Total Cost $0.215 Response Time (avg) 15.2s
#239	Grok 4.3 medium	X AI	6	0.6	$0.989	12/23	44.5s
Total Tests 23 Wrong Tests 11 Total Cost $0.989 Response Time (avg) 44.5s
#243	Beam 1.0 501B A23B max	Reflection	6	0.6	$0.799	12/23	11.1s
Total Tests 23 Wrong Tests 11 Total Cost $0.799 Response Time (avg) 11.1s
#244	Solar Pro 4 medium	Upstage	6	0.6	$0.098	12/23	133.9s
Total Tests 23 Wrong Tests 11 Total Cost $0.098 Response Time (avg) 133.9s
#249	Mercury 2.5 medium	Inception	9	0.6	$0.034	12/23	7.74s
Total Tests 23 Wrong Tests 11 Total Cost $0.034 Response Time (avg) 7.74s

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)