Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Total Cost ↓.

Models Shown

Total Failures

2144

Most Affected Model

Grok 4.20 Multi Agent Beta 4

Categories

In category Domain specific615 In category Anti-AI Tricks375 In category Coding340 In category Puzzle Solving267 In category Trivia230 In category Combined89 In category General Intelligence86 In category Instructions following78 In category Data parsing and extraction59 In category Tool Calling5

291/291

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#128	Seed-2.0-Code high	Bytedance Seed	4	6.9	$1.273	11/22	124.2s
Total Tests 22 Wrong Tests 11 Total Cost $1.273 Response Time (avg) 124.2s
#10	GPT-5.5 low	OpenAI	3	9.3	$1.257	19/22	10.1s
Total Tests 22 Wrong Tests 3 Total Cost $1.257 Response Time (avg) 10.1s
#107	Kimi K2.6 medium	Moonshot AI	3	7.2	$1.247	12/22	115.9s
Total Tests 22 Wrong Tests 10 Total Cost $1.247 Response Time (avg) 115.9s
#131	Step 3.7 Flash high	Stepfun	7	6.8	$1.229	11/22	70.1s
Total Tests 22 Wrong Tests 11 Total Cost $1.229 Response Time (avg) 70.1s
#42	GPT-5.2 medium	OpenAI	3	8.4	$1.182	14/22	28.5s
Total Tests 22 Wrong Tests 8 Total Cost $1.182 Response Time (avg) 28.5s
#106	Claude Opus 4.8 none	Anthropic	4	7.3	$1.166	13/22	4.92s
Total Tests 22 Wrong Tests 9 Total Cost $1.166 Response Time (avg) 4.92s
#17	Qwen3.7 Max medium	Qwen	4	9.1	$1.157	17/22	44.3s
Total Tests 22 Wrong Tests 5 Total Cost $1.157 Response Time (avg) 44.3s
#132	Seed-2.0-Code medium	Bytedance Seed	4	6.8	$1.153	10/22	101.1s
Total Tests 22 Wrong Tests 12 Total Cost $1.153 Response Time (avg) 101.1s
#172	Qwen3.5-35B-A3B medium	Qwen	2	6.1	$1.140	11/22	110.8s
Total Tests 22 Wrong Tests 11 Total Cost $1.140 Response Time (avg) 110.8s
#35	Qwen3.6 Max Preview medium	Qwen	4	8.6	$1.132	17/22	66.5s
Total Tests 22 Wrong Tests 5 Total Cost $1.132 Response Time (avg) 66.5s
#90	Grok Build 0.1 medium	X AI	6	7.5	$1.130	13/22	54.5s
Total Tests 22 Wrong Tests 9 Total Cost $1.130 Response Time (avg) 54.5s
#27	Claude Opus 5 low	Anthropic	4	8.7	$1.121	18/22	6.99s
Total Tests 22 Wrong Tests 4 Total Cost $1.121 Response Time (avg) 6.99s
#129	Gemini 3.5 Flash none	Google	4	6.9	$1.093	14/22	10.2s
Total Tests 22 Wrong Tests 8 Total Cost $1.093 Response Time (avg) 10.2s
#113	Qwen3.5-122B-A10B medium	Qwen	5	7.1	$1.047	14/22	65.7s
Total Tests 22 Wrong Tests 8 Total Cost $1.047 Response Time (avg) 65.7s
#52	Inkling high	Thinkingmachines	4	8.0	$1.041	15/22	62.6s
Total Tests 22 Wrong Tests 7 Total Cost $1.041 Response Time (avg) 62.6s

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)