Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Tests Correct ↓.

Models Shown

Total Failures

3190

Most Affected Model

Gemini 3.6 Flash 1

Categories

In category Domain specific900 In category Anti-AI Tricks521 In category Coding485 In category Puzzle Solving355 In category Trivia317 In category General Intelligence134 In category Combined130 In category Agentic128 In category Instructions following118 In category Data parsing and extraction93

447/447

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#257	Gemini 3.5 Flash Lite low	Google	9	0.6	$0.183	12/23	4.79s
Total Tests 23 Wrong Tests 11 Total Cost $0.183 Response Time (avg) 4.79s
#263	Ling 3.1 Flash low	Inclusionai	2	0.6	$0.000	12/23	85.2s
Total Tests 23 Wrong Tests 11 Total Cost $0.000 Response Time (avg) 85.2s
#274	Gemini 3.1 Flash Lite Preview none	Google	8	0.6	$0.090	12/23	3.60s
Total Tests 23 Wrong Tests 11 Total Cost $0.090 Response Time (avg) 3.60s
#302	Ling 3.0 Flash high	Inclusionai	7	0.6	$0.021	12/23	13.1s
Total Tests 23 Wrong Tests 11 Total Cost $0.021 Response Time (avg) 13.1s
#337	Qwen3.6 Max Preview none	Qwen	11	0.5	$0.228	11/22	7.82s
Total Tests 22 Wrong Tests 11 Total Cost $0.228 Response Time (avg) 7.82s
#431	Span-02 default	Respan	6	0.3	$0.001	6/12	1.36s
Total Tests 12 Wrong Tests 6 Total Cost $0.001 Response Time (avg) 1.36s
#435	Jev 1.13 default	Typesafe	6	0.3	$0.003	6/12	698ms
Total Tests 12 Wrong Tests 6 Total Cost $0.003 Response Time (avg) 698ms
#446	Step 3.5 Flash none	Stepfun	1	0.2	$0.020	6/12	39.0s
Total Tests 12 Wrong Tests 6 Total Cost $0.020 Response Time (avg) 39.0s
#109	DeepSeek V4 Pro 0423 high	DeepSeek	9	0.8	$0.149	11/23	91.3s
Total Tests 23 Wrong Tests 12 Total Cost $0.149 Response Time (avg) 91.3s
#139	Muse Glimmer 30B high	Meta	7	0.8	$0.506	11/23	69.9s
Total Tests 23 Wrong Tests 12 Total Cost $0.506 Response Time (avg) 69.9s
#157	Seed-2.0-Code medium	Bytedance Seed	6	0.7	$1.275	11/23	100.6s
Total Tests 23 Wrong Tests 12 Total Cost $1.275 Response Time (avg) 100.6s
#179	Step 3.7 Flash low	Stepfun	9	0.7	$0.449	11/23	20.7s
Total Tests 23 Wrong Tests 12 Total Cost $0.449 Response Time (avg) 20.7s
#180	Qwen3.6 27B medium	Qwen	5	0.7	$1.021	11/23	107.8s
Total Tests 23 Wrong Tests 12 Total Cost $1.021 Response Time (avg) 107.8s
#190	Kimi K2.7 Code medium	Moonshot AI	8	0.7	$1.136	11/23	81.2s
Total Tests 23 Wrong Tests 12 Total Cost $1.136 Response Time (avg) 81.2s
#196	Muse Glimmer 30B low	Meta	6	0.7	$0.219	11/23	22.4s
Total Tests 23 Wrong Tests 12 Total Cost $0.219 Response Time (avg) 22.4s

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)