Agentic x Wrong answer Ranking

See which AI models are most likely to hit Wrong answer on Agentic, so you can spot weak points faster. Sort by: Response Time (avg) ↓.

Models Shown

Total Failures

108

Most Affected Model

Failure Reasons

Wrong answer108 Invalid tool call44 API error32 Did not follow instructions14 Timed out10

Categories

Domain specific766 Anti-AI Tricks446 Coding429 Puzzle Solving307 Trivia280 Combined115 General Intelligence112 Agentic108 Instructions following94 Data parsing and extraction71

108/108

Rank	Model	Company	Wrong answer Count	Category Score	Total Cost	Tests Correct	Response Time (avg)
#188	Mercury 2 medium	Inception	1	4.7	$0.121	0/1	34.9s
Total Tests 1 Wrong Tests 1 Total Cost $0.121 Response Time (avg) 34.9s
#333	Nemotron 3 Super none	NVIDIA	1	2.8	$0.016	0/1	30.5s
Total Tests 1 Wrong Tests 1 Total Cost $0.016 Response Time (avg) 30.5s
#316	North Mini Code none	Cohere	1	3.0	$0.000	0/1	18.9s
Total Tests 1 Wrong Tests 1 Total Cost $0.000 Response Time (avg) 18.9s

Filter models