Agentic x Wrong answer Ranking

See which AI models are most likely to hit Wrong answer on Agentic, so you can spot weak points faster. Sort by: Tests Correct ↑.

Models Shown

Total Failures

108

Most Affected Model

Grok 4.6 1

Failure Reasons

Wrong answer108 Invalid tool call44 API error32 Did not follow instructions14 Timed out10

Categories

Domain specific766 Anti-AI Tricks446 Coding429 Puzzle Solving307 Trivia280 Combined115 General Intelligence112 Agentic108 Instructions following94 Data parsing and extraction71

108/108

Rank	Model	Company	Wrong answer Count	Category Score	Total Cost	Tests Correct	Response Time (avg)
#62	Grok 4.6 high	X AI	1	5.0	$2.629	0/1	160.9s
Total Tests 1 Wrong Tests 1 Total Cost $2.629 Response Time (avg) 160.9s
#65	Qwen3.7 Max medium	Qwen	1	6.1	$2.046	0/1	137.0s
Total Tests 1 Wrong Tests 1 Total Cost $2.046 Response Time (avg) 137.0s
#78	Claude Opus 4.8 medium	Anthropic	1	6.1	$3.490	0/1	99.4s
Total Tests 1 Wrong Tests 1 Total Cost $3.490 Response Time (avg) 99.4s
#80	Grok 4.5 high	X AI	1	5.0	$2.571	0/1	77.0s
Total Tests 1 Wrong Tests 1 Total Cost $2.571 Response Time (avg) 77.0s
#90	DeepSeek V4.1 Flash low	DeepSeek	1	6.1	$0.153	0/1	56.0s
Total Tests 1 Wrong Tests 1 Total Cost $0.153 Response Time (avg) 56.0s
#102	Grok 4.5 medium	X AI	1	5.0	$2.454	0/1	65.2s
Total Tests 1 Wrong Tests 1 Total Cost $2.454 Response Time (avg) 65.2s
#105	Grok 4.6 medium	X AI	1	5.0	$2.270	0/1	103.6s
Total Tests 1 Wrong Tests 1 Total Cost $2.270 Response Time (avg) 103.6s
#108	Grok 4.5 low	X AI	1	5.0	$1.345	0/1	61.5s
Total Tests 1 Wrong Tests 1 Total Cost $1.345 Response Time (avg) 61.5s
#116	Qwen3.8 27B low	Qwen	1	6.1	~$0.089	0/1	211.3s
Total Tests 1 Wrong Tests 1 Total Cost ~$0.089 Response Time (avg) 211.3s
#124	DeepSeek V4 Flash 0731 low	DeepSeek	1	4.7	$0.307	0/1	321.2s
Total Tests 1 Wrong Tests 1 Total Cost $0.307 Response Time (avg) 321.2s
#127	Grok 4.7 low	X AI	1	5.0	$2.263	0/1	154.9s
Total Tests 1 Wrong Tests 1 Total Cost $2.263 Response Time (avg) 154.9s
#134	Grok 4.7 medium	X AI	1	3.9	$3.501	0/1	372.1s
Total Tests 1 Wrong Tests 1 Total Cost $3.501 Response Time (avg) 372.1s
#137	Qwen3.6 Plus medium	Qwen	1	4.7	$0.391	0/1	307.1s
Total Tests 1 Wrong Tests 1 Total Cost $0.391 Response Time (avg) 307.1s
#140	Qwen3.5 Plus 2026-02-15 medium	Qwen	1	6.1	$0.567	0/1	186.4s
Total Tests 1 Wrong Tests 1 Total Cost $0.567 Response Time (avg) 186.4s
#141	Qwen3.8 27B medium	Qwen	1	4.7	~$0.073	0/1	187.9s
Total Tests 1 Wrong Tests 1 Total Cost ~$0.073 Response Time (avg) 187.9s

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)

Top Models by Estimated Wasted Cost

Agentic: Wrong answer

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)

Top Models by Estimated Wasted CostEstimated GPU electricity cost only. It excludes the rest of the computer and hardware ownership. NVIDIA GeForce RTX 3090: 0.8932 h × 0.300 kW × €0.2896/kWh × 1.138 USD/EUR = ~$0.088310.

Top Models by Estimated Wasted Cost