Anthropic: Claude Sonnet 4.6

Last updated at : Feb 19, 2026

Category Breakdown

Category	Fully passed tests	Score	Consistency	Attempt pass rate	Flaky tests	Reasoning score	Cost
Anti-AI Tricks	1/2	5.50	10.00	50.0%	0	9.83	$0.02304
Data parsing and extraction	2/2	10.00	10.00	100.0%	0	9.83	$0.04958
Domain specific	0/3	1.00	7.21	11.1%	1	5.58	$0.64205
Instructions following	2/2	10.00	10.00	100.0%	0	10.00	$0.01497
Puzzle Solving	3/3	10.00	10.00	100.0%	0	9.44	$0.02077

Compare Anthropic: Claude Sonnet 4.6 against...

#5 · OpenAI

Reasoning (medium)

Score: 7.92

Consistency: 9.30

Attempt pass rate: 80.6%

Flaky tests: 1

Cost per result: 2.2838

Tests Correct: 9/12

Total Cost: $0.20554

#7 · Z.ai

Reasoning (medium)

Score: 6.83

Consistency: 7.86

Attempt pass rate: 80.6%

Flaky tests: 3

Cost per result: 1.3424

Tests Correct: 8/12

Total Cost: $0.10740

#4 · Qwen

Reasoning (medium)

Score: 8.42

Consistency: 9.30

Attempt pass rate: 86.1%

Flaky tests: 1

Cost per result: 2.3151

Tests Correct: 10/12

Total Cost: $0.23151

Compare Anthropic: Claude Sonnet 4.6 against...