Compare Charts

Language:

❤️ Made by XCS

AI BENCHY Compare

Anthropic: Claude Opus 4.6 vs Qwen: Qwen3.5 Plus 2026-02-15

Model Name:

Last updated at : 2026-02-27 15:16

Summary

Metric	Anthropic: Claude Opus 4.6 medium Release: Unknown release date	Qwen: Qwen3.5 Plus 2026-02-15 none Release: Unknown release date
Rank	#20	#15
Score	6.07	6.29
Consistency	8.80	9.99
Cost per result	10.992	0.139
Total Cost	$0.880	$0.012
Tests Correct
Wrong Tests	6	6
Attempt pass rate	61.9%	57.1%
Flaky tests	2	0
Output Tokens	19,576	1,499
Reasoning Tokens	11,081	0

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
Anthropic: Claude Opus 4.6	4.00	4.41	55.6%	2		897	1,000
Qwen: Qwen3.5 Plus 2026-02-15	4.00	10.00	33.3%	0		514	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
Anthropic: Claude Opus 4.6	10.00	10.00	100.0%	0		668	763
Qwen: Qwen3.5 Plus 2026-02-15	10.00	10.00	100.0%	0		243	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
Anthropic: Claude Opus 4.6	1.00	10.00	0.0%	0		16,328	7,928
Qwen: Qwen3.5 Plus 2026-02-15	4.00	10.00	33.3%	0		15	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
Anthropic: Claude Opus 4.6	9.50	9.99	100.0%	0		266	468
Qwen: Qwen3.5 Plus 2026-02-15	9.50	10.00	100.0%	0		71	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
Anthropic: Claude Opus 4.6	7.00	10.00	66.7%	0		556	593
Qwen: Qwen3.5 Plus 2026-02-15	5.00	9.96	33.3%	0		434	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
Anthropic: Claude Opus 4.6	10.00	10.00	100.0%	0		861	329
Qwen: Qwen3.5 Plus 2026-02-15	10.00	10.00	100.0%	0		222	0

Switch Comparison Pair

Compare Anthropic: Claude Opus 4.6 against...

Compare Qwen: Qwen3.5 Plus 2026-02-15 against...