Compare Charts

Language:

❤️ Made by XCS

AI BENCHY Compare

Qwen: Qwen3.5-122B-A10B vs Qwen: Qwen3.5-27B

Model Name:

Last updated at : 2026-02-27 15:16

Summary

Metric	Qwen: Qwen3.5-122B-A10B medium Release: Unknown release date	Qwen: Qwen3.5-27B none Release: Unknown release date
Rank	#13	#29
Score	6.77	4.70
Consistency	8.22	9.93
Cost per result	5.137	0.190
Total Cost	$0.463	$0.010
Tests Correct
Wrong Tests	5	9
Attempt pass rate	76.2%	35.7%
Flaky tests	3	0
Output Tokens	16,751	1,600
Reasoning Tokens	125,394	0

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
Qwen: Qwen3.5-122B-A10B	10.00	10.00	100.0%	0		248	10,486
Qwen: Qwen3.5-27B	4.00	10.00	33.3%	0		264	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
Qwen: Qwen3.5-122B-A10B	9.88	10.00	100.0%	0		270	16,558
Qwen: Qwen3.5-27B	9.88	10.00	100.0%	0		243	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
Qwen: Qwen3.5-122B-A10B	1.00	7.21	11.1%	1		15,537	64,889
Qwen: Qwen3.5-27B	1.00	10.00	0.0%	0		15	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
Qwen: Qwen3.5-122B-A10B	5.50	5.92	83.3%	1		77	7,372
Qwen: Qwen3.5-27B	4.00	10.00	0.0%	0		69	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
Qwen: Qwen3.5-122B-A10B	7.00	7.21	88.9%	1		297	24,863
Qwen: Qwen3.5-27B	4.33	9.68	33.3%	0		706	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
Qwen: Qwen3.5-122B-A10B	10.00	10.00	100.0%	0		322	1,226
Qwen: Qwen3.5-27B	10.00	10.00	100.0%	0		303	0

Switch Comparison Pair

Compare Qwen: Qwen3.5-122B-A10B against...

Compare Qwen: Qwen3.5-27B against...