Compare Charts

Language:

❤️ Made by XCS

AI BENCHY Compare

Qwen: Qwen3.5-27B vs xAI: Grok 4.1 Fast

Model Name:

Last updated at : 2026-02-27 15:16

Summary

Metric	Qwen: Qwen3.5-27B medium Release: Unknown release date	xAI: Grok 4.1 Fast none Release: Unknown release date
Rank	#5	#38
Score	8.55	3.00
Consistency	9.55	8.69
Cost per result	2.950	0.176
Total Cost	$0.325	$0.006
Tests Correct
Wrong Tests	3	11
Attempt pass rate	83.3%	28.6%
Flaky tests	1	2
Output Tokens	1,091	931
Reasoning Tokens	131,807	0

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
Qwen: Qwen3.5-27B	10.00	10.00	100.0%	0		102	8,956
xAI: Grok 4.1 Fast	1.33	10.00	0.0%	0		229	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
Qwen: Qwen3.5-27B	9.88	10.00	100.0%	0		270	16,150
xAI: Grok 4.1 Fast	10.00	10.00	100.0%	0		180	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
Qwen: Qwen3.5-27B	4.00	10.00	33.3%	0		43	52,368
xAI: Grok 4.1 Fast	4.00	7.21	55.6%	1		15	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
Qwen: Qwen3.5-27B	9.00	6.88	83.3%	1		97	11,638
xAI: Grok 4.1 Fast	1.00	10.00	0.0%	0		66	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
Qwen: Qwen3.5-27B	10.00	10.00	100.0%	0		231	41,372
xAI: Grok 4.1 Fast	1.00	9.48	0.0%	0		233	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
Qwen: Qwen3.5-27B	10.00	10.00	100.0%	0		348	1,323
xAI: Grok 4.1 Fast	1.00	1.62	33.3%	1		208	0

Switch Comparison Pair

Compare Qwen: Qwen3.5-27B against...

Compare xAI: Grok 4.1 Fast against...