Compare Charts

Language:

❤️ Made by XCS

AI BENCHY Compare

MiniMax: MiniMax M2.5 vs Qwen: Qwen3.5-35B-A3B

Model Name:

Last updated at : 2026-02-27 15:16

Summary

Metric	MiniMax: MiniMax M2.5 medium Release: Unknown release date	Qwen: Qwen3.5-35B-A3B none Release: Unknown release date
Rank	#26	#30
Score	5.64	4.63
Consistency	6.12	9.40
Cost per result	4.028	0.165
Total Cost	$0.242	$0.009
Tests Correct
Wrong Tests	8	9
Attempt pass rate	64.3%	40.5%
Flaky tests	7	1
Output Tokens	121,297	1,775
Reasoning Tokens	203,513	0

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
MiniMax: MiniMax M2.5	9.33	7.89	88.9%	1		286	45,112
Qwen: Qwen3.5-35B-A3B	1.00	7.21	22.2%	1		569	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
MiniMax: MiniMax M2.5	5.50	5.81	83.3%	1		369	4,952
Qwen: Qwen3.5-35B-A3B	9.88	10.00	100.0%	0		243	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
MiniMax: MiniMax M2.5	1.00	4.41	22.2%	2		111,023	139,533
Qwen: Qwen3.5-35B-A3B	7.00	10.00	66.7%	0		15	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
MiniMax: MiniMax M2.5	7.00	6.41	66.7%	1		1,121	2,521
Qwen: Qwen3.5-35B-A3B	3.50	9.99	0.0%	0		63	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
MiniMax: MiniMax M2.5	4.33	4.79	55.6%	2		8,229	10,458
Qwen: Qwen3.5-35B-A3B	1.33	9.99	0.0%	0		621	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
MiniMax: MiniMax M2.5	10.00	10.00	100.0%	0		269	937
Qwen: Qwen3.5-35B-A3B	10.00	10.00	100.0%	0		264	0

Switch Comparison Pair

Compare MiniMax: MiniMax M2.5 against...

Compare Qwen: Qwen3.5-35B-A3B against...