Compare Charts

Language:

❤️ Made by XCS

AI BENCHY Compare

MoonshotAI: Kimi K2.5 vs Qwen: Qwen3.5 Plus 2026-02-15

Model Name:

Last updated at : 2026-02-27 15:16

Summary

Metric	MoonshotAI: Kimi K2.5 medium Release: Unknown release date	Qwen: Qwen3.5 Plus 2026-02-15 none Release: Unknown release date
Rank	#17	#15
Score	6.29	6.29
Consistency	7.69	9.99
Cost per result	2.335	0.139
Total Cost	$0.187	$0.012
Tests Correct
Wrong Tests	6	6
Attempt pass rate	73.8%	57.1%
Flaky tests	4	0
Output Tokens	30,504	1,499
Reasoning Tokens	58,467	0

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
MoonshotAI: Kimi K2.5	7.00	7.21	88.9%	1		335	6,255
Qwen: Qwen3.5 Plus 2026-02-15	4.00	10.00	33.3%	0		514	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
MoonshotAI: Kimi K2.5	10.00	10.00	100.0%	0		1,181	6,049
Qwen: Qwen3.5 Plus 2026-02-15	10.00	10.00	100.0%	0		243	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
MoonshotAI: Kimi K2.5	1.00	4.41	33.3%	2		20,696	30,894
Qwen: Qwen3.5 Plus 2026-02-15	4.00	10.00	33.3%	0		15	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
MoonshotAI: Kimi K2.5	9.50	10.00	100.0%	0		3,777	4,967
Qwen: Qwen3.5 Plus 2026-02-15	9.50	10.00	100.0%	0		71	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
MoonshotAI: Kimi K2.5	5.00	7.61	55.6%	1		4,273	9,490
Qwen: Qwen3.5 Plus 2026-02-15	5.00	9.96	33.3%	0		434	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
MoonshotAI: Kimi K2.5	10.00	10.00	100.0%	0		242	812
Qwen: Qwen3.5 Plus 2026-02-15	10.00	10.00	100.0%	0		222	0

Switch Comparison Pair

Compare MoonshotAI: Kimi K2.5 against...

Compare Qwen: Qwen3.5 Plus 2026-02-15 against...