Compare Charts

Language:

❤️ Made by XCS

AI BENCHY Compare

MoonshotAI: Kimi K2.5 vs Qwen: Qwen3.5-Flash

Model Name:

Last updated at : 2026-02-27 15:16

Summary

Metric	MoonshotAI: Kimi K2.5 none Release: Unknown release date	Qwen: Qwen3.5-Flash medium Release: Unknown release date
Rank	#32	#24
Score	4.07	5.79
Consistency	8.92	7.60
Cost per result	0.232	0.650
Total Cost	$0.010	$0.046
Tests Correct
Wrong Tests	10	7
Attempt pass rate	35.7%	66.7%
Flaky tests	2	4
Output Tokens	1,915	1,194
Reasoning Tokens	0	108,368

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
MoonshotAI: Kimi K2.5	2.67	7.86	11.1%	1		363	0
Qwen: Qwen3.5-Flash	10.00	10.00	100.0%	0		363	23,645

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
MoonshotAI: Kimi K2.5	5.50	5.81	83.3%	1		995	0
Qwen: Qwen3.5-Flash	5.50	5.87	83.3%	1		235	16,237

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
MoonshotAI: Kimi K2.5	4.00	10.00	33.3%	0		29	0
Qwen: Qwen3.5-Flash	1.00	4.41	33.3%	2		52	34,605

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
MoonshotAI: Kimi K2.5	5.00	9.99	50.0%	0		61	0
Qwen: Qwen3.5-Flash	7.50	9.91	50.0%	0		98	14,139

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
MoonshotAI: Kimi K2.5	2.00	9.92	0.0%	0		247	0
Qwen: Qwen3.5-Flash	4.00	7.21	55.6%	1		137	18,458

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
MoonshotAI: Kimi K2.5	10.00	10.00	100.0%	0		220	0
Qwen: Qwen3.5-Flash	10.00	10.00	100.0%	0		309	1,284

Switch Comparison Pair

Compare MoonshotAI: Kimi K2.5 against...

Compare Qwen: Qwen3.5-Flash against...