Compare Charts

Language:

❤️ Made by XCS

AI BENCHY Compare

LiquidAI: LFM2-24B-A2B vs Qwen: Qwen3.5 Plus 2026-02-15

Model Name:

Last updated at : 2026-02-27 15:16

Summary

Metric	LiquidAI: LFM2-24B-A2B none Release: Unknown release date	Qwen: Qwen3.5 Plus 2026-02-15 medium Release: Unknown release date
Rank	#39	#4
Score	2.43	8.64
Consistency	8.91	10.00
Cost per result	0.045	1.955
Total Cost	$0.001	$0.235
Tests Correct
Wrong Tests	13	2
Attempt pass rate	16.7%	85.7%
Flaky tests	2	0
Output Tokens	1,125	1,258
Reasoning Tokens	0	93,374

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
LiquidAI: LFM2-24B-A2B	1.00	9.81	0.0%	0		490	0
Qwen: Qwen3.5 Plus 2026-02-15	10.00	10.00	100.0%	0		186	5,926

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
LiquidAI: LFM2-24B-A2B	1.00	10.00	0.0%	0		219	0
Qwen: Qwen3.5 Plus 2026-02-15	10.00	10.00	100.0%	0		283	14,892

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
LiquidAI: LFM2-24B-A2B	4.00	7.21	55.6%	1		30	0
Qwen: Qwen3.5 Plus 2026-02-15	4.00	10.00	33.3%	0		56	39,882

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
LiquidAI: LFM2-24B-A2B	3.00	10.00	0.0%	0		60	0
Qwen: Qwen3.5 Plus 2026-02-15	9.50	9.99	100.0%	0		102	9,257

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
LiquidAI: LFM2-24B-A2B	3.33	7.88	22.2%	1		326	0
Qwen: Qwen3.5 Plus 2026-02-15	10.00	10.00	100.0%	0		322	22,508

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
LiquidAI: LFM2-24B-A2B	1.00	10.00	0.0%	0		0	0
Qwen: Qwen3.5 Plus 2026-02-15	10.00	10.00	100.0%	0		309	909

Switch Comparison Pair

Compare LiquidAI: LFM2-24B-A2B against...

Compare Qwen: Qwen3.5 Plus 2026-02-15 against...