Compare Charts

Language:

❤️ Made by XCS

AI BENCHY Compare

LiquidAI: LFM2-24B-A2B vs OpenAI: GPT-5 Nano

Model Name:

Last updated at : 2026-02-27 15:16

Summary

Metric	LiquidAI: LFM2-24B-A2B none Release: Unknown release date	OpenAI: GPT-5 Nano medium Release: Unknown release date
Rank	#39	#23
Score	2.43	5.86
Consistency	8.91	6.60
Cost per result	0.045	0.519
Total Cost	$0.001	$0.037
Tests Correct
Wrong Tests	13	7
Attempt pass rate	16.7%	69.1%
Flaky tests	2	6
Output Tokens	1,125	3,700
Reasoning Tokens	0	85,184

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
LiquidAI: LFM2-24B-A2B	1.00	9.81	0.0%	0		490	0
OpenAI: GPT-5 Nano	7.00	9.99	66.7%	0		1,107	19,968

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
LiquidAI: LFM2-24B-A2B	1.00	10.00	0.0%	0		219	0
OpenAI: GPT-5 Nano	5.50	5.81	83.3%	1		426	8,576

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
LiquidAI: LFM2-24B-A2B	4.00	7.21	55.6%	1		30	0
OpenAI: GPT-5 Nano	4.00	4.41	55.6%	2		195	33,600

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
LiquidAI: LFM2-24B-A2B	3.00	10.00	0.0%	0		60	0
OpenAI: GPT-5 Nano	7.00	6.41	83.3%	1		360	4,032

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
LiquidAI: LFM2-24B-A2B	3.33	7.88	22.2%	1		326	0
OpenAI: GPT-5 Nano	4.67	4.90	55.6%	2		1,054	12,032

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Output Tokens	Reasoning Tokens
LiquidAI: LFM2-24B-A2B	1.00	10.00	0.0%	0		0	0
OpenAI: GPT-5 Nano	10.00	10.00	100.0%	0		558	6,976

Switch Comparison Pair

Compare LiquidAI: LFM2-24B-A2B against...

Compare OpenAI: GPT-5 Nano against...