Laguna XS 2.1 (medium) vs GLM 5.1

Compared models

Recommended model Laguna XS 2.1 (medium)

It has the best score here (6.4), while costing about 3.7x less than GLM 5.1.

Metric	Laguna XS 2.1 Laguna XS 2.1 medium Release: 2026-07-02 Free Available	GLM 5.1 GLM 5.1 none Release: 2026-04-07

Metric	Laguna XS 2.1 Laguna XS 2.1 medium Release: 2026-07-02 Free Available	GLM 5.1 GLM 5.1 none Release: 2026-04-07
Score	6.4	6.5
Rank	#200	#196
Reliability	10.0	10.0
Consistency	9.0	8.2
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	46.4%	47.8%
Flaky tests	3	5
Total Runs	69	69
Cost per result	0.922	3.478
Total Cost	$0.083	$0.311
Input Price	$0.060 / 1M	$0.965 / 1M
Output Price	$0.120 / 1M	$3.032 / 1M
Total Input Tokens	352,516	258,956
Output Tokens	33,786	20,076
Reasoning Tokens	504,506	0
Response Time (avg)	48.97s	11.10s
Response Time (max)	422.72s	107.19s
Response Time (total)	1126.35s	255.39s
Parameters	33B total (3B active)	744B total (40B active)
Availability	Weights available	Open source

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

medium

none

Reached the allocated time limit (300 seconds) without receiving showcase output.

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Laguna XS 2.1	6.1	3.1	66.7%	1		66.42s	233,518	3,036	12,776
GLM 5.1	10.0	10.0	100.0%	0		107.19s	134,737	5,683	0

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Laguna XS 2.1	4.8	10.0	25.0%	0		41.96s	774	353	73,090
GLM 5.1	4.0	6.3	25.0%	2		2.11s	555	305	0

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Laguna XS 2.1	5.5	10.0	33.3%	0		70.35s	7,995	23,767	83,258
GLM 5.1	3.9	9.7	0.0%	0		4.96s	7,256	525	0

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Laguna XS 2.1	6.3	10.0	50.0%	0		218.07s	91,698	5,496	229,064
GLM 5.1	2.8	1.8	33.3%	2		46.88s	99,907	12,768	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Laguna XS 2.1	10.0	10.0	100.0%	0		4.50s	7,734	234	3,129
GLM 5.1	10.0	10.0	100.0%	0		1.08s	7,107	204	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Laguna XS 2.1	3.5	4.4	33.3%	2		67.48s	843	17	91,430
GLM 5.1	5.3	7.2	44.4%	1		2.27s	697	24	0

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Laguna XS 2.1	5.0	10.0	0.0%	0		4.15s	537	119	1,375
GLM 5.1	5.0	10.0	0.0%	0		790ms	477	39	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Laguna XS 2.1	9.8	10.0	100.0%	0		2.57s	753	82	1,844
GLM 5.1	9.8	10.0	100.0%	0		1.98s	636	66	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Laguna XS 2.1	5.3	10.0	33.3%	0		3.43s	771	357	3,355
GLM 5.1	7.7	10.0	66.7%	0		1.45s	609	151	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Laguna XS 2.1	10.0	10.0	100.0%	0		3.01s	7,638	309	748
GLM 5.1	10.0	10.0	100.0%	0		10.68s	6,789	300	0

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Laguna XS 2.1	3.0	10.0	0.0%	0		10.88s	255	16	4,437
GLM 5.1	3.0	10.0	0.0%	0		2.34s	186	11	0

Switch Comparison Pair