Mercury 2.5 (high) vs GLM 5.3 (low)

Compared models

Recommended model Mercury 2.5 (high)

It has the best score here (6.5), while costing about 10.9x less than GLM 5.3 (low).

Metric	Mercury 2.5 Mercury 2.5 high Release: 2026-09-08	GLM 5.3 GLM 5.3 low Release: 2026-08-20

Metric	Mercury 2.5 Mercury 2.5 high Release: 2026-09-08	GLM 5.3 GLM 5.3 low Release: 2026-08-20
Score	6.5	6.5
Rank	#194	#195
Reliability	9.8	10.0
Consistency	8.7	8.3
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	59.4%	63.8%
Flaky tests	4	5
Total Runs	69	69
Cost per result	0.362	3.936
Total Cost	$0.044	$0.473
Input Price	$0.040 / 1M	$1.400 / 1M
Output Price	$0.150 / 1M	$4.400 / 1M
Total Input Tokens	358,562	247,436
Output Tokens	4,266	11,005
Reasoning Tokens	189,410	17,597
Response Time (avg)	7.62s	15.28s
Response Time (max)	80.30s	83.60s
Response Time (total)	175.36s	351.49s
Parameters	~100B	744B total (40B active)
Availability	Closed	Closed

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

high

low

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mercury 2.5	3.9	9.6	0.0%	0		80.30s	238,494	864	18,265
GLM 5.3	5.2	3.2	33.3%	1		51.27s	142,447	2,473	1,321

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mercury 2.5	10.0	10.0	100.0%	0		1.33s	782	218	7,913
GLM 5.3	6.9	7.9	66.7%	1		4.16s	639	266	249

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mercury 2.5	6.4	7.8	44.4%	1		6.58s	7,757	415	44,012
GLM 5.3	6.2	6.9	55.6%	1		21.02s	7,317	368	6,764

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mercury 2.5	6.4	5.8	66.7%	1		16.00s	91,255	1,478	62,200
GLM 5.3	3.8	5.8	33.3%	1		53.02s	80,209	6,729	5,209

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mercury 2.5	10.0	10.0	100.0%	0		3.08s	8,355	557	9,430
GLM 5.3	10.0	10.0	100.0%	0		3.42s	7,149	210	56

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mercury 2.5	2.9	7.2	11.1%	1		4.86s	857	78	22,452
GLM 5.3	5.3	10.0	33.3%	0		19.23s	759	35	3,384

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mercury 2.5	5.0	10.0	0.0%	0		2.69s	528	93	3,609
GLM 5.3	4.1	2.7	33.3%	1		4.70s	498	163	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mercury 2.5	6.5	10.0	50.0%	0		934ms	401	27	1,770
GLM 5.3	10.0	10.0	100.0%	0		3.40s	678	72	81

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mercury 2.5	8.7	7.7	88.9%	1		1.39s	771	227	5,812
GLM 5.3	10.0	10.0	100.0%	0		4.20s	672	389	225

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mercury 2.5	10.0	10.0	100.0%	0		3.06s	9,130	283	4,484
GLM 5.3	10.0	10.0	100.0%	0		18.45s	6,861	231	0

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mercury 2.5	3.0	10.0	0.0%	0		5.48s	232	26	9,463
GLM 5.3	3.0	10.0	0.0%	0		7.42s	207	69	308

Switch Comparison Pair