Mistral Large 4 (high) vs GLM 5.1 (medium)

Compared models

Recommended model GLM 5.1 (medium)

It has the best score here (7.5), while responding about 4.0x faster than Mistral Large 4 (high).

Metric	Mistral Large 4 Mistral Large 4 high Release: 2026-10-06	GLM 5.1 GLM 5.1 medium Release: 2026-04-07

Metric	Mistral Large 4 Mistral Large 4 high Release: 2026-10-06	GLM 5.1 GLM 5.1 medium Release: 2026-04-07
Score	7.5	7.5
Rank	#126	#124
Reliability	9.0	9.2
Consistency	7.9	8.4
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	65.2%	66.7%
Flaky tests	6	4
Total Runs	69	69
Cost per result	11.590	9.004
Total Cost	$1.391	$1.546
Input Price	$0.680 / 1M	$1.400 / 1M
Output Price	$2.090 / 1M	$4.400 / 1M
Cache Read Price	$0.070 / 1M	$0.260 / 1M
Cache Write Price	N/A	N/A
Total Input Tokens	230,895	331,577
Output Tokens	161,281	17,919
Reasoning Tokens	510,655	230,789
Response Time (avg)	263.69s	66.38s
Response Time (max)	1727.29s	308.75s
Response Time (total)	6064.89s	1460.31s
Parameters	1.05T total (49B active)	744B total (40B active)
Availability	Closed	Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

high

medium

Reached the allocated time limit (300 seconds) without receiving showcase output.

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mistral Large 4	10.0	10.0	100.0%	0		85.76s	146,529	4,449	3,575
GLM 5.1	10.0	10.0	100.0%	0		225.59s	248,985	1,830	30,989

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mistral Large 4	8.3	10.0	75.0%	0		14.97s	705	1,099	7,391
GLM 5.1	10.0	10.0	100.0%	0		8.31s	555	401	5,122

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mistral Large 4	3.3	4.4	33.3%	2		1277.83s	6,541	53,820	279,694
GLM 5.1	4.6	3.7	44.5%	2		109.63s	5,702	4,871	37,826

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mistral Large 4	10.0	10.0	100.0%	0		391.89s	60,590	7,002	56,326
GLM 5.1	9.8	10.0	100.0%	0		175.93s	66,926	4,761	65,248

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mistral Large 4	10.0	10.0	100.0%	0		34.99s	7,314	1,144	10,190
GLM 5.1	10.0	10.0	100.0%	0		9.33s	7,107	991	4,552

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mistral Large 4	3.5	4.4	33.3%	2		289.43s	798	57,077	112,091
GLM 5.1	3.0	10.0	0.0%	0		113.95s	458	969	74,651

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mistral Large 4	10.0	10.0	100.0%	0		41.23s	516	6,145	6,502
GLM 5.1	10.0	10.0	100.0%	0		20.95s	477	2,875	2,875

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mistral Large 4	8.4	6.9	83.3%	1		21.99s	708	5,465	6,653
GLM 5.1	6.4	5.8	66.7%	1		7.47s	634	204	1,617

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mistral Large 4	5.4	7.1	44.4%	1		55.18s	717	14,728	16,884
GLM 5.1	8.2	7.2	88.9%	1		31.64s	609	935	5,730

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mistral Large 4	10.0	10.0	100.0%	0		24.21s	6,267	305	994
GLM 5.1	3.0	10.0	0.0%	0		0ms	0	0	0

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mistral Large 4	3.0	10.0	0.0%	0		88.77s	210	10,047	10,355
GLM 5.1	3.0	10.0	0.0%	0		29.40s	124	82	2,179

Switch Comparison Pair