Mistral Large 4 (low) vs GLM 5.1 (medium)

Compared models

Recommended model GLM 5.1 (medium)

Its score stays close to the best score here (7.5 vs 7.6), while responding about 4.5x faster than Mistral Large 4 (low).

Metric	Mistral Large 4 Mistral Large 4 low Release: 2026-10-06	GLM 5.1 GLM 5.1 medium Release: 2026-04-07

Metric	Mistral Large 4 Mistral Large 4 low Release: 2026-10-06	GLM 5.1 GLM 5.1 medium Release: 2026-04-07
Score	7.6	7.5
Rank	#119	#124
Reliability	9.0	9.2
Consistency	8.7	8.4
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	65.2%	66.7%
Flaky tests	4	4
Total Runs	69	69
Cost per result	12.670	9.004
Total Cost	$1.648	$1.546
Input Price	$0.680 / 1M	$1.400 / 1M
Output Price	$2.090 / 1M	$4.400 / 1M
Cache Read Price	$0.070 / 1M	$0.260 / 1M
Cache Write Price	N/A	N/A
Total Input Tokens	226,734	331,577
Output Tokens	278,013	17,919
Reasoning Tokens	638,296	230,789
Response Time (avg)	300.15s	66.38s
Response Time (max)	1798.01s	308.75s
Response Time (total)	6903.40s	1460.31s
Parameters	1.05T total (49B active)	744B total (40B active)
Availability	Closed	Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

low

medium

Reached the allocated time limit (300 seconds) without receiving showcase output.

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mistral Large 4	10.0	10.0	100.0%	0		69.63s	143,243	3,788	3,053
GLM 5.1	10.0	10.0	100.0%	0		225.59s	248,985	1,830	30,989

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mistral Large 4	8.3	10.0	75.0%	0		19.75s	705	999	9,354
GLM 5.1	10.0	10.0	100.0%	0		8.31s	555	401	5,122

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mistral Large 4	3.4	7.2	22.2%	1		1379.72s	5,896	129,426	386,126
GLM 5.1	4.6	3.7	44.5%	2		109.63s	5,702	4,871	37,826

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mistral Large 4	10.0	10.0	100.0%	0		556.27s	60,360	5,603	60,531
GLM 5.1	9.8	10.0	100.0%	0		175.93s	66,926	4,761	65,248

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mistral Large 4	10.0	10.0	100.0%	0		27.46s	7,314	1,014	7,623
GLM 5.1	10.0	10.0	100.0%	0		9.33s	7,107	991	4,552

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mistral Large 4	2.9	7.2	11.1%	1		291.62s	798	82,605	111,098
GLM 5.1	3.0	10.0	0.0%	0		113.95s	458	969	74,651

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mistral Large 4	10.0	10.0	100.0%	0		39.29s	516	5,529	5,865
GLM 5.1	10.0	10.0	100.0%	0		20.95s	477	2,875	2,875

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mistral Large 4	8.4	6.9	83.3%	1		23.21s	708	5,408	6,402
GLM 5.1	6.4	5.8	66.7%	1		7.47s	634	204	1,617

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mistral Large 4	7.7	7.3	77.8%	1		35.82s	717	8,012	9,030
GLM 5.1	8.2	7.2	88.9%	1		31.64s	609	935	5,730

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mistral Large 4	10.0	10.0	100.0%	0		21.53s	6,267	307	1,015
GLM 5.1	3.0	10.0	0.0%	0		0ms	0	0	0

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mistral Large 4	3.0	10.0	0.0%	0		358.62s	210	35,322	38,199
GLM 5.1	3.0	10.0	0.0%	0		29.40s	124	82	2,179

Switch Comparison Pair