Grok 4.3 (medium) vs GLM 5.1

Compared models

Recommended model GLM 5.1

It has the best score here (6.5), while costing about 3.2x less than Grok 4.3 (medium).

Metric	Grok 4.3 Grok 4.3 medium Release: 2026-05-01	GLM 5.1 GLM 5.1 none Release: 2026-04-07

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

medium

none

Reached the allocated time limit (300 seconds) without receiving showcase output.

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Grok 4.3	3.9	9.6	0.0%	0		51.61s	185,227	1,128	5,510
GLM 5.1	10.0	10.0	100.0%	0		107.19s	134,737	5,683	0

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Grok 4.3	10.0	10.0	100.0%	0		8.83s	2,010	88	8,207
GLM 5.1	4.0	6.3	25.0%	2		2.11s	555	305	0

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Grok 4.3	5.9	7.7	44.4%	1		41.23s	8,340	1,028	31,226
GLM 5.1	3.9	9.7	0.0%	0		4.96s	7,256	525	0

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Grok 4.3	6.5	10.0	50.0%	0		55.07s	108,468	11,992	21,601
GLM 5.1	2.8	1.8	33.3%	2		46.88s	99,907	12,768	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Grok 4.3	10.0	10.0	100.0%	0		18.97s	7,761	180	9,546
GLM 5.1	10.0	10.0	100.0%	0		1.08s	7,107	204	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Grok 4.3	3.5	4.4	33.3%	2		158.01s	1,977	14	95,783
GLM 5.1	5.3	7.2	44.4%	1		2.27s	697	24	0

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Grok 4.3	5.4	2.5	66.7%	1		24.70s	825	70	5,020
GLM 5.1	5.0	10.0	0.0%	0		790ms	477	39	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Grok 4.3	9.8	10.0	100.0%	0		18.58s	1,362	57	8,713
GLM 5.1	9.8	10.0	100.0%	0		1.98s	636	66	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Grok 4.3	5.9	7.2	55.6%	1		22.52s	1,689	128	14,468
GLM 5.1	7.7	10.0	66.7%	0		1.45s	609	151	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Grok 4.3	10.0	10.0	100.0%	0		17.66s	7,263	168	4,615
GLM 5.1	10.0	10.0	100.0%	0		10.68s	6,789	300	0

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Grok 4.3	3.0	10.0	0.0%	0		44.47s	549	14	12,986
GLM 5.1	3.0	10.0	0.0%	0		2.34s	186	11	0

Switch Comparison Pair