Compared models

Rank: #184
Total Output Tokens: 120,942
Response Time (avg): 39.05s
Total Cost: $0.479

Rank: #156
Total Output Tokens: 245,833
Response Time (avg): 66.38s
Total Cost: $1.546

Rank: #321
Total Output Tokens: 5,577
Response Time (avg): 8.74s
Total Cost: $0.140

Rank: #243
Total Output Tokens: 20,076
Response Time (avg): 11.10s
Total Cost: $0.451

Recommended model GLM 5 (medium)

It offers the best overall trade-off: a competitive score (7.2), lower cost than the other models in this comparison, and balanced response time.

Detailed comparison

Metric	GLM 5 GLM 5 medium Release: 2026-02-12	GLM 5.1 GLM 5.1 medium Release: 2026-04-07	GLM 5 GLM 5 none Release: 2026-02-12	GLM 5.1 GLM 5.1 none Release: 2026-04-07

Metric	GLM 5 GLM 5 medium Release: 2026-02-12	GLM 5.1 GLM 5.1 medium Release: 2026-04-07	GLM 5 GLM 5 none Release: 2026-02-12	GLM 5.1 GLM 5.1 none Release: 2026-04-07
Score	7.2	7.5	5.6	6.5
Rank	#184	#156	#321	#243
Reliability	10.0	9.2	10.0	10.0
Consistency	7.9	8.4	9.3	8.2
Attempts	66/69	69/69	66/69	69/69
Tests Correct
Attempt pass rate	76.8%	66.7%	40.6%	47.8%
Flaky tests	5	4	1	5
Total Runs	66	69	66	69
Cost per result	2.552	9.004	1.363	3.478
Total Cost	$0.479	$1.546	$0.140	$0.451
Input Price	$0.600 / 1M	$1.400 / 1M	$0.600 / 1M	$1.400 / 1M
Output Price	$1.920 / 1M	$4.400 / 1M	$1.920 / 1M	$4.400 / 1M
Cache Read Price	$0.120 / 1M	$0.260 / 1M	$0.120 / 1M	$0.260 / 1M
Cache Write Price	N/A	N/A	N/A	N/A
Total Input Tokens	212,440	331,577	190,675	258,956
Output Tokens	22,922	17,919	5,577	20,076
Reasoning Tokens	115,335	230,789	0	0
Response Time (avg)	39.05s	66.38s	8.74s	11.10s
Response Time (max)	110.70s	308.75s	74.80s	107.19s
Response Time (total)	546.68s	1460.31s	131.17s	255.39s
Parameters	744B total (40B active)	744B total (40B active)	744B total (40B active)	744B total (40B active)
Availability	Open source	Open source	Open source	Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#184 GLM 5

medium

Cost: $0.005
Time: 20.7s
Tokens: 2,068 tok

#156 GLM 5.1

medium

Reached the allocated time limit (300 seconds) without receiving showcase output.

Cost: $0.000
Time: 300.0s
Tokens: 0 tok

#321 GLM 5

none

Cost: $0.007
Time: 32.1s
Tokens: 2,023 tok

#243 GLM 5.1

none

Reached the allocated time limit (300 seconds) without receiving showcase output.

Cost: $0.000
Time: 300.0s
Tokens: 0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GLM 5	4.7	3.1	33.3%	1	110.70s	177,216	1,352	12,339
GLM 5.1	10.0	10.0	100.0%	0	225.59s	248,985	1,830	30,989
GLM 5	5.0	10.0	0.0%	0	74.80s	153,540	3,588	0
GLM 5.1	10.0	10.0	100.0%	0	107.19s	134,737	5,683	0

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GLM 5	10.0	10.0	100.0%	0	23.66s	555	480	7,056
GLM 5.1	10.0	10.0	100.0%	0	8.31s	555	401	5,122
GLM 5	4.8	10.0	25.0%	0	2.37s	510	275	0
GLM 5.1	4.0	6.3	25.0%	2	2.11s	555	305	0

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GLM 5	10.0	10.0	100.0%	0	74.30s	7,254	2,997	52,930
GLM 5.1	4.6	3.7	44.5%	2	109.63s	5,702	4,871	37,826
GLM 5	4.0	7.8	11.1%	1	5.12s	7,256	428	0
GLM 5.1	3.9	9.7	0.0%	0	4.96s	7,256	525	0

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GLM 5	5.0	5.0	50.0%	0	28.96s	12,804	662	3,242
GLM 5.1	9.8	10.0	100.0%	0	175.93s	66,926	4,761	65,248
GLM 5	1.5	5.0	0.0%	0	4.98s	12,812	406	0
GLM 5.1	2.8	1.8	33.3%	2	46.88s	99,907	12,768	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GLM 5	7.1	5.6	83.3%	1	8.90s	5,508	567	3,734
GLM 5.1	10.0	10.0	100.0%	0	9.33s	7,107	991	4,552
GLM 5	10.0	10.0	100.0%	0	5.78s	7,107	203	0
GLM 5.1	10.0	10.0	100.0%	0	1.08s	7,107	204	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GLM 5	3.5	4.4	33.3%	2	0ms	260	13,176	14,137
GLM 5.1	3.0	10.0	0.0%	0	113.95s	458	969	74,651
GLM 5	3.0	10.0	0.0%	0	2.24s	643	19	0
GLM 5.1	5.3	7.2	44.4%	1	2.27s	697	24	0

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GLM 5	6.1	3.1	66.7%	1	14.69s	477	2,020	2,248
GLM 5.1	10.0	10.0	100.0%	0	20.95s	477	2,875	2,875
GLM 5	10.0	10.0	100.0%	0	3.27s	477	103	0
GLM 5.1	5.0	10.0	0.0%	0	790ms	477	39	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GLM 5	10.0	10.0	100.0%	0	7.25s	636	1,001	2,129
GLM 5.1	6.4	5.8	66.7%	1	7.47s	634	204	1,617
GLM 5	10.0	10.0	100.0%	0	1.48s	636	61	0
GLM 5.1	9.8	10.0	100.0%	0	1.98s	636	66	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GLM 5	10.0	10.0	100.0%	0	11.33s	609	33	4,076
GLM 5.1	8.2	7.2	88.9%	1	31.64s	609	935	5,730
GLM 5	7.7	10.0	66.7%	0	1.91s	609	261	0
GLM 5.1	7.7	10.0	66.7%	0	1.45s	609	151	0

Tool Calling	Score	Consistency	Attempt pass rate	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GLM 5	10.0	10.0	100.0%	15.93s	6,935	233	994
GLM 5.1	3.0	10.0	0.0%	0ms	0	0	0
GLM 5	10.0	10.0	100.0%	11.07s	6,899	220	0
GLM 5.1	10.0	10.0	100.0%	10.68s	6,789	300	0

Trivia	Score	Consistency	Attempt pass rate	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GLM 5	3.0	10.0	0.0%	67.37s	186	401	12,450
GLM 5.1	3.0	10.0	0.0%	29.40s	124	82	2,179
GLM 5	3.0	10.0	0.0%	3.62s	186	13	0
GLM 5.1	3.0	10.0	0.0%	2.34s	186	11	0

Switch Comparison Pair

Space Bunny AlphahighvsGLM 5.1medium Step 3.7 FlashlowvsGLM 5medium KAT-Coder-Pro V2.5highvsGLM 5.1none Grok 4.3mediumvsGLM 5.1none Laguna XS 2.1mediumFree AvailablevsGLM 5.1none Qwen3.7 FlashhighvsGLM 5medium Beam 1.0 501B A23BxhighvsGLM 5.1none Mercury 2.5highvsGLM 5.1none Claude Opus 5nonevsGLM 5medium Qwen3.8 27BlowFree AvailablevsGLM 5.1medium GPT-6 LunalowvsGLM 5.1medium Claude Opus 4.8lowvsGLM 5medium

Compared models

Compared models

Detailed comparison

Model generation showcase

Hamster playing table tennis

#184 GLM 5

#156 GLM 5.1

#321 GLM 5

#243 GLM 5.1

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Quick Compare