Beam 1.0 501B A23B (medium) vs GLM 5.3 (low)

Compared models

Rank: #220
Total Output Tokens: 98,521
Response Time (avg): 6.27s
Total Cost: $0.499

Rank: #227
Total Output Tokens: 28,106
Response Time (avg): 15.18s
Total Cost: $0.215

Recommended model GLM 5.3 (low)

Its score stays close to the best score here (6.5 vs 6.6), while costing about 2.3x less than Beam 1.0 501B A23B (medium).

Detailed comparison

Metric	Beam 1.0 501B A23B Beam 1.0 501B A23B medium Release: 2026-10-17	GLM 5.3 GLM 5.3 low Release: 2026-08-20

Metric	Beam 1.0 501B A23B Beam 1.0 501B A23B medium Release: 2026-10-17	GLM 5.3 GLM 5.3 low Release: 2026-08-20
Score	6.6	6.5
Rank	#220	#227
Reliability	10.0	10.0
Consistency	9.3	8.3
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	65.2%	63.8%
Flaky tests	2	5
Total Runs	69	69
Cost per result	3.561	3.923
Total Cost	$0.499	$0.215
Input Price	$1.000 / 1M	$0.070 / 1M
Output Price	$3.000 / 1M	$7.000 / 1M
Cache Read Price	$0.100 / 1M	$0.065 / 1M
Cache Write Price	N/A	N/A
Total Input Tokens	202,937	247,871
Output Tokens	4,328	10,791
Reasoning Tokens	94,193	17,315
Response Time (avg)	6.27s	15.18s
Response Time (max)	31.55s	83.60s
Response Time (total)	144.28s	349.06s
Parameters	501B total (23B active)	744B total (40B active)
Availability	Open source	Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#220 Beam 1.0 501B A23B

medium

Cost: $0.005
Time: 11.8s
Tokens: 4,267 tok

#227 GLM 5.3

low

Cost: $0.007
Time: 28.4s
Tokens: 1,599 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Beam 1.0 501B A23B	3.0	10.0	0.0%	0		31.55s	172,837	2,588	9,026
GLM 5.3	5.2	3.2	33.3%	1		48.84s	142,882	2,259	1,039

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Beam 1.0 501B A23B	10.0	10.0	100.0%	0		1.62s	1,113	232	4,706
GLM 5.3	6.9	7.9	66.7%	1		4.16s	639	266	249

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Beam 1.0 501B A23B	10.0	10.0	100.0%	0		11.81s	7,791	440	27,204
GLM 5.3	6.2	6.9	55.6%	1		21.02s	7,317	368	6,764

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Beam 1.0 501B A23B	3.0	10.0	0.0%	0		2.62s	7,665	132	2,087
GLM 5.3	3.8	5.8	33.3%	1		53.02s	80,209	6,729	5,209

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Beam 1.0 501B A23B	10.0	10.0	100.0%	0		1.24s	7,993	279	1,614
GLM 5.3	10.0	10.0	100.0%	0		3.42s	7,149	210	56

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Beam 1.0 501B A23B	2.9	7.2	11.1%	1		11.66s	1,113	71	29,077
GLM 5.3	5.3	10.0	33.3%	0		19.23s	759	35	3,384

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Beam 1.0 501B A23B	4.7	1.6	66.7%	1		1.87s	615	96	1,532
GLM 5.3	4.1	2.7	33.3%	1		4.70s	498	163	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Beam 1.0 501B A23B	9.8	10.0	100.0%	0		1.24s	918	102	1,834
GLM 5.3	10.0	10.0	100.0%	0		3.40s	678	72	81

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Beam 1.0 501B A23B	10.0	10.0	100.0%	0		3.91s	1,029	281	9,130
GLM 5.3	10.0	10.0	100.0%	0		4.20s	672	389	225

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Beam 1.0 501B A23B	3.0	10.0	0.0%	0		1.95s	1,530	72	440
GLM 5.3	10.0	10.0	100.0%	0		18.45s	6,861	231	0

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Beam 1.0 501B A23B	3.0	10.0	0.0%	0		10.13s	333	35	7,543
GLM 5.3	3.0	10.0	0.0%	0		7.42s	207	69	308

Switch Comparison Pair

Beam 1.0 501B A23BxhighvsGLM 5.3low KAT-Coder-Pro V2.5lowvsBeam 1.0 501B A23Bmedium Beam 1.0 501B A23BmediumvsStep 3.7 Flashhigh Mercury 2.5highvsGLM 5.3low Mercury 2.5 PreviewhighvsGLM 5.3low KAT-Coder-Pro V2.5highvsGLM 5.3low Grok 4.3mediumvsGLM 5.3low Qwen3.6 35B A3BmediumvsGLM 5.3low Laguna XS 2.1mediumFree AvailablevsGLM 5.3low Qwen3.5-122B-A10BnonevsGLM 5.3low Claude Sonnet 5.5mediumvsGLM 5.3low LongCat 2.0lowvsBeam 1.0 501B A23Bmedium