GPT-6.1 Sol (low) vs GLM 5.2 (high)

Compared models

Rank: #16
Total Output Tokens: 13,138
Response Time (avg): 7.15s
Total Cost: $0.460

Rank: #78
Total Output Tokens: 382,333
Response Time (avg): 69.11s
Total Cost: $4.632

Recommended model GPT-6.1 Sol (low)

It has the best score here (9.6), while costing about 10.1x less than GLM 5.2 (high).

Detailed comparison

Metric	GPT-6.1 Sol GPT-6.1 Sol low Release: 2026-09-29	GLM 5.2 GLM 5.2 high Release: 2026-06-17

Metric	GPT-6.1 Sol GPT-6.1 Sol low Release: 2026-09-29	GLM 5.2 GLM 5.2 high Release: 2026-06-17
Score	9.6	8.4
Rank	#16	#78
Reliability	10.0	10.0
Consistency	9.6	8.6
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	92.8%	71.0%
Flaky tests	1	3
Total Runs	69	69
Cost per result	2.187	7.314
Total Cost	$0.460	$4.632
Input Price	$2.000 / 1M	$0.153 / 1M
Output Price	$10.000 / 1M	$12.000 / 1M
Cache Read Price	$0.100 / 1M	$0.150 / 1M
Cache Write Price	$2.500 / 1M	N/A
Total Input Tokens	163,900	288,913
Output Tokens	4,958	79,462
Reasoning Tokens	8,180	303,120
Response Time (avg)	7.15s	69.11s
Response Time (max)	46.57s	599.43s
Response Time (total)	164.47s	1589.43s
Parameters	~2T total (~150B active)	744B total (40B active)
Availability	Closed	Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#16 GPT-6.1 Sol

low

Cost: $0.028
Time: 44.6s
Tokens: 2,881 tok

#78 GLM 5.2

high

Reached the allocated time limit (300 seconds) without receiving showcase output.

Cost: $0.000
Time: 300.0s
Tokens: 0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6.1 Sol	10.0	10.0	100.0%	0		46.57s	85,882	798	461
GLM 5.2	10.0	10.0	100.0%	0		52.45s	205,091	7,422	10,505

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6.1 Sol	10.0	10.0	100.0%	0		2.14s	606	147	226
GLM 5.2	10.0	10.0	100.0%	0		5.80s	639	406	2,660

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6.1 Sol	10.0	10.0	100.0%	0		4.48s	7,302	388	1,286
GLM 5.2	6.4	8.6	33.3%	0		73.03s	5,124	2,302	22,546

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6.1 Sol	10.0	10.0	100.0%	0		10.94s	54,810	2,619	370
GLM 5.2	10.0	10.0	100.0%	0		321.47s	61,516	18,824	63,861

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6.1 Sol	10.0	10.0	100.0%	0		1.94s	7,140	222	0
GLM 5.2	10.0	10.0	100.0%	0		5.81s	7,143	435	1,414

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6.1 Sol	7.7	10.0	66.7%	0		15.39s	732	69	5,195
GLM 5.2	3.1	6.5	11.1%	1		126.85s	560	49,045	157,522

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6.1 Sol	10.0	10.0	100.0%	0		3.66s	477	114	142
GLM 5.2	10.0	10.0	100.0%	0		12.90s	498	63	1,743

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6.1 Sol	10.0	10.0	100.0%	0		2.21s	660	93	115
GLM 5.2	10.0	10.0	100.0%	0		4.26s	678	151	1,210

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6.1 Sol	10.0	10.0	100.0%	0		2.19s	642	232	88
GLM 5.2	6.0	4.6	66.7%	2		33.71s	665	568	22,392

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6.1 Sol	10.0	10.0	100.0%	0		5.53s	5,454	246	0
GLM 5.2	10.0	10.0	100.0%	0		9.25s	6,861	246	503

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6.1 Sol	2.8	1.6	33.3%	1		3.80s	195	30	297
GLM 5.2	3.0	10.0	0.0%	0		127.82s	138	0	18,764

Switch Comparison Pair

Gemini 3 Flash PreviewmediumvsGPT-6.1 Sollow Gemini 3.7 FlashmediumvsGPT-6.1 Sollow Kimi K3maxvsGLM 5.2high Gemini 3.1 Pro PreviewmediumvsGLM 5.2high Muse Glimmer 30BxhighvsGLM 5.2high GPT-5 MinimediumvsGLM 5.2high Qwen3.8 2.4T A95BlowvsGLM 5.2high GPT-6 LunamediumvsGLM 5.2high Claude Opus 4.8mediumvsGLM 5.2high Ling 3.1 FlashmediumvsGLM 5.2high Qwen3.7 PlusmediumvsGLM 5.2high GPT-5.6 TerramediumvsGLM 5.2high