GPT-5.4 Mini (medium) vs GLM 5.3 FlashX (max)

Compared models

Recommended model GLM 5.3 FlashX (max)

It has the best score here (7.9), while costing about 1.6x less than GPT-5.4 Mini (medium).

Metric	GPT-5.4 Mini GPT-5.4 Mini medium Release: 2026-03-17	GLM 5.3 FlashX GLM 5.3 FlashX max Release: 2026-09-21

Metric	GPT-5.4 Mini GPT-5.4 Mini medium Release: 2026-03-17	GLM 5.3 FlashX GLM 5.3 FlashX max Release: 2026-09-21
Score	7.9	7.9
Rank	#99	#97
Reliability	10.0	10.0
Consistency	8.2	8.0
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	69.6%	78.3%
Flaky tests	5	6
Total Runs	69	69
Cost per result	7.754	4.153
Total Cost	$1.008	$0.623
Input Price	$0.750 / 1M	$0.370 / 1M
Output Price	$4.500 / 1M	$1.250 / 1M
Total Input Tokens	238,925	322,894
Output Tokens	7,109	8,010
Reasoning Tokens	177,063	394,755
Response Time (avg)	29.94s	43.97s
Response Time (max)	138.75s	390.70s
Response Time (total)	688.57s	1011.29s
Parameters	~400B total (~17B active)	320B total (18B active)
Availability	Closed	Closed

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

medium

max

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.4 Mini	10.0	10.0	100.0%	0		100.66s	141,761	898	24,930
GLM 5.3 FlashX	6.1	3.1	66.7%	1		104.77s	221,683	1,709	25,322

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.4 Mini	8.6	7.9	91.7%	1		4.05s	606	296	2,876
GLM 5.3 FlashX	10.0	10.0	100.0%	0		2.65s	639	301	2,210

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.4 Mini	8.4	7.4	88.9%	1		57.87s	7,305	467	40,902
GLM 5.3 FlashX	8.2	7.2	88.9%	1		24.61s	7,317	463	36,503

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.4 Mini	6.9	5.9	66.7%	1		59.64s	74,058	4,347	40,924
GLM 5.3 FlashX	8.2	6.9	66.7%	1		45.23s	76,431	3,485	35,762

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.4 Mini	10.0	10.0	100.0%	0		2.43s	7,140	234	650
GLM 5.3 FlashX	10.0	10.0	100.0%	0		3.38s	7,149	223	2,262

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.4 Mini	3.6	7.2	22.2%	1		71.05s	628	60	49,875
GLM 5.3 FlashX	3.5	4.4	33.3%	2		224.00s	759	583	279,058

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.4 Mini	4.5	10.0	0.0%	0		3.72s	477	150	510
GLM 5.3 FlashX	10.0	10.0	100.0%	0		5.01s	498	209	1,290

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.4 Mini	9.8	10.0	100.0%	0		2.13s	660	96	1,185
GLM 5.3 FlashX	9.9	10.0	100.0%	0		2.23s	678	72	1,032

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.4 Mini	7.8	10.0	66.7%	0		4.37s	642	278	2,443
GLM 5.3 FlashX	8.2	7.7	77.8%	1		3.88s	672	456	2,848

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.4 Mini	4.7	1.6	66.7%	1		9.62s	5,453	251	2,594
GLM 5.3 FlashX	10.0	10.0	100.0%	0		9.39s	6,861	231	712

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.4 Mini	3.0	10.0	0.0%	0		30.10s	195	32	10,174
GLM 5.3 FlashX	3.0	10.0	0.0%	0		22.41s	207	278	7,756

Switch Comparison Pair