gpt-oss-120b (medium) vs GLM 5.3 FlashX (low)

Compared models

Recommended model gpt-oss-120b (medium)

Its score stays close to the best score here (5.9 vs 6.0), while costing about 5.4x less than GLM 5.3 FlashX (low).

Metric	gpt-oss-120b gpt-oss-120b medium Release: 2025-08-05	GLM 5.3 FlashX GLM 5.3 FlashX low Release: 2026-09-21

Metric	gpt-oss-120b gpt-oss-120b medium Release: 2025-08-05	GLM 5.3 FlashX GLM 5.3 FlashX low Release: 2026-09-21
Score	5.9	6.0
Rank	#243	#238
Reliability	10.0	10.0
Consistency	8.1	6.8
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	47.8%	63.8%
Flaky tests	5	9
Total Runs	69	69
Cost per result	0.335	1.423
Total Cost	$0.030	$0.157
Input Price	$0.037 / 1M	$0.370 / 1M
Output Price	$0.170 / 1M	$1.250 / 1M
Total Input Tokens	285,293	277,028
Output Tokens	29,565	11,965
Reasoning Tokens	89,266	31,238
Response Time (avg)	31.58s	9.69s
Response Time (max)	203.90s	77.99s
Response Time (total)	536.78s	222.83s
Parameters	117B total (5.1B active)	320B total (18B active)
Availability	Open source	Closed

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

medium

low

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
gpt-oss-120b	5.0	10.0	0.0%	0		203.90s	176,526	187	20,362
GLM 5.3 FlashX	4.7	3.1	33.3%	1		77.99s	159,703	1,471	4,696

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
gpt-oss-120b	6.7	9.9	50.0%	0		10.21s	1,314	3,518	2,177
GLM 5.3 FlashX	8.2	7.9	83.3%	1		1.56s	639	278	353

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
gpt-oss-120b	5.9	7.0	55.6%	1		38.37s	7,782	3,365	11,973
GLM 5.3 FlashX	5.5	7.4	44.4%	1		5.45s	7,317	382	4,760

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
gpt-oss-120b	6.5	10.0	50.0%	0		23.96s	81,198	10,453	22,883
GLM 5.3 FlashX	2.8	1.6	33.3%	2		42.40s	92,545	8,581	18,553

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
gpt-oss-120b	6.4	5.9	66.7%	1		1.98s	7,476	241	1,114
GLM 5.3 FlashX	10.0	10.0	100.0%	0		1.59s	7,149	210	81

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
gpt-oss-120b	2.9	4.4	22.2%	2		27.55s	1,286	6,390	21,466
GLM 5.3 FlashX	3.5	4.4	33.3%	2		3.87s	759	36	2,040

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
gpt-oss-120b	4.3	10.0	0.0%	0		7.90s	659	107	387
GLM 5.3 FlashX	4.7	1.6	66.7%	1		2.07s	498	137	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
gpt-oss-120b	9.9	10.0	100.0%	0		7.63s	1,036	126	1,799
GLM 5.3 FlashX	10.0	10.0	100.0%	0		1.34s	678	72	84

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
gpt-oss-120b	5.3	7.2	44.4%	1		21.71s	1,190	1,790	2,264
GLM 5.3 FlashX	7.7	7.3	77.8%	1		1.89s	672	460	336

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
gpt-oss-120b	9.8	10.0	100.0%	0		6.91s	6,514	287	1,083
GLM 5.3 FlashX	10.0	10.0	100.0%	0		9.52s	6,861	231	20

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
gpt-oss-120b	3.0	10.0	0.0%	0		26.51s	312	3,101	3,758
GLM 5.3 FlashX	3.0	10.0	0.0%	0		2.69s	207	107	315

Switch Comparison Pair