GPT-5.4 vs Hy4

Compared models

Rank: #341
Total Output Tokens: 9,372
Response Time (avg): 3.89s
Total Cost: $0.690

Rank: #337
Total Output Tokens: 12,248
Response Time (avg): 5.87s
Total Cost: $0.114

Recommended model Hy4

It has the best score here (5.7), while costing about 6.1x less than GPT-5.4.

Detailed comparison

Metric	GPT-5.4 GPT-5.4 none Release: 2026-03-05	Hy4 Hy4 none Release: 2026-11-04

Metric	GPT-5.4 GPT-5.4 none Release: 2026-03-05	Hy4 Hy4 none Release: 2026-11-04
Score	5.6	5.7
Rank	#341	#337
Reliability	10.0	10.0
Consistency	9.3	9.7
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	33.3%	40.6%
Flaky tests	2	1
Total Runs	69	69
Cost per result	9.845	1.263
Total Cost	$0.690	$0.114
Input Price	$2.500 / 1M	$0.417 / 1M
Output Price	$15.000 / 1M	$1.251 / 1M
Cache Read Price	$0.250 / 1M	$0.021 / 1M
Cache Write Price	N/A	N/A
Total Input Tokens	219,404	235,746
Output Tokens	9,372	12,248
Reasoning Tokens	0	0
Response Time (avg)	3.89s	5.87s
Response Time (max)	43.73s	75.59s
Response Time (total)	89.48s	135.00s
Parameters	~1.5T total (~100B active)	~770B total (~49B active)
Availability	Closed	Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#341 GPT-5.4

none

Cost: $0.026
Time: 18.1s
Tokens: 1,792 tok

#337 Hy4

none

Cost: $0.004
Time: 22.4s
Tokens: 2,679 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.4	5.0	10.0	0.0%	0		43.73s	110,763	1,033	0
Hy4	4.7	3.1	33.3%	1		75.59s	163,245	8,408	0

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.4	3.2	8.0	8.3%	1		1.21s	606	406	0
Hy4	3.6	10.0	0.0%	0		2.42s	786	978	0

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.4	5.5	10.0	33.3%	0		1.62s	7,305	516	0
Hy4	5.5	10.0	33.3%	0		1.68s	7,554	341	0

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.4	3.0	10.0	0.0%	0		9.26s	85,439	6,195	0
Hy4	3.0	10.0	0.0%	0		7.14s	41,262	648	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.4	10.0	10.0	100.0%	0		1.04s	7,140	222	0
Hy4	10.0	10.0	100.0%	0		1.51s	7,215	189	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.4	5.3	7.2	44.4%	1		1.15s	732	68	0
Hy4	5.3	10.0	33.3%	0		1.46s	858	26	0

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.4	4.4	9.9	0.0%	0		1.78s	477	184	0
Hy4	5.5	10.0	0.0%	0		1.57s	534	117	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.4	6.5	10.0	50.0%	0		1.07s	660	81	0
Hy4	10.0	10.0	100.0%	0		1.64s	750	70	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.4	5.6	9.8	33.3%	0		1.44s	642	381	0
Hy4	10.0	10.0	100.0%	0		2.00s	777	417	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.4	10.0	10.0	100.0%	0		2.75s	5,445	246	0
Hy4	3.0	10.0	0.0%	0		8.20s	12,510	465	0

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.4	3.0	10.0	0.0%	0		990ms	195	40	0
Hy4	3.0	10.0	0.0%	0		3.95s	255	589	0

Switch Comparison Pair

Dots 3 Note PreviewmediumFree AvailablevsHy4none GPT-5.4nonevsSpace Bunny Alphalow GPT-5.4nonevsStep 5 Previewlow GPT-5 NanomediumvsHy4none Trinity Large ThinkinghighvsHy4none Ring 2.6 1tmediumvsHy4none Space Bunny AlphalowvsHy4none Dots 3 Note PreviewmediumFree AvailablevsGPT-5.4none Ling 3.0 FlashhighvsHy4none Step 5 PreviewlowvsHy4none Trinity Large ThinkinghighvsGPT-5.4none Ring 2.6 1tmediumvsGPT-5.4none