OpenAI: GPT-5.4 vs Qwen: Qwen3.5-35B-A3B

Qwen3.5-35B-A3B leads on average score with 6.1 vs 5.8. Qwen3.5-35B-A3B has the lower benchmark cost at $0.106 vs $0.397. GPT-5.4 is faster at 2.07s vs 12.72s, with pass rates of 34.9% vs 43.9%.

Recommended modelQwen3.5-35B-A3BIt has the best score here (6.1), while costing about 3.8x less than GPT-5.4.

Last updated at: 2026-07-18

Metric	GPT-5.4 GPT-5.4 none Release: 2026-03-05	Qwen3.5-35B-A3B Qwen3.5-35B-A3B none Release: 2026-02-24

Metric	GPT-5.4 GPT-5.4 none Release: 2026-03-05	Qwen3.5-35B-A3B Qwen3.5-35B-A3B none Release: 2026-02-24
Score	5.8	6.1
Rank	#135	#123
Reliability	10.0	10.0
Consistency	9.2	8.6
Tests Correct
Attempt pass rate	34.9%	43.9%
Flaky tests	2	4
Total Runs	66	66
Cost per result	5.663	1.578
Total Cost	$0.397	$0.106
Input Price	$2.500 / 1M	$0.140 / 1M
Output Price	$15.000 / 1M	$1.000 / 1M
Total Input Tokens	108,632	134,521
Output Tokens	8,321	86,614
Reasoning Tokens	0	0
Response Time (avg)	2.07s	12.72s
Response Time (max)	15.63s	209.15s
Response Time (total)	45.51s	279.90s

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#135 GPT-5.4

none

Cost: $0.026
Time: 18.1s
Tokens: 1,792 tok

#123 Qwen3.5-35B-A3B

none

Cost: $0.005
Time: 28.4s
Tokens: 4,518 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.4	3.2	8.0	8.3%	1		1.21s	606	406	0
Qwen3.5-35B-A3B	3.4	7.9	16.7%	1		1.43s	696	574	0

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.4	5.5	10.0	33.3%	0		1.62s	7,305	516	0
Qwen3.5-35B-A3B	5.5	10.0	33.3%	0		1.39s	7,808	571	0

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.4	3.0	10.0	0.0%	0		9.26s	85,439	6,195	0
Qwen3.5-35B-A3B	3.8	5.8	33.3%	1		128.29s	107,066	84,104	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.4	10.0	10.0	100.0%	0		1.04s	7,140	222	0
Qwen3.5-35B-A3B	10.0	10.0	100.0%	0		1.16s	7,794	243	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.4	5.3	7.2	44.4%	1		1.07s	723	50	0
Qwen3.5-35B-A3B	7.7	10.0	66.7%	0		485ms	789	15	0

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.4	4.4	9.9	0.0%	0		1.78s	477	184	0
Qwen3.5-35B-A3B	6.5	3.4	66.7%	1		1.19s	522	114	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.4	6.5	10.0	50.0%	0		1.07s	660	81	0
Qwen3.5-35B-A3B	6.3	10.0	50.0%	0		809ms	711	63	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.4	5.6	9.8	33.3%	0		1.44s	642	381	0
Qwen3.5-35B-A3B	3.7	7.4	22.2%	1		1.35s	714	655	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.4	10.0	10.0	100.0%	0		2.75s	5,445	246	0
Qwen3.5-35B-A3B	10.0	10.0	100.0%	0		2.30s	8,211	264	0

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.4	3.0	10.0	0.0%	0		990ms	195	40	0
Qwen3.5-35B-A3B	3.0	10.0	0.0%	0		493ms	210	11	0

Quick Compare

Switch Comparison Pair

GPT-5 NanomediumvsQwen3.5-35B-A3Bnone Qwen3.5-35B-A3BnonevsInklinglow Qwen3.5-35B-A3BnonevsStep 3.5 Flashmedium gpt-oss-120bmediumvsQwen3.5-35B-A3Bnone Nemotron 3 SupermediumFree AvailablevsGPT-5.4none Gemini 3.1 Flash LiteminimalvsQwen3.5-35B-A3Bnone North Mini CodemediumFree AvailablevsGPT-5.4none GPT-5.6 LunalowvsQwen3.5-35B-A3Bnone KAT-Coder-Air V2.5highvsGPT-5.4none North Mini CodemediumFree AvailablevsQwen3.5-35B-A3Bnone KAT-Coder-Air V2.5mediumvsGPT-5.4none Gemma 4 31BmediumFree AvailablevsQwen3.5-35B-A3Bnone