OpenAI: GPT-5.3 Chat vs Qwen: Qwen3.7 Max

GPT-5.3 Chat leads on average score with 7.5 vs 7.4. Qwen3.7 Max has the lower benchmark cost at $0.197 vs $0.571. Qwen3.7 Max is faster at 4.52s vs 6.88s, with pass rates of 68.2% vs 68.2%.

Recommended modelQwen3.7 MaxIts score stays close to the best score here (7.4 vs 7.5), while costing about 2.9x less than GPT-5.3 Chat.

Rank: #62
Attempt pass rate: 68.2%
Total Output Tokens: 30,854
Response Time (avg): 6.88s
Total Cost: $0.571

Rank: #67
Attempt pass rate: 68.2%
Total Output Tokens: 12,446
Response Time (avg): 4.52s
Total Cost: $0.197

Last updated at: 2026-07-25

Metric	GPT-5.3 Chat GPT-5.3 Chat none Release: 2026-03-03	Qwen3.7 Max Qwen3.7 Max none Release: 2026-05-22

Metric	GPT-5.3 Chat GPT-5.3 Chat none Release: 2026-03-03	Qwen3.7 Max Qwen3.7 Max none Release: 2026-05-22
Score	7.5	7.4
Rank	#62	#67
Reliability	10.0	9.9
Consistency	8.2	10.0
Tests Correct
Attempt pass rate	68.2%	68.2%
Flaky tests	5	0
Total Runs	66	66
Cost per result	4.387	1.582
Total Cost	$0.571	$0.197
Input Price	$1.750 / 1M	$1.475 / 1M
Output Price	$14.000 / 1M	$4.425 / 1M
Total Input Tokens	78,990	95,983
Output Tokens	30,854	12,446
Reasoning Tokens	0	0
Response Time (avg)	6.88s	4.52s
Response Time (max)	18.33s	72.30s
Response Time (total)	151.31s	99.52s

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#62 GPT-5.3 Chat

none

Cost: $0.008
Time: 8.1s
Tokens: 634 tok

#67 Qwen3.7 Max

none

Cost: $0.046
Time: 195.0s
Tokens: 12,171 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.3 Chat	6.7	8.1	58.3%	1		3.86s	606	3,167	0
Qwen3.7 Max	6.5	10.0	50.0%	0		1.08s	696	242	0

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.3 Chat	5.6	4.7	55.6%	2		10.52s	7,302	6,632	0
Qwen3.7 Max	5.5	10.0	33.3%	0		1.35s	7,911	582	0

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.3 Chat	10.0	10.0	100.0%	0		15.07s	55,800	6,851	0
Qwen3.7 Max	6.5	10.0	50.0%	0		37.23s	68,425	10,623	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.3 Chat	10.0	10.0	100.0%	0		2.21s	7,140	942	0
Qwen3.7 Max	10.0	10.0	100.0%	0		1.35s	7,794	243	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.3 Chat	3.5	4.4	33.3%	2		13.01s	723	8,264	0
Qwen3.7 Max	7.7	10.0	66.7%	0		975ms	789	15	0

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.3 Chat	4.6	10.0	0.0%	0		1.99s	477	319	0
Qwen3.7 Max	10.0	10.0	100.0%	0		1.04s	522	120	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.3 Chat	9.8	10.0	100.0%	0		3.51s	660	1,491	0
Qwen3.7 Max	10.0	10.0	100.0%	0		943ms	711	72	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.3 Chat	10.0	10.0	100.0%	0		2.99s	642	1,758	0
Qwen3.7 Max	10.0	10.0	100.0%	0		1.13s	714	314	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.3 Chat	10.0	10.0	100.0%	0		8.36s	5,445	861	0
Qwen3.7 Max	10.0	10.0	100.0%	0		3.92s	8,211	222	0

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.3 Chat	3.0	10.0	0.0%	0		4.38s	195	569	0
Qwen3.7 Max	3.0	10.0	0.0%	0		856ms	210	13	0

Quick Compare

Switch Comparison Pair

Kimi K2.7 CodemediumvsGPT-5.3 Chatnone LongCat 2.0mediumvsQwen3.7 Maxnone GPT-5.3 ChatnonevsQwen3.5 Plus 2026-02-15medium Nemotron 3 UltramediumFree AvailablevsGPT-5.3 Chatnone GPT-5.4 MinimediumvsQwen3.7 Maxnone GPT-5.6 TerralowvsQwen3.7 Maxnone Gemini 3 Flash PreviewlowvsQwen3.7 Maxnone GPT-5.3 ChatnonevsQwen3.5-27Bmedium KAT-Coder-Pro V2.5lowvsQwen3.7 Maxnone GPT-5.3 ChatnonevsGrok Build 0.1medium GPT-5.4 NanomediumvsQwen3.7 Maxnone Kimi K2.7 CodemediumvsQwen3.7 Maxnone