AI BENCHY Compare

OpenAI: GPT-5.3 Chat vs Qwen: Qwen3.5-35B-A3B

Last updated at: 2026-03-15

Metric	GPT-5.3 Chat GPT-5.3 Chat none Release: 2026-03-03	Qwen3.5-35B-A3B Qwen3.5-35B-A3B medium Release: 2026-02-24

Metric	GPT-5.3 Chat GPT-5.3 Chat none Release: 2026-03-03	Qwen3.5-35B-A3B Qwen3.5-35B-A3B medium Release: 2026-02-24
Rank	#23	#33
Score	7.8	7.1
Consistency	8.5	6.3
Cost per result	3.163	4.251
Total Cost	$0.317	$0.341
Tests Correct
Attempt pass rate	70.8%	77.1%
Flaky tests	3	7
Total Runs	48	48
Output Tokens	19,272	5,495
Reasoning Tokens	0	169,266
Response Time (avg)	5.96s	43.93s
Response Time (max)	18.33s	106.00s
Response Time (total)	95.30s	702.85s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.3 Chat	7.9	7.5	77.8%	1		4.72s	3,091	0
Qwen3.5-35B-A3B	10.0	10.0	100.0%	0		21.75s	429	36,235

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.3 Chat	10.0	10.0	100.0%	0		11.96s	2,614	0
Qwen3.5-35B-A3B	4.7	1.6	66.7%	1		75.34s	775	12,485

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.3 Chat	10.0	10.0	100.0%	0		2.21s	942	0
Qwen3.5-35B-A3B	7.3	5.9	83.3%	1		59.33s	235	19,493

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.3 Chat	3.5	4.4	33.3%	2		13.01s	8,264	0
Qwen3.5-35B-A3B	4.1	4.4	44.5%	2		88.34s	41	46,368

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.3 Chat	4.6	10.0	0.0%	0		1.99s	319	0
Qwen3.5-35B-A3B	2.8	1.6	33.3%	1		30.30s	20	3,753

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.3 Chat	8.3	10.0	50.0%	0		3.29s	1,455	0
Qwen3.5-35B-A3B	10.0	10.0	100.0%	0		24.45s	97	17,361

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.3 Chat	10.0	10.0	100.0%	0		2.93s	1,726	0
Qwen3.5-35B-A3B	6.4	4.4	77.8%	2		31.58s	3,589	32,206

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.3 Chat	10.0	10.0	100.0%	0		8.36s	861	0
Qwen3.5-35B-A3B	10.0	10.0	100.0%	0		4.65s	309	1,365

Quick Compare

Switch Comparison Pair

GPT-5.3 ChatnonevsQwen3.5-Flashmedium Gemini 3.1 Flash Lite PreviewlowvsGPT-5.3 Chatnone GPT-5.3 ChatnonevsGrok 4.20 Betamedium GPT-5.3 ChatnonevsStep 3.5 FlashmediumFree Available GPT-5.3 ChatnonevsGLM 5 Turbomedium GPT-5.3 ChatnonevsMiMo-V2-Flashmedium Gemini 3.1 Flash Lite PreviewmediumvsGPT-5.3 Chatnone Qwen3.5-35B-A3BmediumvsGLM 5none Seed-2.0-MinimediumvsGPT-5.3 Chatnone Gemini 2.5 FlashmediumvsGPT-5.3 Chatnone DeepSeek V3.2mediumvsGPT-5.3 Chatnone GPT-5.3 ChatnonevsGLM 5medium