AI BENCHY Compare

OpenAI: GPT-5.2 Chat vs Qwen: Qwen3.5-35B-A3B

Last updated at: 2026-05-01

Metric	GPT-5.2 Chat GPT-5.2 Chat none Release: 2025-12-11	Qwen3.5-35B-A3B Qwen3.5-35B-A3B medium Release: 2026-02-24

Metric	GPT-5.2 Chat GPT-5.2 Chat none Release: 2025-12-11	Qwen3.5-35B-A3B Qwen3.5-35B-A3B medium Release: 2026-02-24
Score	7.9	7.4
Rank	#39	#57
Reliability	N/A	N/A
Consistency	8.7	6.7
Tests Correct
Attempt pass rate	75.9%	79.6%
Flaky tests	3	7
Total Runs	54	54
Cost per result	2.424	3.976
Total Cost	$0.291	$0.398
Input Price	$1.750 / 1M	$0.163 / 1M
Output Price	$14.000 / 1M	$1.300 / 1M
Output Tokens	17,346	10,137
Reasoning Tokens	0	208,761
Response Time (avg)	6.84s	44.51s
Response Time (max)	38.52s	106.00s
Response Time (total)	123.17s	801.21s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	8.7	7.9	91.7%	1		3.40s	1,807	0
Qwen3.5-35B-A3B	10.0	10.0	100.0%	0		21.13s	798	42,652

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	10.0	10.0	100.0%	0		8.97s	1,345	0
Qwen3.5-35B-A3B	10.0	10.0	100.0%	0		79.09s	4,273	33,078

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	10.0	10.0	100.0%	0		9.12s	1,243	0
Qwen3.5-35B-A3B	4.7	1.6	66.7%	1		75.34s	775	12,485

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	10.0	10.0	100.0%	0		3.05s	980	0
Qwen3.5-35B-A3B	7.3	5.9	83.3%	1		59.33s	235	19,493

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	5.3	10.0	33.3%	0		17.78s	7,810	0
Qwen3.5-35B-A3B	4.1	4.4	44.5%	2		88.34s	41	46,368

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	4.4	3.0	33.3%	1		3.20s	335	0
Qwen3.5-35B-A3B	2.8	1.6	33.3%	1		30.30s	20	3,753

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	7.3	5.9	83.3%	1		5.46s	1,528	0
Qwen3.5-35B-A3B	10.0	10.0	100.0%	0		24.45s	97	17,361

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	7.7	10.0	66.7%	0		4.42s	1,743	0
Qwen3.5-35B-A3B	6.4	4.4	77.8%	2		31.58s	3,589	32,206

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	10.0	10.0	100.0%	0		4.68s	555	0
Qwen3.5-35B-A3B	10.0	10.0	100.0%	0		4.65s	309	1,365

Quick Compare

Switch Comparison Pair

Claude Sonnet 4.6nonevsQwen3.5-35B-A3Bmedium GPT-5.2 ChatnonevsStep 3.5 Flashmedium DeepSeek V3.2mediumvsGPT-5.2 Chatnone DeepSeek V4 FlashhighvsGPT-5.2 Chatnone GPT-5.2 ChatnonevsGLM 5V Turbomedium Claude Sonnet 4.6mediumvsGPT-5.2 Chatnone GPT-5.2 ChatnonevsQwen3.5-Flashmedium Gemma 4 26B A4BmediumFree AvailablevsGPT-5.2 Chatnone GPT-5.2 ChatnonevsGLM 5.1medium GPT-5.2 ChatnonevsHY3 PreviewmediumFree Available GPT-5.2 ChatnonevsQwen3.5 Plus 2026-04-20medium GPT-5.2 ChatnonevsMiMo-V2-Promedium