AI BENCHY Compare

OpenAI: GPT-5.2 Chat vs Qwen: Qwen3.5-35B-A3B

Last updated at: 2026-03-17

Metric	GPT-5.2 Chat GPT-5.2 Chat none Release: 2025-12-11	Qwen3.5-35B-A3B Qwen3.5-35B-A3B medium Release: 2026-02-24

Metric	GPT-5.2 Chat GPT-5.2 Chat none Release: 2025-12-11	Qwen3.5-35B-A3B Qwen3.5-35B-A3B medium Release: 2026-02-24
Rank	#24	#31
Score	7.8	7.3
Consistency	8.6	6.6
Cost per result	2.462	3.877
Total Cost	$0.271	$0.349
Tests Correct
Attempt pass rate	74.5%	78.4%
Flaky tests	3	7
Total Runs	51	51
Output Tokens	16,001	5,864
Reasoning Tokens	0	175,683
Response Time (avg)	6.72s	42.48s
Response Time (max)	38.52s	106.00s
Response Time (total)	114.20s	722.12s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	8.7	7.9	91.7%	1		3.40s	1,807	0
Qwen3.5-35B-A3B	10.0	10.0	100.0%	0		21.13s	798	42,652

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	10.0	10.0	100.0%	0		9.12s	1,243	0
Qwen3.5-35B-A3B	4.7	1.6	66.7%	1		75.34s	775	12,485

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	10.0	10.0	100.0%	0		3.05s	980	0
Qwen3.5-35B-A3B	7.3	5.9	83.3%	1		59.33s	235	19,493

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	5.3	10.0	33.3%	0		17.78s	7,810	0
Qwen3.5-35B-A3B	4.1	4.4	44.5%	2		88.34s	41	46,368

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	4.4	3.0	33.3%	1		3.20s	335	0
Qwen3.5-35B-A3B	2.8	1.6	33.3%	1		30.30s	20	3,753

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	7.5	6.1	83.3%	1		5.46s	1,528	0
Qwen3.5-35B-A3B	10.0	10.0	100.0%	0		24.45s	97	17,361

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	7.7	10.0	66.7%	0		4.42s	1,743	0
Qwen3.5-35B-A3B	6.4	4.4	77.8%	2		31.58s	3,589	32,206

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	10.0	10.0	100.0%	0		4.68s	555	0
Qwen3.5-35B-A3B	10.0	10.0	100.0%	0		4.65s	309	1,365

Quick Compare

Switch Comparison Pair

Claude Sonnet 4.6nonevsQwen3.5-35B-A3Bmedium GPT-5.2 ChatnonevsStep 3.5 FlashmediumFree Available GPT-5.2 ChatnonevsGrok 4.20 Betamedium Claude Sonnet 4.6mediumvsGPT-5.2 Chatnone GPT-5.2 ChatnonevsQwen3.5-Flashmedium GPT-5.2 ChatnonevsMiMo-V2-Flashmedium Gemini 3.1 Flash Lite PreviewlowvsGPT-5.2 Chatnone GPT-5.2 ChatnonevsGLM 5 Turbomedium GPT-5.3 ChatnonevsQwen3.5-35B-A3Bmedium Claude Opus 4.6mediumvsGPT-5.2 Chatnone Gemini 3.1 Flash Lite PreviewmediumvsGPT-5.2 Chatnone Gemini 2.5 FlashmediumvsGPT-5.2 Chatnone