AI BENCHY Compare

OpenAI: GPT-5.2 Chat vs Qwen: Qwen3.6 35B A3B

Last updated at: 2026-04-27

Metric	GPT-5.2 Chat GPT-5.2 Chat none Release: 2025-12-11	Qwen3.6 35B A3B Qwen3.6 35B A3B medium Release: 2026-04-20

Metric	GPT-5.2 Chat GPT-5.2 Chat none Release: 2025-12-11	Qwen3.6 35B A3B Qwen3.6 35B A3B medium Release: 2026-04-20
Score	7.9	8.8
Rank	#38	#9
Reliability	N/A	10.0
Consistency	8.7	9.5
Tests Correct
Attempt pass rate	75.9%	83.3%
Flaky tests	3	1
Total Runs	54	54
Cost per result	2.424	0.800
Total Cost	$0.291	$0.104
Input Price	$1.750 / 1M	$0.162 / 1M
Output Price	$14.000 / 1M	$0.966 / 1M
Output Tokens	17,346	14,256
Reasoning Tokens	0	98,005
Response Time (avg)	6.84s	11.98s
Response Time (max)	38.52s	45.02s
Response Time (total)	123.17s	191.76s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	8.7	7.9	91.7%	1		3.40s	1,807	0
Qwen3.6 35B A3B	10.0	10.0	100.0%	0		6.02s	1,154	12,385

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	10.0	10.0	100.0%	0		8.97s	1,345	0
Qwen3.6 35B A3B	10.0	10.0	100.0%	0		32.58s	3,294	15,116

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	10.0	10.0	100.0%	0		9.12s	1,243	0
Qwen3.6 35B A3B	0.0	0.0	0.0%	0		0ms	0	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	10.0	10.0	100.0%	0		3.05s	980	0
Qwen3.6 35B A3B	10.0	10.0	100.0%	0		12.99s	2,591	9,968

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	5.3	10.0	33.3%	0		17.78s	7,810	0
Qwen3.6 35B A3B	5.3	7.2	44.4%	1		22.50s	6,193	39,116

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	4.4	3.0	33.3%	1		3.20s	335	0
Qwen3.6 35B A3B	4.4	9.9	0.0%	0		8.66s	129	4,569

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	7.5	6.1	83.3%	1		5.46s	1,528	0
Qwen3.6 35B A3B	10.0	10.0	100.0%	0		7.50s	219	7,404

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	7.7	10.0	66.7%	0		4.42s	1,743	0
Qwen3.6 35B A3B	10.0	10.0	100.0%	0		5.98s	676	9,447

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	10.0	10.0	100.0%	0		4.68s	555	0
Qwen3.6 35B A3B	0.0	0.0	0.0%	0		0ms	0	0

Quick Compare

Switch Comparison Pair

GPT-5.2 ChatnonevsStep 3.5 Flashmedium Gemini 3 Flash PreviewlowvsQwen3.6 35B A3Bmedium DeepSeek V3.2mediumvsGPT-5.2 Chatnone DeepSeek V4 FlashhighvsGPT-5.2 Chatnone GPT-5.2 ChatnonevsGLM 5V Turbomedium Claude Sonnet 4.6mediumvsGPT-5.2 Chatnone GPT-5.2 ChatnonevsQwen3.5-Flashmedium Gemma 4 26B A4BmediumFree AvailablevsGPT-5.2 Chatnone GPT-5.2 ChatnonevsGLM 5.1medium GPT-5.2 ChatnonevsHY3 PreviewmediumFree Available GPT-5.2 ChatnonevsQwen3.5 Plus 2026-04-20medium GPT-5.2 ChatnonevsMiMo-V2-Promedium