AI BENCHY Compare

OpenAI: GPT-5.2 Chat vs Qwen: Qwen3.7 Max

Last updated at: 2026-06-01

Metric	GPT-5.2 Chat GPT-5.2 Chat none Release: 2025-12-11	Qwen3.7 Max Qwen3.7 Max none Release: 2026-05-22

Metric	GPT-5.2 Chat GPT-5.2 Chat none Release: 2025-12-11	Qwen3.7 Max Qwen3.7 Max none Release: 2026-05-22
Score	7.9	7.9
Rank	#32	#28
Reliability	10.0	10.0
Consistency	8.9	10.0
Tests Correct
Attempt pass rate	73.3%	70.0%
Flaky tests	3	0
Total Runs	60	60
Cost per result	2.703	0.719
Total Cost	$0.352	$0.051
Input Price	$1.750 / 1M	$1.250 / 1M
Output Price	$14.000 / 1M	$3.750 / 1M
Output Tokens	21,144	1,988
Reasoning Tokens	0	0
Response Time (avg)	6.82s	1.30s
Response Time (max)	38.52s	3.92s
Response Time (total)	136.34s	25.95s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	8.7	7.9	91.7%	1		3.40s	1,807	0
Qwen3.7 Max	6.5	10.0	50.0%	0		1.08s	242	0

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	8.2	6.7	83.3%	1		8.05s	4,131	0
Qwen3.7 Max	6.8	10.0	50.0%	0		1.39s	576	0

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	10.0	10.0	100.0%	0		9.12s	1,243	0
Qwen3.7 Max	3.0	10.0	0.0%	0		2.17s	171	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	10.0	10.0	100.0%	0		3.05s	980	0
Qwen3.7 Max	10.0	10.0	100.0%	0		1.35s	243	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	5.3	10.0	33.3%	0		17.78s	7,810	0
Qwen3.7 Max	7.7	10.0	66.7%	0		975ms	15	0

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	4.4	3.0	33.3%	1		3.20s	335	0
Qwen3.7 Max	10.0	10.0	100.0%	0		1.04s	120	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	9.8	10.0	100.0%	0		5.51s	1,441	0
Qwen3.7 Max	10.0	10.0	100.0%	0		943ms	72	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	7.7	10.0	66.7%	0		4.10s	1,603	0
Qwen3.7 Max	10.0	10.0	100.0%	0		1.13s	314	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	10.0	10.0	100.0%	0		4.68s	555	0
Qwen3.7 Max	10.0	10.0	100.0%	0		3.92s	222	0

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	3.0	10.0	0.0%	0		6.89s	1,239	0
Qwen3.7 Max	3.0	10.0	0.0%	0		856ms	13	0

Quick Compare

Switch Comparison Pair

GPT-5.4mediumvsQwen3.7 Maxnone Qwen3.7 MaxnonevsGLM 5 Turbomedium Qwen3.7 MaxnonevsStep 3.7 Flashmedium Gemma 4 26B A4BmediumFree AvailablevsGPT-5.2 Chatnone GPT-5.2 ChatnonevsStep 3.7 Flashmedium GPT-5.2 ChatnonevsGLM 5 Turbomedium Gemini 3.5 FlashminimalvsQwen3.7 Maxnone GPT-5.2 ChatnonevsQwen3.5-27Bmedium Gemma 4 26B A4BmediumFree AvailablevsQwen3.7 Maxnone GPT-5.2 ChatnonevsQwen3.6 35B A3Bmedium Gemma 4 31BmediumFree AvailablevsQwen3.7 Maxnone GPT-5.2 ChatnonevsGrok 4.3medium