Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.2 Chat vs Qwen: Qwen3.7 Max

Last updated at: 2026-05-22

Metric GPT-5.2 Chat GPT-5.2 Chat none Release: 2025-12-11 Qwen3.7 Max Qwen3.7 Max medium Release: 2026-05-22
Score 7.6 9.0
Rank #44 #5
Reliability 10.0 10.0
Consistency 8.5 9.6
Tests Correct
Attempt pass rate 71.7% 88.3%
Flaky tests 4 1
Total Runs 60 60
Cost per result 2.955 5.540
Total Cost $0.355 $0.942
Input Price $1.750 / 1M $2.500 / 1M
Output Price $14.000 / 1M $7.500 / 1M
Output Tokens 21,371 2,109
Reasoning Tokens 0 110,285
Response Time (avg) 6.86s 13.83s
Response Time (max) 38.52s 33.37s
Response Time (total) 137.19s 276.53s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 8.7 7.9 91.7% 1 3.40s 1,807 0
Qwen3.7 Max 10.0 10.0 100.0% 0 6.36s 222 8,742
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 8.2 6.7 83.3% 1 8.05s 4,131 0
Qwen3.7 Max 10.0 10.0 100.0% 0 22.98s 403 22,134
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 10.0 10.0 100.0% 0 9.12s 1,243 0
Qwen3.7 Max 10.0 10.0 100.0% 0 19.60s 366 8,405
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 10.0 10.0 100.0% 0 3.05s 980 0
Qwen3.7 Max 10.0 10.0 100.0% 0 8.80s 270 6,254
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 5.3 10.0 33.3% 0 17.78s 7,810 0
Qwen3.7 Max 5.9 7.2 55.6% 1 24.94s 61 31,793
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 4.4 3.0 33.3% 1 3.20s 335 0
Qwen3.7 Max 10.0 10.0 100.0% 0 11.70s 135 4,457
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 7.3 5.9 83.3% 1 5.46s 1,528 0
Qwen3.7 Max 10.0 10.0 100.0% 0 7.46s 102 5,452
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 7.7 10.0 66.7% 0 4.42s 1,743 0
Qwen3.7 Max 10.0 10.0 100.0% 0 8.84s 259 8,908
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 10.0 10.0 100.0% 0 4.68s 555 0
Qwen3.7 Max 10.0 10.0 100.0% 0 6.63s 267 1,220
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 3.0 10.0 0.0% 0 6.89s 1,239 0
Qwen3.7 Max 3.0 10.0 0.0% 0 33.37s 24 12,920

Quick Compare

Switch Comparison Pair

GPT-5.2 ChatnonevsQwen3.5 Plus 2026-04-20mediumGemini 3.1 Flash Lite PreviewlowvsGPT-5.2 ChatnoneGPT-5.2 ChatnonevsMiMo-V2-PromediumGPT-5.2 ChatnonevsGrok Build 0.1mediumClaude Sonnet 4.6mediumvsGPT-5.2 ChatnoneGPT-5.2 ChatnonevsQwen3.5-122B-A10BmediumGemini 2.5 FlashmediumvsGPT-5.2 ChatnoneGemini 3.1 Flash LitemediumvsGPT-5.2 ChatnoneGemini 3.5 FlashnonevsQwen3.7 MaxmediumGemini 3.1 Flash Lite PreviewmediumvsGPT-5.2 ChatnoneGemma 4 26B A4BmediumFree AvailablevsGPT-5.2 ChatnoneGPT-5.2 ChatnonevsQwen3.6 Plusmedium