Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.2 Chat vs Qwen: Qwen3.7 Max

Summary

GPT-5.2 Chat vs Qwen3.7 Max benchmark comparison: Qwen3.7 Max leads on average score with 9.4 vs 8.5. GPT-5.2 Chat has the lower benchmark cost at $0.393 vs $0.523. GPT-5.2 Chat is faster at 7.13s vs 16.02s, with pass rates of 74.6% vs 88.9%.

Recommended model: Qwen3.7 Max - It has the strongest score in this comparison (9.4) and the best overall balance of cost and response time across all 2 models.

Last updated at: 2026-07-02

Metric GPT-5.2 Chat GPT-5.2 Chat none Release: 2025-12-11 Qwen3.7 Max Qwen3.7 Max medium Release: 2026-05-22
Score 8.5 9.4
Rank #19 #3
Reliability 10.0 10.0
Consistency 8.9 9.6
Tests Correct
Attempt pass rate 74.6% 88.9%
Flaky tests 3 1
Total Runs 63 63
Cost per result 2.803 5.517
Total Cost $0.393 $0.523
Input Price $1.750 / 1M $1.250 / 1M
Output Price $14.000 / 1M $3.750 / 1M
Total Input Tokens 34,212 42,360
Output Tokens 23,744 2,129
Reasoning Tokens 0 122,959
Response Time (avg) 7.13s 16.02s
Response Time (max) 38.52s 59.98s
Response Time (total) 149.69s 336.51s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#19 GPT-5.2 Chat

none
Cost
$0.010
Time
15.3s
Tokens
797 tok

#3 Qwen3.7 Max

medium
Cost
$0.017
Time
68.8s
Tokens
4,526 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 Chat 8.7 7.9 91.7% 1 3.40s 606 1,807 0
Qwen3.7 Max 10.0 10.0 100.0% 0 6.36s 672 222 8,742
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 Chat 8.8 7.8 88.9% 1 9.82s 7,305 6,731 0
Qwen3.7 Max 10.0 10.0 100.0% 0 35.31s 7,893 423 34,808
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 Chat 10.0 10.0 100.0% 0 9.12s 11,019 1,243 0
Qwen3.7 Max 10.0 10.0 100.0% 0 19.60s 14,934 366 8,405
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 Chat 10.0 10.0 100.0% 0 3.05s 7,140 980 0
Qwen3.7 Max 10.0 10.0 100.0% 0 8.80s 7,782 270 6,254
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 Chat 5.3 10.0 33.3% 0 17.78s 723 7,810 0
Qwen3.7 Max 5.9 7.2 55.6% 1 24.94s 771 61 31,793
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 Chat 4.4 3.0 33.3% 1 3.20s 477 335 0
Qwen3.7 Max 10.0 10.0 100.0% 0 11.70s 516 135 4,457
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 Chat 9.8 10.0 100.0% 0 5.51s 660 1,441 0
Qwen3.7 Max 10.0 10.0 100.0% 0 7.46s 699 102 5,452
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 Chat 7.7 10.0 66.7% 0 4.10s 642 1,603 0
Qwen3.7 Max 10.0 10.0 100.0% 0 8.84s 696 259 8,908
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 Chat 10.0 10.0 100.0% 0 4.68s 5,445 555 0
Qwen3.7 Max 10.0 10.0 100.0% 0 6.63s 8,193 267 1,220
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 Chat 3.0 10.0 0.0% 0 6.89s 195 1,239 0
Qwen3.7 Max 3.0 10.0 0.0% 0 33.37s 204 24 12,920

Quick Compare

Switch Comparison Pair