Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.2 vs Qwen: Qwen3.7 Plus

Summary

GPT-5.2 vs Qwen3.7 Plus benchmark comparison: GPT-5.2 leads on average score with 8.4 vs 8.2. Qwen3.7 Plus has the lower benchmark cost at $0.177 vs $0.548. GPT-5.2 is faster at 16.88s vs 38.95s, with pass rates of 71.4% vs 77.8%.

Recommended model: Qwen3.7 Plus - Its score stays close to the best score here (8.2 vs 8.4), while costing about 3.1x less than GPT-5.2.

Last updated at: 2026-06-18

Metric GPT-5.2 GPT-5.2 medium Release: 2025-12-11 Qwen3.7 Plus Qwen3.7 Plus medium Release: 2026-06-03
Score 8.4 8.2
Rank #22 #25
Reliability 10.0 10.0
Consistency 8.4 9.1
Tests Correct
Attempt pass rate 71.4% 77.8%
Flaky tests 4 2
Total Runs 63 63
Cost per result 4.209 1.474
Total Cost $0.548 $0.177
Input Price $1.750 / 1M $0.320 / 1M
Output Price $14.000 / 1M $1.280 / 1M
Total Input Tokens 33,967 40,939
Output Tokens 2,901 2,125
Reasoning Tokens 31,932 125,754
Response Time (avg) 16.88s 38.95s
Response Time (max) 77.80s 178.04s
Response Time (total) 236.34s 817.85s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#22 GPT-5.2

medium
Cost
$0.047
Time
49.2s
Tokens
3,396 tok

#25 Qwen3.7 Plus

medium
Cost
$0.018
Time
193.2s
Tokens
10,821 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 6.5 8.0 58.3% 1 7.81s 606 567 2,002
Qwen3.7 Plus 10.0 10.0 100.0% 0 8.58s 672 195 5,065
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 10.0 10.0 100.0% 0 22.73s 7,302 511 11,912
Qwen3.7 Plus 6.1 6.6 55.6% 1 108.60s 6,472 414 43,576
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 10.0 10.0 100.0% 0 14.06s 11,019 291 1,757
Qwen3.7 Plus 10.0 10.0 100.0% 0 65.24s 14,934 366 10,132
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 10.0 10.0 100.0% 0 3.15s 7,140 234 420
Qwen3.7 Plus 10.0 10.0 100.0% 0 21.75s 7,782 270 6,713
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 5.9 7.2 55.6% 1 77.80s 473 42 10,342
Qwen3.7 Plus 3.6 7.2 22.2% 1 45.35s 771 57 27,073
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 3.7 9.7 0.0% 0 4.32s 477 162 269
Qwen3.7 Plus 10.0 10.0 100.0% 0 25.48s 516 123 3,998
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 9.9 10.0 100.0% 0 3.12s 660 94 614
Qwen3.7 Plus 10.0 10.0 100.0% 0 16.13s 699 102 5,013
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 7.5 7.3 77.8% 1 5.80s 642 735 924
Qwen3.7 Plus 10.0 10.0 100.0% 0 16.38s 696 280 7,312
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 4.7 1.6 66.7% 1 10.30s 5,453 239 469
Qwen3.7 Plus 10.0 10.0 100.0% 0 15.02s 8,193 292 1,831
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 3.0 10.0 0.0% 0 28.18s 195 26 3,223
Qwen3.7 Plus 3.0 10.0 0.0% 0 91.07s 204 26 15,041

Quick Compare

Switch Comparison Pair