Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.2 vs Qwen: Qwen3.6 35B A3B

Summary

GPT-5.2 vs Qwen3.6 35B A3B benchmark comparison: The average score is effectively tied at 7.5 vs 7.4. Qwen3.6 35B A3B has the lower benchmark cost at $0.146 vs $0.548. GPT-5.2 is faster at 16.88s vs 18.08s, with pass rates of 71.4% vs 63.5%.

Recommended model: Qwen3.6 35B A3B - It has the best score here (7.4), while costing about 3.8x less than GPT-5.2.

Last updated at: 2026-06-10

Metric GPT-5.2 GPT-5.2 medium Release: 2025-12-11 Qwen3.6 35B A3B Qwen3.6 35B A3B medium Release: 2026-04-20
Score 7.5 7.4
Rank #43 #47
Reliability 10.0 10.0
Consistency 8.4 9.6
Tests Correct
Attempt pass rate 71.4% 63.5%
Flaky tests 4 1
Total Runs 63 63
Cost per result 4.209 1.094
Total Cost $0.548 $0.146
Input Price $1.750 / 1M $0.140 / 1M
Output Price $14.000 / 1M $1.000 / 1M
Total Input Tokens 33,967 16,385
Output Tokens 2,901 19,632
Reasoning Tokens 31,932 130,219
Response Time (avg) 16.88s 18.08s
Response Time (max) 77.80s 86.11s
Response Time (total) 236.34s 343.61s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#43 GPT-5.2

medium
Cost
$0.047
Time
49.2s
Tokens
3,396 tok

#47 Qwen3.6 35B A3B

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 6.5 8.0 58.3% 1 7.81s 606 567 2,002
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 6.02s 672 1,154 12,385
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 10.0 10.0 100.0% 0 22.73s 7,302 511 11,912
Qwen3.6 35B A3B 7.7 10.0 66.7% 0 50.55s 5,051 7,929 37,223
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 10.0 10.0 100.0% 0 14.06s 11,019 291 1,757
Qwen3.6 35B A3B 3.0 10.0 0.0% 0 0ms 0 0 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 10.0 10.0 100.0% 0 3.15s 7,140 234 420
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 12.99s 7,776 2,591 9,968
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 5.9 7.2 55.6% 1 77.80s 473 42 10,342
Qwen3.6 35B A3B 5.3 7.2 44.4% 1 22.50s 771 6,193 39,116
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 3.7 9.7 0.0% 0 4.32s 477 162 269
Qwen3.6 35B A3B 4.4 9.9 0.0% 0 8.66s 516 129 4,569
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 9.9 10.0 100.0% 0 3.12s 660 94 614
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 7.50s 699 219 7,404
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 7.5 7.3 77.8% 1 5.80s 642 735 924
Qwen3.6 35B A3B 8.0 10.0 66.7% 0 5.95s 696 655 9,228
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 4.7 1.6 66.7% 1 10.30s 5,453 239 469
Qwen3.6 35B A3B 3.0 10.0 0.0% 0 0ms 0 0 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 3.0 10.0 0.0% 0 28.18s 195 26 3,223
Qwen3.6 35B A3B 3.0 10.0 0.0% 0 32.90s 204 762 10,326

Quick Compare

Switch Comparison Pair

Gemini 3 Flash PreviewnonevsQwen3.6 35B A3BmediumGemini 3.1 Flash Lite PreviewlowvsQwen3.6 35B A3BmediumGemini 3 Flash PreviewnonevsGPT-5.2mediumGemini 3.1 Flash Lite PreviewlowvsGPT-5.2mediumGPT-5.2mediumvsQwen3.7 MaxnoneQwen3.6 35B A3BmediumvsStep 3.7 FlashlowGemini 3.1 Flash Lite PreviewnonevsQwen3.6 35B A3BmediumGemini 3.1 Flash LitelowvsQwen3.6 35B A3BmediumGemini 3.5 FlashminimalvsGPT-5.2mediumGPT-5.2mediumvsStep 3.7 FlashlowGPT-5.3 ChatnonevsQwen3.6 35B A3BmediumGemini 3.1 Flash Lite PreviewnonevsGPT-5.2medium