Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.2 Chat vs Qwen: Qwen3.6 35B A3B

Summary

GPT-5.2 Chat vs Qwen3.6 35B A3B benchmark comparison: GPT-5.2 Chat leads on average score with 7.9 vs 7.4. Qwen3.6 35B A3B has the lower benchmark cost at $0.146 vs $0.393. GPT-5.2 Chat is faster at 7.13s vs 18.08s, with pass rates of 74.6% vs 63.5%.

Recommended model: Qwen3.6 35B A3B - Its score stays close to the best score here (7.4 vs 7.9), while costing about 2.7x less than GPT-5.2 Chat.

Last updated at: 2026-06-10

Metric GPT-5.2 Chat GPT-5.2 Chat none Release: 2025-12-11 Qwen3.6 35B A3B Qwen3.6 35B A3B medium Release: 2026-04-20
Score 7.9 7.4
Rank #25 #47
Reliability 10.0 10.0
Consistency 8.9 9.6
Tests Correct
Attempt pass rate 74.6% 63.5%
Flaky tests 3 1
Total Runs 63 63
Cost per result 2.803 1.094
Total Cost $0.393 $0.146
Input Price $1.750 / 1M $0.140 / 1M
Output Price $14.000 / 1M $1.000 / 1M
Total Input Tokens 34,212 16,385
Output Tokens 23,744 19,632
Reasoning Tokens 0 130,219
Response Time (avg) 7.13s 18.08s
Response Time (max) 38.52s 86.11s
Response Time (total) 149.69s 343.61s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#25 GPT-5.2 Chat

none
Cost
$0.010
Time
15.3s
Tokens
797 tok

#47 Qwen3.6 35B A3B

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 Chat 8.7 7.9 91.7% 1 3.40s 606 1,807 0
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 6.02s 672 1,154 12,385
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 Chat 8.8 7.8 88.9% 1 9.82s 7,305 6,731 0
Qwen3.6 35B A3B 7.7 10.0 66.7% 0 50.55s 5,051 7,929 37,223
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 Chat 10.0 10.0 100.0% 0 9.12s 11,019 1,243 0
Qwen3.6 35B A3B 3.0 10.0 0.0% 0 0ms 0 0 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 Chat 10.0 10.0 100.0% 0 3.05s 7,140 980 0
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 12.99s 7,776 2,591 9,968
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 Chat 5.3 10.0 33.3% 0 17.78s 723 7,810 0
Qwen3.6 35B A3B 5.3 7.2 44.4% 1 22.50s 771 6,193 39,116
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 Chat 4.4 3.0 33.3% 1 3.20s 477 335 0
Qwen3.6 35B A3B 4.4 9.9 0.0% 0 8.66s 516 129 4,569
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 Chat 9.8 10.0 100.0% 0 5.51s 660 1,441 0
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 7.50s 699 219 7,404
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 Chat 7.7 10.0 66.7% 0 4.10s 642 1,603 0
Qwen3.6 35B A3B 8.0 10.0 66.7% 0 5.95s 696 655 9,228
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 Chat 10.0 10.0 100.0% 0 4.68s 5,445 555 0
Qwen3.6 35B A3B 3.0 10.0 0.0% 0 0ms 0 0 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 Chat 3.0 10.0 0.0% 0 6.89s 195 1,239 0
Qwen3.6 35B A3B 3.0 10.0 0.0% 0 32.90s 204 762 10,326

Quick Compare

Switch Comparison Pair

GPT-5.2 ChatnonevsQwen3.5 Plus 2026-02-15mediumGemini 3 Flash PreviewnonevsQwen3.6 35B A3BmediumGemini 3.1 Flash Lite PreviewlowvsQwen3.6 35B A3BmediumGPT-5.2 ChatnonevsGLM 5 TurbomediumGPT-5.2 ChatnonevsStep 3.7 FlashmediumGPT-5.2 ChatnonevsQwen3.6 PlusmediumGemma 4 31BmediumFree AvailablevsGPT-5.2 ChatnoneGemini 2.5 FlashmediumvsGPT-5.2 ChatnoneGPT-5.2 ChatnonevsQwen3.5-122B-A10BmediumQwen3.6 35B A3BmediumvsStep 3.7 FlashlowGPT-5.2 ChatnonevsQwen3.5-27BmediumDeepSeek V4 FlashhighvsGPT-5.2 Chatnone