Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.3 Chat vs Qwen: Qwen3.6 35B A3B

Summary

GPT-5.3 Chat vs Qwen3.6 35B A3B benchmark comparison: GPT-5.3 Chat leads on average score with 7.5 vs 6.7. Qwen3.6 35B A3B has the lower benchmark cost at $0.146 vs $0.433. GPT-5.3 Chat is faster at 6.34s vs 18.08s, with pass rates of 66.7% vs 63.5%.

Recommended model: GPT-5.3 Chat - It has the best score here (7.5), while responding about 2.9x faster than Qwen3.6 35B A3B.

Last updated at: 2026-06-18

Metric GPT-5.3 Chat GPT-5.3 Chat none Release: 2026-03-03 Qwen3.6 35B A3B Qwen3.6 35B A3B medium Release: 2026-04-20
Score 7.5 6.7
Rank #45 #75
Reliability 10.0 10.0
Consistency 8.1 9.6
Tests Correct
Attempt pass rate 66.7% 63.5%
Flaky tests 5 1
Total Runs 63 63
Cost per result 3.605 1.094
Total Cost $0.433 $0.146
Input Price $1.750 / 1M $0.140 / 1M
Output Price $14.000 / 1M $1.000 / 1M
Total Input Tokens 34,209 16,385
Output Tokens 26,617 19,632
Reasoning Tokens 0 130,219
Response Time (avg) 6.34s 18.08s
Response Time (max) 18.33s 86.11s
Response Time (total) 133.13s 343.61s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#45 GPT-5.3 Chat

none
Cost
$0.008
Time
8.1s
Tokens
634 tok

#75 Qwen3.6 35B A3B

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.3 Chat 6.7 8.1 58.3% 1 3.86s 606 3,167 0
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 6.02s 672 1,154 12,385
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.3 Chat 5.6 4.7 55.6% 2 10.52s 7,302 6,632 0
Qwen3.6 35B A3B 7.7 10.0 66.7% 0 50.55s 5,051 7,929 37,223
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.3 Chat 10.0 10.0 100.0% 0 11.96s 11,019 2,614 0
Qwen3.6 35B A3B 3.0 10.0 0.0% 0 0ms 0 0 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.3 Chat 10.0 10.0 100.0% 0 2.21s 7,140 942 0
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 12.99s 7,776 2,591 9,968
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.3 Chat 3.5 4.4 33.3% 2 13.01s 723 8,264 0
Qwen3.6 35B A3B 5.3 7.2 44.4% 1 22.50s 771 6,193 39,116
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.3 Chat 4.6 10.0 0.0% 0 1.99s 477 319 0
Qwen3.6 35B A3B 4.4 9.9 0.0% 0 8.66s 516 129 4,569
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.3 Chat 9.8 10.0 100.0% 0 3.51s 660 1,491 0
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 7.50s 699 219 7,404
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.3 Chat 10.0 10.0 100.0% 0 2.99s 642 1,758 0
Qwen3.6 35B A3B 8.0 10.0 66.7% 0 5.95s 696 655 9,228
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.3 Chat 10.0 10.0 100.0% 0 8.36s 5,445 861 0
Qwen3.6 35B A3B 3.0 10.0 0.0% 0 0ms 0 0 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.3 Chat 3.0 10.0 0.0% 0 4.38s 195 569 0
Qwen3.6 35B A3B 3.0 10.0 0.0% 0 32.90s 204 762 10,326

Quick Compare

Switch Comparison Pair

Mercury 2mediumvsGPT-5.3 ChatnoneKimi K2.5mediumvsGPT-5.3 ChatnoneGPT-5.3 ChatnonevsQwen3.6 FlashmediumDeepSeek V3.2mediumvsGPT-5.3 ChatnoneGPT-5.3 ChatnonevsGrok Build 0.1mediumGemini 3.5 FlashminimalvsQwen3.6 35B A3BmediumDeepSeek V4 ProhighvsGPT-5.3 ChatnoneSeed-2.0-MinimediumvsGPT-5.3 ChatnoneGPT-5.3 ChatnonevsMiMo-V2.5-PromediumMiniMax M3mediumvsGPT-5.3 ChatnoneGemini 3 Flash PreviewlowvsGPT-5.3 ChatnoneGPT-5.3 ChatnonevsGrok 4.20medium