Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.3 Chat vs Qwen: Qwen3.6 35B A3B

Last updated at: 2026-05-08

Metric GPT-5.3 Chat GPT-5.3 Chat none Release: 2026-03-03 Qwen3.6 35B A3B Qwen3.6 35B A3B medium Release: 2026-04-20
Score 7.6 8.0
Rank #46 #21
Reliability 10.0 9.8
Consistency 8.7 9.1
Tests Correct
Attempt pass rate 70.2% 74.5%
Flaky tests 3 2
Total Runs 57 57
Cost per result 2.895 0.959
Total Cost $0.348 $0.116
Input Price $1.750 / 1M $0.150 / 1M
Output Price $14.000 / 1M $1.000 / 1M
Output Tokens 21,353 15,018
Reasoning Tokens 0 108,331
Response Time (avg) 5.80s 13.22s
Response Time (max) 18.33s 45.02s
Response Time (total) 110.27s 224.66s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.3 Chat 6.7 8.1 58.3% 1 3.86s 3,167 0
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 6.02s 1,154 12,385
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.3 Chat 10.0 10.0 100.0% 0 9.32s 1,436 0
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 32.58s 3,294 15,116
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.3 Chat 10.0 10.0 100.0% 0 11.96s 2,614 0
Qwen3.6 35B A3B 0.0 0.0 0.0% 0 0ms 0 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.3 Chat 10.0 10.0 100.0% 0 2.21s 942 0
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 12.99s 2,591 9,968
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.3 Chat 3.5 4.4 33.3% 2 13.01s 8,264 0
Qwen3.6 35B A3B 5.3 7.2 44.4% 1 22.50s 6,193 39,116
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.3 Chat 4.6 10.0 0.0% 0 1.99s 319 0
Qwen3.6 35B A3B 4.4 9.9 0.0% 0 8.66s 129 4,569
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.3 Chat 9.8 10.0 100.0% 0 3.29s 1,455 0
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 7.50s 219 7,404
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.3 Chat 10.0 10.0 100.0% 0 2.93s 1,726 0
Qwen3.6 35B A3B 7.9 7.5 77.8% 1 5.98s 676 9,447
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.3 Chat 10.0 10.0 100.0% 0 8.36s 861 0
Qwen3.6 35B A3B 0.0 0.0 0.0% 0 0ms 0 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.3 Chat 3.0 10.0 0.0% 0 4.38s 569 0
Qwen3.6 35B A3B 3.0 10.0 0.0% 0 32.90s 762 10,326

Quick Compare

Switch Comparison Pair

GPT-5.3 ChatnonevsGLM 5.1mediumDeepSeek V4 FlashhighvsGPT-5.3 ChatnoneGPT-5.3 ChatnonevsQwen3.5-FlashmediumGemini 3.1 Flash LitelowvsGPT-5.3 ChatnoneGPT-5.3 ChatnonevsStep 3.5 FlashmediumGPT-5.3 ChatnonevsGLM 5V TurbomediumKimi K2.6mediumvsGPT-5.3 ChatnoneGPT-5.3 ChatnonevsQwen3.6 FlashmediumGemma 4 26B A4BmediumFree AvailablevsGPT-5.3 ChatnoneGPT-5.3 ChatnonevsMiMo-V2-PromediumGemini 3 Flash PreviewnonevsQwen3.6 35B A3BmediumGemini 3.1 Flash Lite PreviewlowvsQwen3.6 35B A3Bmedium