Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.5 vs Qwen: Qwen3.6 35B A3B

Last updated at: 2026-05-10

Metric GPT-5.5 GPT-5.5 low Release: 2026-04-24 Qwen3.6 35B A3B Qwen3.6 35B A3B medium Release: 2026-04-20
Score 8.9 8.0
Rank #6 #21
Reliability 10.0 9.8
Consistency 10.0 9.1
Tests Correct
Attempt pass rate 84.2% 74.5%
Flaky tests 0 2
Total Runs 57 57
Cost per result 4.412 0.959
Total Cost $0.706 $0.116
Input Price $5.000 / 1M $0.150 / 1M
Output Price $30.000 / 1M $1.000 / 1M
Output Tokens 2,008 15,018
Reasoning Tokens 16,914 108,331
Response Time (avg) 8.80s 13.22s
Response Time (max) 56.19s 45.02s
Response Time (total) 167.26s 224.66s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 4.43s 246 1,011
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 6.02s 1,154 12,385
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 7.79s 369 936
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 32.58s 3,294 15,116
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 9.56s 303 717
Qwen3.6 35B A3B 0.0 0.0 0.0% 0 0ms 0 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 3.28s 228 157
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 12.99s 2,591 9,968
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 5.3 10.0 33.3% 0 27.57s 69 11,731
Qwen3.6 35B A3B 5.3 7.2 44.4% 1 22.50s 6,193 39,116
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 7.14s 146 170
Qwen3.6 35B A3B 4.4 9.9 0.0% 0 8.66s 129 4,569
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 9.9 10.0 100.0% 0 2.98s 93 356
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 7.50s 219 7,404
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 4.94s 274 895
Qwen3.6 35B A3B 7.9 7.5 77.8% 1 5.98s 676 9,447
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 4.96s 250 101
Qwen3.6 35B A3B 0.0 0.0 0.0% 0 0ms 0 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 3.0 10.0 0.0% 0 10.06s 30 840
Qwen3.6 35B A3B 3.0 10.0 0.0% 0 32.90s 762 10,326

Quick Compare

Switch Comparison Pair

Claude Opus 4.7mediumvsGPT-5.5lowGemini 3 Flash PreviewnonevsQwen3.6 35B A3BmediumGemini 3.1 Flash Lite PreviewlowvsQwen3.6 35B A3BmediumGPT-5.5lowvsQwen3.6 Max PreviewmediumGemini 3.1 Flash Lite PreviewnonevsQwen3.6 35B A3BmediumGPT-5.2 ChatnonevsQwen3.6 35B A3BmediumGemini 3.1 Flash LitelowvsQwen3.6 35B A3BmediumGPT-5.3 ChatnonevsQwen3.6 35B A3BmediumGemini 3 PRO PreviewmediumvsGPT-5.5lowDeepSeek V4 FlashhighvsQwen3.6 35B A3BmediumSeed-2.0-LitemediumvsGPT-5.5lowGPT-5.5lowvsQwen3.5 Plus 2026-02-15medium