Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

OpenAI: GPT-5.5 vs Qwen: Qwen3.6 35B A3B

Last updated at: 2026-04-27

Metric GPT-5.5 GPT-5.5 low Release: 2026-04-24 Qwen3.6 35B A3B Qwen3.6 35B A3B medium Release: 2026-04-20
Score 9.0 8.8
Rank #5 #9
Reliability 10.0 10.0
Consistency 9.6 9.5
Tests Correct
Attempt pass rate 87.0% 83.3%
Flaky tests 1 1
Total Runs 54 54
Cost per result 4.534 0.800
Total Cost $0.681 $0.104
Input Price $5.000 / 1M $0.162 / 1M
Output Price $30.000 / 1M $0.966 / 1M
Output Tokens 1,959 14,256
Reasoning Tokens 16,134 98,005
Response Time (avg) 8.39s 11.98s
Response Time (max) 56.19s 45.02s
Response Time (total) 151.01s 191.76s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 4.15s 232 1,056
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 6.02s 1,154 12,385
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 7.79s 369 936
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 32.58s 3,294 15,116
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 9.56s 303 717
Qwen3.6 35B A3B 0.0 0.0 0.0% 0 0ms 0 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 3.28s 228 157
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 12.99s 2,591 9,968
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 5.3 10.0 33.3% 0 27.57s 69 11,731
Qwen3.6 35B A3B 5.3 7.2 44.4% 1 22.50s 6,193 39,116
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 3.45s 143 132
Qwen3.6 35B A3B 4.4 9.9 0.0% 0 8.66s 129 4,569
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 9.9 10.0 100.0% 0 2.98s 93 356
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 7.50s 219 7,404
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 9.0 7.9 88.9% 1 4.48s 272 948
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 5.98s 676 9,447
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 4.96s 250 101
Qwen3.6 35B A3B 0.0 0.0 0.0% 0 0ms 0 0

Quick Compare

Switch Comparison Pair