Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

OpenAI: GPT-5.5 vs Qwen: Qwen3.6 35B A3B

Last updated at: 2026-04-27

Metric GPT-5.5 GPT-5.5 medium Release: 2026-04-24 Qwen3.6 35B A3B Qwen3.6 35B A3B medium Release: 2026-04-20
Score 9.0 8.8
Rank #6 #9
Reliability N/A 10.0
Consistency 9.2 9.5
Tests Correct
Attempt pass rate 87.0% 83.3%
Flaky tests 2 1
Total Runs 54 54
Cost per result 19.226 0.800
Total Cost $2.884 $0.104
Input Price $5.000 / 1M $0.162 / 1M
Output Price $30.000 / 1M $0.966 / 1M
Output Tokens 1,920 14,256
Reasoning Tokens 89,632 98,005
Response Time (avg) 32.75s 11.98s
Response Time (max) 332.10s 45.02s
Response Time (total) 589.59s 191.76s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 4.66s 250 1,335
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 6.02s 1,154 12,385
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 9.09s 318 1,391
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 32.58s 3,294 15,116
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 19.29s 312 2,841
Qwen3.6 35B A3B 0.0 0.0 0.0% 0 0ms 0 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 4.18s 234 593
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 12.99s 2,591 9,968
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 5.3 7.2 44.4% 1 164.14s 67 79,625
Qwen3.6 35B A3B 5.3 7.2 44.4% 1 22.50s 6,193 39,116
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 4.16s 138 223
Qwen3.6 35B A3B 4.4 9.9 0.0% 0 8.66s 129 4,569
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 3.36s 93 538
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 7.50s 219 7,404
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 8.6 7.9 77.8% 1 6.78s 250 2,254
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 5.98s 676 9,447
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 10.57s 258 832
Qwen3.6 35B A3B 0.0 0.0 0.0% 0 0ms 0 0

Quick Compare

Switch Comparison Pair