Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.5 vs Qwen: Qwen3.6 35B A3B

Summary

GPT-5.5 vs Qwen3.6 35B A3B benchmark comparison: Qwen3.6 35B A3B leads on average score with 6.7 vs 6.3. Qwen3.6 35B A3B has the lower benchmark cost at $0.146 vs $0.231. GPT-5.5 is faster at 1.89s vs 18.08s, with pass rates of 54.0% vs 63.5%.

Recommended model: GPT-5.5 - Its score stays close to the best score here (6.3 vs 6.7), while responding about 9.6x faster than Qwen3.6 35B A3B.

Last updated at: 2026-06-18

Metric GPT-5.5 GPT-5.5 none Release: 2026-04-24 Qwen3.6 35B A3B Qwen3.6 35B A3B medium Release: 2026-04-20
Score 6.3 6.7
Rank #90 #75
Reliability 10.0 10.0
Consistency 8.8 9.6
Tests Correct
Attempt pass rate 54.0% 63.5%
Flaky tests 3 1
Total Runs 63 63
Cost per result 2.302 1.094
Total Cost $0.231 $0.146
Input Price $5.000 / 1M $0.140 / 1M
Output Price $30.000 / 1M $1.000 / 1M
Total Input Tokens 34,212 16,385
Output Tokens 1,971 19,632
Reasoning Tokens 0 130,219
Response Time (avg) 1.89s 18.08s
Response Time (max) 5.56s 86.11s
Response Time (total) 39.64s 343.61s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#90 GPT-5.5

none
Cost
$0.090
Time
54.3s
Tokens
3,063 tok

#75 Qwen3.6 35B A3B

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 6.9 7.9 66.7% 1 1.31s 606 213 0
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 6.02s 672 1,154 12,385
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 5.5 10.0 33.3% 0 1.35s 7,305 462 0
Qwen3.6 35B A3B 7.7 10.0 66.7% 0 50.55s 5,051 7,929 37,223
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 3.0 10.0 0.0% 0 5.56s 11,019 300 0
Qwen3.6 35B A3B 3.0 10.0 0.0% 0 0ms 0 0 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 1.18s 7,140 222 0
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 12.99s 7,776 2,591 9,968
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 2.9 7.2 11.1% 1 1.31s 723 52 0
Qwen3.6 35B A3B 5.3 7.2 44.4% 1 22.50s 771 6,193 39,116
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 3.41s 477 124 0
Qwen3.6 35B A3B 4.4 9.9 0.0% 0 8.66s 516 129 4,569
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 6.2 5.8 66.7% 1 1.15s 660 81 0
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 7.50s 699 219 7,404
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 7.7 10.0 66.7% 0 1.29s 642 252 0
Qwen3.6 35B A3B 8.0 10.0 66.7% 0 5.95s 696 655 9,228
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 3.90s 5,445 247 0
Qwen3.6 35B A3B 3.0 10.0 0.0% 0 0ms 0 0 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 3.0 10.0 0.0% 0 5.01s 195 18 0
Qwen3.6 35B A3B 3.0 10.0 0.0% 0 32.90s 204 762 10,326

Quick Compare

Switch Comparison Pair

GPT-5.5nonevsQwen3.5-35B-A3BmediumGemma 4 31BmediumFree AvailablevsGPT-5.5noneNemotron 3 SupermediumFree AvailablevsGPT-5.5noneGemini 3.5 FlashminimalvsQwen3.6 35B A3BmediumGemini 3.1 Flash LiteminimalvsGPT-5.5noneGemini 3.1 Flash LitelowvsGPT-5.5noneGemini 3 Flash PreviewnonevsQwen3.6 35B A3BmediumGemini 3.1 Flash Lite PreviewlowvsGPT-5.5noneGemini 3.1 Flash Lite PreviewlowvsQwen3.6 35B A3BmediumGemini 3.5 FlashnonevsQwen3.6 35B A3BmediumGemini 3.1 Flash Lite PreviewnonevsQwen3.6 35B A3BmediumGemini 3.1 Flash LitelowvsQwen3.6 35B A3Bmedium