Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.5 vs Qwen: Qwen3.5-35B-A3B

Summary

GPT-5.5 vs Qwen3.5-35B-A3B benchmark comparison: GPT-5.5 leads on average score with 6.3 vs 5.9. Qwen3.5-35B-A3B has the lower benchmark cost at $0.012 vs $0.231. GPT-5.5 is faster at 1.89s vs 3.37s, with pass rates of 54.0% vs 42.9%.

Recommended model: Qwen3.5-35B-A3B - Its score stays close to the best score here (5.9 vs 6.3), while costing about 20.8x less than GPT-5.5.

Last updated at: 2026-07-10

Metric GPT-5.5 GPT-5.5 none Release: 2026-04-24 Qwen3.5-35B-A3B Qwen3.5-35B-A3B none Release: 2026-02-24
Score 6.3 5.9
Rank #105 #120
Reliability 10.0 10.0
Consistency 8.8 8.9
Tests Correct
Attempt pass rate 54.0% 42.9%
Flaky tests 3 3
Total Runs 63 63
Cost per result 2.302 0.230
Total Cost $0.231 $0.012
Input Price $5.000 / 1M $0.140 / 1M
Output Price $30.000 / 1M $1.000 / 1M
Total Input Tokens 34,212 48,194
Output Tokens 1,971 4,343
Reasoning Tokens 0 0
Response Time (avg) 1.89s 3.37s
Response Time (max) 5.56s 47.43s
Response Time (total) 39.64s 70.75s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#105 GPT-5.5

none
Cost
$0.090
Time
54.3s
Tokens
3,063 tok

#120 Qwen3.5-35B-A3B

none
Cost
$0.005
Time
28.4s
Tokens
4,518 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 6.9 7.9 66.7% 1 1.31s 606 213 0
Qwen3.5-35B-A3B 3.4 7.9 16.7% 1 1.43s 696 574 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 5.5 10.0 33.3% 0 1.35s 7,305 462 0
Qwen3.5-35B-A3B 5.5 10.0 33.3% 0 1.39s 7,808 571 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 3.0 10.0 0.0% 0 5.56s 11,019 300 0
Qwen3.5-35B-A3B 3.0 10.0 0.0% 0 47.43s 20,739 1,833 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 1.18s 7,140 222 0
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 1.16s 7,794 243 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 2.9 7.2 11.1% 1 1.31s 723 52 0
Qwen3.5-35B-A3B 7.7 10.0 66.7% 0 485ms 789 15 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 3.41s 477 124 0
Qwen3.5-35B-A3B 6.5 3.4 66.7% 1 1.19s 522 114 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 6.2 5.8 66.7% 1 1.15s 660 81 0
Qwen3.5-35B-A3B 6.3 10.0 50.0% 0 809ms 711 63 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 7.7 10.0 66.7% 0 1.29s 642 252 0
Qwen3.5-35B-A3B 3.7 7.4 22.2% 1 1.35s 714 655 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 3.90s 5,445 247 0
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 2.30s 8,211 264 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 3.0 10.0 0.0% 0 5.01s 195 18 0
Qwen3.5-35B-A3B 3.0 10.0 0.0% 0 493ms 210 11 0

Quick Compare

Switch Comparison Pair