Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.5 vs Qwen: Qwen3.5-27B

Summary

GPT-5.5 vs Qwen3.5-27B benchmark comparison: GPT-5.5 leads on average score with 9.3 vs 7.9. Qwen3.5-27B has the lower benchmark cost at $0.536 vs $0.907. GPT-5.5 is faster at 9.76s vs 68.39s, with pass rates of 85.7% vs 73.0%.

Recommended model: GPT-5.5 - It has the best score here (9.3), while responding about 7.0x faster than Qwen3.5-27B.

Last updated at: 2026-06-18

Metric GPT-5.5 GPT-5.5 low Release: 2026-04-24 Qwen3.5-27B Qwen3.5-27B medium Release: 2026-02-24
Score 9.3 7.9
Rank #4 #29
Reliability 10.0 10.0
Consistency 10.0 8.5
Tests Correct
Attempt pass rate 85.7% 73.0%
Flaky tests 0 4
Total Runs 63 63
Cost per result 5.035 4.901
Total Cost $0.907 $0.536
Input Price $5.000 / 1M $0.195 / 1M
Output Price $30.000 / 1M $1.560 / 1M
Total Input Tokens 34,209 42,164
Output Tokens 2,046 8,534
Reasoning Tokens 22,460 329,289
Response Time (avg) 9.76s 68.39s
Response Time (max) 56.19s 234.36s
Response Time (total) 204.92s 1436.24s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#4 GPT-5.5

low
Cost
$0.068
Time
37.0s
Tokens
2,339 tok

#29 Qwen3.5-27B

medium
Cost
$0.008
Time
62.0s
Tokens
3,099 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 4.41s 606 238 1,020
Qwen3.5-27B 8.7 7.9 91.7% 1 19.75s 672 569 31,505
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 15.04s 7,302 423 6,402
Qwen3.5-27B 6.2 7.1 55.6% 1 160.69s 7,895 6,381 89,388
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 9.56s 11,019 303 717
Qwen3.5-27B 10.0 10.0 100.0% 0 163.96s 14,946 483 9,991
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 3.28s 7,140 228 157
Qwen3.5-27B 10.0 10.0 100.0% 0 30.26s 7,782 270 16,150
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 5.3 10.0 33.3% 0 28.05s 723 69 11,609
Qwen3.5-27B 5.3 10.0 33.3% 0 79.53s 553 43 52,368
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 5.17s 477 133 245
Qwen3.5-27B 6.1 3.1 66.7% 1 101.41s 524 70 23,147
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 9.9 10.0 100.0% 0 3.74s 660 93 415
Qwen3.5-27B 10.0 10.0 100.0% 0 19.66s 699 97 11,638
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 4.74s 642 279 954
Qwen3.5-27B 8.2 7.7 77.8% 1 59.60s 696 242 70,096
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 4.96s 5,445 250 101
Qwen3.5-27B 10.0 10.0 100.0% 0 7.45s 8,193 348 1,323
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 3.0 10.0 0.0% 0 10.06s 195 30 840
Qwen3.5-27B 3.0 10.0 0.0% 0 85.11s 204 31 23,683

Quick Compare

Switch Comparison Pair

GPT-5.5lowvsQwen3.7 MaxmediumClaude Fable 5mediumvsGPT-5.5lowGemini 3.1 Pro PreviewmediumvsGPT-5.5lowQwen3.5-27BmediumvsStep 3.7 FlashlowGemini 3.5 FlashmediumvsGPT-5.5lowGemini 3 Flash PreviewmediumvsGPT-5.5lowDeepSeek V4 ProhighvsQwen3.5-27BmediumDeepSeek V4 FlashhighvsQwen3.5-27BmediumGPT-5.3 ChatnonevsQwen3.5-27BmediumGPT-5.5lowvsQwen3.6 Max PreviewmediumClaude Opus 4.8mediumvsGPT-5.5lowGemini 3.5 FlashhighvsGPT-5.5low