Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.5 vs Qwen: Qwen3.6 27B

Summary

GPT-5.5 vs Qwen3.6 27B benchmark comparison: Qwen3.6 27B leads on average score with 6.8 vs 6.4. GPT-5.5 has the lower benchmark cost at $0.231 vs $0.336. GPT-5.5 is faster at 1.89s vs 59.71s, with pass rates of 54.0% vs 60.3%.

Recommended model: GPT-5.5 - Its score stays close to the best score here (6.4 vs 6.8), while responding about 31.6x faster than Qwen3.6 27B.

Last updated at: 2026-06-10

Metric GPT-5.5 GPT-5.5 none Release: 2026-04-24 Qwen3.6 27B Qwen3.6 27B medium Release: 2026-04-20
Score 6.4 6.8
Rank #92 #79
Reliability 10.0 10.0
Consistency 8.8 8.2
Tests Correct
Attempt pass rate 54.0% 60.3%
Flaky tests 3 5
Total Runs 63 63
Cost per result 2.302 3.361
Total Cost $0.231 $0.336
Input Price $5.000 / 1M $0.290 / 1M
Output Price $30.000 / 1M $2.400 / 1M
Total Input Tokens 34,212 39,376
Output Tokens 1,971 16,189
Reasoning Tokens 0 122,521
Response Time (avg) 1.89s 59.71s
Response Time (max) 5.56s 168.22s
Response Time (total) 39.64s 1254.01s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#92 GPT-5.5

none
Cost
$0.090
Time
54.3s
Tokens
3,063 tok

#79 Qwen3.6 27B

medium
Cost
$0.009
Time
39.6s
Tokens
3,090 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 6.9 7.9 66.7% 1 1.31s 606 213 0
Qwen3.6 27B 8.3 10.0 75.0% 0 12.62s 453 582 4,311
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 5.5 10.0 33.3% 0 1.35s 7,305 462 0
Qwen3.6 27B 7.7 10.0 66.7% 0 142.99s 5,051 7,968 43,367
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 3.0 10.0 0.0% 0 5.56s 11,019 300 0
Qwen3.6 27B 7.0 3.7 66.7% 1 83.07s 15,104 2,088 14,689
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 1.18s 7,140 222 0
Qwen3.6 27B 3.5 1.4 50.0% 2 37.30s 7,778 568 9,404
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 2.9 7.2 11.1% 1 1.31s 723 52 0
Qwen3.6 27B 2.9 7.2 11.1% 1 73.38s 662 3,510 20,352
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 3.41s 477 124 0
Qwen3.6 27B 6.5 3.4 66.7% 1 39.53s 516 81 3,045
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 6.2 5.8 66.7% 1 1.15s 660 81 0
Qwen3.6 27B 10.0 10.0 100.0% 0 37.96s 699 346 6,548
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 7.7 10.0 66.7% 0 1.29s 642 252 0
Qwen3.6 27B 7.7 10.0 66.7% 0 61.14s 696 255 12,044
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 3.90s 5,445 247 0
Qwen3.6 27B 10.0 10.0 100.0% 0 16.88s 8,213 390 2,954
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 3.0 10.0 0.0% 0 5.01s 195 18 0
Qwen3.6 27B 3.0 10.0 0.0% 0 80.99s 204 401 5,807

Quick Compare

Switch Comparison Pair

Gemini 3.1 Flash LiteminimalvsGPT-5.5noneClaude Sonnet 4.6nonevsQwen3.6 27BmediumGemma 4 31BnoneFree AvailablevsQwen3.6 27BmediumMercury 2mediumvsGPT-5.5noneQwen3.6 27BmediumvsStep 3.7 FlashhighClaude Opus 4.8nonevsQwen3.6 27BmediumGemini 3.1 Flash LiteminimalvsQwen3.6 27BmediumGemini 3.1 Flash LitenonevsQwen3.6 27BmediumDeepSeek V4 ProhighvsGPT-5.5noneKimi K2.5mediumvsGPT-5.5noneGPT-5.3 ChatnonevsQwen3.6 27BmediumRing-2.6-1TmediumvsGPT-5.5none