Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.5 vs Qwen: Qwen3.7 Max

Summary

GPT-5.5 vs Qwen3.7 Max benchmark comparison: Qwen3.7 Max leads on average score with 9.4 vs 9.0. Qwen3.7 Max has the lower benchmark cost at $0.523 vs $3.679. Qwen3.7 Max is faster at 16.02s vs 37.98s, with pass rates of 87.3% vs 88.9%.

Recommended model: Qwen3.7 Max - It has the best score here (9.4), while costing about 7.0x less than GPT-5.5.

Last updated at: 2026-07-02

Metric GPT-5.5 GPT-5.5 medium Release: 2026-04-24 Qwen3.7 Max Qwen3.7 Max medium Release: 2026-05-22
Score 9.0 9.4
Rank #9 #3
Reliability 10.0 10.0
Consistency 8.9 9.6
Tests Correct
Attempt pass rate 87.3% 88.9%
Flaky tests 3 1
Total Runs 63 63
Cost per result 21.638 5.517
Total Cost $3.679 $0.523
Input Price $5.000 / 1M $1.250 / 1M
Output Price $30.000 / 1M $3.750 / 1M
Total Input Tokens 34,212 42,360
Output Tokens 1,985 2,129
Reasoning Tokens 114,925 122,959
Response Time (avg) 37.98s 16.02s
Response Time (max) 332.10s 59.98s
Response Time (total) 797.60s 336.51s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#9 GPT-5.5

medium
Cost
$0.112
Time
71.9s
Tokens
3,807 tok

#3 Qwen3.7 Max

medium
Cost
$0.017
Time
68.8s
Tokens
4,526 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 4.66s 606 250 1,335
Qwen3.7 Max 10.0 10.0 100.0% 0 6.36s 672 222 8,742
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 8.8 7.8 88.9% 1 59.77s 7,305 362 24,959
Qwen3.7 Max 10.0 10.0 100.0% 0 35.31s 7,893 423 34,808
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 19.29s 11,019 312 2,841
Qwen3.7 Max 10.0 10.0 100.0% 0 19.60s 14,934 366 8,405
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 4.18s 7,140 234 593
Qwen3.7 Max 10.0 10.0 100.0% 0 8.80s 7,782 270 6,254
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 5.3 7.2 44.4% 1 164.14s 723 67 79,625
Qwen3.7 Max 5.9 7.2 55.6% 1 24.94s 771 61 31,793
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 4.16s 477 138 223
Qwen3.7 Max 10.0 10.0 100.0% 0 11.70s 516 135 4,457
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 3.36s 660 93 538
Qwen3.7 Max 10.0 10.0 100.0% 0 7.46s 699 102 5,452
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 6.76s 642 241 2,225
Qwen3.7 Max 10.0 10.0 100.0% 0 8.84s 696 259 8,908
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 10.57s 5,445 258 832
Qwen3.7 Max 10.0 10.0 100.0% 0 6.63s 8,193 267 1,220
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 2.8 1.6 33.3% 1 37.86s 195 30 1,754
Qwen3.7 Max 3.0 10.0 0.0% 0 33.37s 204 24 12,920

Quick Compare

Switch Comparison Pair

GPT-5.5lowvsQwen3.7 MaxmediumGemini 3.5 FlashlowvsQwen3.7 MaxmediumGemini 3.5 FlashlowvsGPT-5.5mediumGemini 3.5 FlashhighvsQwen3.7 MaxmediumDeepSeek V4 FlashhighvsGPT-5.5mediumGemini 3.5 FlashhighvsGPT-5.5mediumGPT-5.2 ChatnonevsQwen3.7 MaxmediumDeepSeek V4 FlashhighvsQwen3.7 MaxmediumClaude Opus 4.8lowvsGPT-5.5mediumGPT-5.5mediumvsStep 3.7 FlashlowDeepSeek V4 ProhighvsGPT-5.5mediumGemini 3 Flash PreviewlowvsGPT-5.5medium