Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.5 vs Qwen: Qwen3.7 Max

Last updated at: 2026-05-22

Metric GPT-5.5 GPT-5.5 low Release: 2026-04-24 Qwen3.7 Max Qwen3.7 Max medium Release: 2026-05-22
Score 8.9 9.0
Rank #10 #5
Reliability 10.0 10.0
Consistency 10.0 9.6
Tests Correct
Attempt pass rate 84.2% 88.3%
Flaky tests 0 1
Total Runs 57 60
Cost per result 4.412 5.540
Total Cost $0.706 $0.942
Input Price $5.000 / 1M $2.500 / 1M
Output Price $30.000 / 1M $7.500 / 1M
Output Tokens 2,008 2,109
Reasoning Tokens 16,914 110,285
Response Time (avg) 8.80s 13.83s
Response Time (max) 56.19s 33.37s
Response Time (total) 167.26s 276.53s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 4.43s 246 1,011
Qwen3.7 Max 10.0 10.0 100.0% 0 6.36s 222 8,742
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 7.79s 369 936
Qwen3.7 Max 10.0 10.0 100.0% 0 22.98s 403 22,134
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 9.56s 303 717
Qwen3.7 Max 10.0 10.0 100.0% 0 19.60s 366 8,405
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 3.28s 228 157
Qwen3.7 Max 10.0 10.0 100.0% 0 8.80s 270 6,254
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 5.3 10.0 33.3% 0 27.57s 69 11,731
Qwen3.7 Max 5.9 7.2 55.6% 1 24.94s 61 31,793
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 7.14s 146 170
Qwen3.7 Max 10.0 10.0 100.0% 0 11.70s 135 4,457
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 9.9 10.0 100.0% 0 2.98s 93 356
Qwen3.7 Max 10.0 10.0 100.0% 0 7.46s 102 5,452
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 4.94s 274 895
Qwen3.7 Max 10.0 10.0 100.0% 0 8.84s 259 8,908
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 4.96s 250 101
Qwen3.7 Max 10.0 10.0 100.0% 0 6.63s 267 1,220
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.5 3.0 10.0 0.0% 0 10.06s 30 840
Qwen3.7 Max 3.0 10.0 0.0% 0 33.37s 24 12,920

Quick Compare

Switch Comparison Pair

Gemini 3.5 FlashnonevsGPT-5.5lowClaude Opus 4.7mediumvsGPT-5.5lowGemini 3.5 FlashnonevsQwen3.7 MaxmediumGemini 3.5 FlashmediumvsGPT-5.5lowGemini 3.5 FlashlowvsQwen3.7 MaxmediumGemini 3 Flash PreviewlowvsQwen3.7 MaxmediumGemini 3.1 Pro PreviewmediumvsGPT-5.5lowGPT-5.5lowvsQwen3.6 Max PreviewmediumGemini 3.5 FlashhighvsQwen3.7 MaxmediumGPT-5.5lowvsGLM 5mediumGemini 3 PRO PreviewmediumvsGPT-5.5lowGPT-5.5lowvsMiMo-V2.5-Promedium