Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.5 vs Qwen: Qwen3.7 Plus

Last updated at: 2026-06-03

Metric GPT-5.5 GPT-5.5 medium Release: 2026-04-24 Qwen3.7 Plus Qwen3.7 Plus medium Release: 2026-06-03
Score 8.7 8.4
Rank #10 #16
Reliability 10.0 9.9
Consistency 8.8 9.2
Tests Correct
Attempt pass rate 86.7% 80.0%
Flaky tests 3 2
Total Runs 60 60
Cost per result 21.884 1.324
Total Cost $3.502 $0.199
Input Price $5.000 / 1M $0.400 / 1M
Output Price $30.000 / 1M $1.600 / 1M
Total Input Tokens 31,593 38,104
Output Tokens 1,964 2,107
Reasoning Tokens 109,481 112,479
Response Time (avg) 37.88s 36.84s
Response Time (max) 332.10s 178.04s
Response Time (total) 757.66s 736.86s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 4.66s 606 250 1,335
Qwen3.7 Plus 10.0 10.0 100.0% 0 8.58s 672 195 5,065
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 8.2 6.7 83.3% 1 69.68s 4,686 341 19,515
Qwen3.7 Plus 6.5 5.9 66.7% 1 122.40s 3,637 396 30,301
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 19.29s 11,019 312 2,841
Qwen3.7 Plus 10.0 10.0 100.0% 0 65.24s 14,934 366 10,132
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 4.18s 7,140 234 593
Qwen3.7 Plus 10.0 10.0 100.0% 0 21.75s 7,782 270 6,713
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 5.3 7.2 44.4% 1 164.14s 723 67 79,625
Qwen3.7 Plus 3.6 7.2 22.2% 1 45.35s 771 57 27,073
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 4.16s 477 138 223
Qwen3.7 Plus 10.0 10.0 100.0% 0 25.48s 516 123 3,998
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 3.36s 660 93 538
Qwen3.7 Plus 10.0 10.0 100.0% 0 16.13s 699 102 5,013
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 6.76s 642 241 2,225
Qwen3.7 Plus 10.0 10.0 100.0% 0 16.38s 696 280 7,312
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 10.57s 5,445 258 832
Qwen3.7 Plus 10.0 10.0 100.0% 0 15.02s 8,193 292 1,831
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 2.8 1.6 33.3% 1 37.86s 195 30 1,754
Qwen3.7 Plus 3.0 10.0 0.0% 0 91.07s 204 26 15,041

Quick Compare

Switch Comparison Pair

Gemini 3 Flash PreviewlowvsGPT-5.5mediumGemini 3 Flash PreviewlowvsQwen3.7 PlusmediumGemini 3.5 FlashnonevsQwen3.7 PlusmediumGemini 3.5 FlashminimalvsQwen3.7 PlusmediumGPT-5.2 ChatnonevsQwen3.7 PlusmediumGPT-5.5lowvsQwen3.7 PlusmediumGemini 3.5 FlashlowvsGPT-5.5mediumGemini 3 Flash PreviewnonevsQwen3.7 PlusmediumGemini 3.5 FlashnonevsGPT-5.5mediumDeepSeek V4 FlashhighvsQwen3.7 PlusmediumGemini 3.1 Flash Lite PreviewlowvsQwen3.7 PlusmediumGemini 3.5 FlashminimalvsGPT-5.5medium