Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.6 Sol vs Qwen: Qwen3.7 Max

Summary

GPT-5.6 Sol (low) vs Qwen3.7 Max (medium) benchmark comparison: GPT-5.6 Sol (low) leads on average score with 9.5 vs 9.4. Qwen3.7 Max (medium) has the lower benchmark cost at $0.523 vs $0.649. GPT-5.6 Sol (low) is faster at 8.29s vs 16.02s, with pass rates of 85.7% vs 88.9%.

Recommended model: GPT-5.6 Sol (low) - It has the best score here (9.5), while responding about 1.9x faster than Qwen3.7 Max (medium).

Last updated at: 2026-07-09

Metric GPT-5.6 Sol GPT-5.6 Sol low Release: 2026-07-09 Qwen3.7 Max Qwen3.7 Max medium Release: 2026-05-22
Score 9.5 9.4
Rank #3 #4
Reliability 10.0 10.0
Consistency 9.2 9.6
Tests Correct
Attempt pass rate 85.7% 88.9%
Flaky tests 2 1
Total Runs 63 63
Cost per result 3.816 5.517
Total Cost $0.649 $0.523
Input Price $5.000 / 1M $1.250 / 1M
Output Price $30.000 / 1M $3.750 / 1M
Total Input Tokens 34,218 42,360
Output Tokens 1,898 2,129
Reasoning Tokens 14,023 122,959
Response Time (avg) 8.29s 16.02s
Response Time (max) 53.91s 59.98s
Response Time (total) 174.04s 336.51s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#3 GPT-5.6 Sol

low
Cost
$0.062
Time
26.7s
Tokens
2,150 tok

#4 Qwen3.7 Max

medium
Cost
$0.017
Time
68.8s
Tokens
4,526 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 8.3 10.0 75.0% 0 2.60s 606 174 492
Qwen3.7 Max 10.0 10.0 100.0% 0 6.36s 672 222 8,742
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 10.0 10.0 100.0% 0 11.25s 7,302 412 3,482
Qwen3.7 Max 10.0 10.0 100.0% 0 35.31s 7,893 423 34,808
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 10.0 10.0 100.0% 0 9.87s 11,019 318 792
Qwen3.7 Max 10.0 10.0 100.0% 0 19.60s 14,934 366 8,405
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 10.0 10.0 100.0% 0 1.82s 7,140 222 0
Qwen3.7 Max 10.0 10.0 100.0% 0 8.80s 7,782 270 6,254
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 5.3 7.2 44.4% 1 29.07s 723 71 7,822
Qwen3.7 Max 5.9 7.2 55.6% 1 24.94s 771 61 31,793
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 10.0 10.0 100.0% 0 3.07s 477 99 135
Qwen3.7 Max 10.0 10.0 100.0% 0 11.70s 516 135 4,457
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 10.0 10.0 100.0% 0 2.27s 660 90 146
Qwen3.7 Max 10.0 10.0 100.0% 0 7.46s 699 102 5,452
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 8.2 7.2 88.9% 1 3.44s 642 224 534
Qwen3.7 Max 10.0 10.0 100.0% 0 8.84s 696 259 8,908
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 10.0 10.0 100.0% 0 7.56s 5,454 258 294
Qwen3.7 Max 10.0 10.0 100.0% 0 6.63s 8,193 267 1,220
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 10.0 10.0 100.0% 0 3.67s 195 30 326
Qwen3.7 Max 3.0 10.0 0.0% 0 33.37s 204 24 12,920

Quick Compare

Switch Comparison Pair

GPT-5.6 SolhighvsQwen3.7 MaxmediumGPT-5.5lowvsQwen3.7 MaxmediumGemini 3 Flash PreviewmediumvsGPT-5.6 SollowGemini 3.5 FlashlowvsQwen3.7 MaxmediumGemini 3.5 FlashhighvsGPT-5.6 SollowClaude Fable 5mediumvsGPT-5.6 SollowGemini 3.1 Pro PreviewmediumvsGPT-5.6 SollowGemini 3.5 FlashmediumvsGPT-5.6 SollowGemini 3.5 FlashhighvsQwen3.7 MaxmediumGPT-5.6 SollowvsQwen3.6 Max PreviewmediumClaude Opus 4.8mediumvsGPT-5.6 SollowClaude Opus 4.7mediumvsGPT-5.6 Sollow