Navigate
AI BENCHY
Advertise here

GPT-5.6 Sol (low) vs Qwen3.7 Max (medium)

GPT-5.6 Sol (low) leads on average score with 9.5 vs 9.1. GPT-5.6 Sol (low) has the lower benchmark cost at $0.496 vs $1.157. GPT-5.6 Sol (low) is faster at 9.04s vs 44.32s, with pass rates of 86.4% vs 86.4%.

Last updated at: 2026-08-20

Rank
#4
Total Output Tokens
19,946
Response Time (avg)
9.04s
Total Cost
$0.496
Rank
#17
Total Output Tokens
226,102
Response Time (avg)
44.32s
Total Cost
$1.157
Recommended model GPT-5.6 Sol (low)

It has the best score here (9.5), while costing about 2.3x less than Qwen3.7 Max (medium).

Detailed comparison

Metric GPT-5.6 Sol GPT-5.6 Sol low Release: 2026-07-09 Qwen3.7 Max Qwen3.7 Max medium Release: 2026-05-22
Score 9.5 9.1
Rank #4 #17
Reliability 10.0 10.0
Consistency 9.2 9.0
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 86.4% 86.4%
Flaky tests 2 3
Total Runs 66 66
Cost per result 5.508 8.904
Total Cost $0.496 $1.157
Input Price $2.500 / 1M $1.475 / 1M
Output Price $15.000 / 1M $4.425 / 1M
Total Input Tokens 78,580 106,029
Output Tokens 4,476 5,748
Reasoning Tokens 15,470 220,354
Response Time (avg) 9.04s 44.32s
Response Time (max) 53.91s 556.06s
Response Time (total) 198.97s 975.11s
Parameters ~2T total (~150B active) ~1T total (~40B active)
Availability Closed Closed

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#4 GPT-5.6 Sol

low
Cost
$0.062
Time
26.7s
Tokens
2,150 tok

#17 Qwen3.7 Max

medium
Cost
$0.017
Time
68.8s
Tokens
4,526 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 10.0 10.0 100.0% 0 11.25s 7,302 412 3,482
Qwen3.7 Max 10.0 10.0 100.0% 0 35.31s 7,893 423 34,808

Quick Compare

Switch Comparison Pair