Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.6 Sol vs Qwen: Qwen3.7 Max

Summary

GPT-5.6 Sol (high) vs Qwen3.7 Max (medium) benchmark comparison: The average score is effectively tied at 9.4 vs 9.4. Qwen3.7 Max (medium) has the lower benchmark cost at $0.523 vs $0.821. GPT-5.6 Sol (high) is faster at 10.56s vs 16.02s, with pass rates of 88.9% vs 88.9%.

Recommended model: Qwen3.7 Max (medium) - It has the best score here (9.4), while costing about 1.6x less than GPT-5.6 Sol (high).

Last updated at: 2026-07-09

Metric GPT-5.6 Sol GPT-5.6 Sol high Release: 2026-07-09 Qwen3.7 Max Qwen3.7 Max medium Release: 2026-05-22
Score 9.4 9.4
Rank #6 #4
Reliability 10.0 10.0
Consistency 8.8 9.6
Tests Correct
Attempt pass rate 88.9% 88.9%
Flaky tests 3 1
Total Runs 63 63
Cost per result 4.824 5.517
Total Cost $0.821 $0.523
Input Price $5.000 / 1M $1.250 / 1M
Output Price $30.000 / 1M $3.750 / 1M
Total Input Tokens 34,114 42,360
Output Tokens 1,872 2,129
Reasoning Tokens 19,777 122,959
Response Time (avg) 10.56s 16.02s
Response Time (max) 54.79s 59.98s
Response Time (total) 221.69s 336.51s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#6 GPT-5.6 Sol

high
Cost
$0.151
Time
201.9s
Tokens
5,100 tok

#4 Qwen3.7 Max

medium
Cost
$0.017
Time
68.8s
Tokens
4,526 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 8.7 7.9 91.7% 1 3.39s 606 171 644
Qwen3.7 Max 10.0 10.0 100.0% 0 6.36s 672 222 8,742
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 10.0 10.0 100.0% 0 12.52s 7,302 404 5,656
Qwen3.7 Max 10.0 10.0 100.0% 0 35.31s 7,893 423 34,808
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 10.0 10.0 100.0% 0 13.68s 11,019 315 1,599
Qwen3.7 Max 10.0 10.0 100.0% 0 19.60s 14,934 366 8,405
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 10.0 10.0 100.0% 0 1.16s 7,140 222 0
Qwen3.7 Max 10.0 10.0 100.0% 0 8.80s 7,782 270 6,254
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 5.3 7.2 44.4% 1 39.45s 619 62 9,556
Qwen3.7 Max 5.9 7.2 55.6% 1 24.94s 771 61 31,793
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 10.0 10.0 100.0% 0 4.40s 477 97 238
Qwen3.7 Max 10.0 10.0 100.0% 0 11.70s 516 135 4,457
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 10.0 10.0 100.0% 0 2.73s 660 96 331
Qwen3.7 Max 10.0 10.0 100.0% 0 7.46s 699 102 5,452
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 10.0 10.0 100.0% 0 4.10s 642 211 675
Qwen3.7 Max 10.0 10.0 100.0% 0 8.84s 696 259 8,908
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 10.0 10.0 100.0% 0 7.08s 5,454 264 393
Qwen3.7 Max 10.0 10.0 100.0% 0 6.63s 8,193 267 1,220
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 4.7 1.6 66.7% 1 6.97s 195 30 685
Qwen3.7 Max 3.0 10.0 0.0% 0 33.37s 204 24 12,920

Quick Compare

Switch Comparison Pair

GPT-5.5lowvsQwen3.7 MaxmediumGemini 3.5 FlashlowvsGPT-5.6 SolhighGemini 3.5 FlashlowvsQwen3.7 MaxmediumClaude Fable 5mediumvsGPT-5.6 SolhighGemini 3.1 Pro PreviewmediumvsGPT-5.6 SolhighGPT-5.6 SollowvsQwen3.7 MaxmediumGemini 3.5 FlashmediumvsGPT-5.6 SolhighGemini 3 Flash PreviewmediumvsGPT-5.6 SolhighGemini 3.5 FlashhighvsQwen3.7 MaxmediumGPT-5.6 SolhighvsQwen3.6 Max PreviewmediumClaude Opus 4.8mediumvsGPT-5.6 SolhighClaude Opus 4.7mediumvsGPT-5.6 Solhigh