Navigate
Advertise here

GPT-6.2 Sol (low) vs Qwen3.7 Max (medium)

Qwen3.7 Max (medium) leads on average score with 8.5 vs 8.4. GPT-6.2 Sol (low) has the lower benchmark cost at $0.354 vs $1.689. GPT-6.2 Sol (low) is faster at 4.44s vs 48.35s, with pass rates of 84.1% vs 85.5%.

Last updated at: 2026-11-17

Compared models

Rank
#125
Total Output Tokens
5,820
Response Time (avg)
4.44s
Total Cost
$0.354
Rank
#122
Total Output Tokens
259,032
Response Time (avg)
48.35s
Total Cost
$1.689
Recommended model GPT-6.2 Sol (low)

Its score stays close to the best score here (8.4 vs 8.5), while costing about 4.8x less than Qwen3.7 Max (medium).

Detailed comparison

Metric GPT-6.2 Sol GPT-6.2 Sol low Release: 2026-11-17 Qwen3.7 Max Qwen3.7 Max medium Release: 2026-05-22
Score 8.4 8.5
Rank #125 #122
Reliability 10.0 10.0
Consistency 8.9 8.7
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 84.1% 85.5%
Flaky tests 3 4
Total Runs 69 69
Cost per result 1.963 12.033
Total Cost $0.354 $1.689
Input Price $2.000 / 1M $1.475 / 1M
Output Price $10.000 / 1M $4.425 / 1M
Cache Read Price $0.100 / 1M $0.295 / 1M
Cache Write Price $2.500 / 1M $1.844 / 1M
Total Input Tokens 147,521 367,848
Output Tokens 4,652 8,753
Reasoning Tokens 1,168 250,279
Response Time (avg) 4.44s 48.35s
Response Time (max) 42.86s 556.06s
Response Time (total) 102.02s 1112.11s
Parameters ~2T total (~150B active) ~1T total (~40B active)
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#125 GPT-6.2 Sol

low
Cost
$0.018
Time
20.3s
Tokens
1,872 tok

#122 Qwen3.7 Max

medium
Cost
$0.017
Time
68.8s
Tokens
4,526 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-6.2 Sol 5.4 7.2 44.4% 1 1.65s 7,302 372 0
Qwen3.7 Max 10.0 10.0 100.0% 0 35.31s 7,893 423 34,808

Switch Comparison Pair