Navigate
Advertise here

Qwen3.7 Max (medium) vs Inkling (high)

Qwen3.7 Max (medium) leads on average score with 8.5 vs 8.4. Inkling (high) has the lower benchmark cost at $1.250 vs $2.046. Qwen3.7 Max (medium) is faster at 48.35s vs 62.72s, with pass rates of 85.5% vs 78.3%.

Last updated at: 2026-10-01

Compared models

Rank
#67
Total Output Tokens
259,032
Response Time (avg)
48.35s
Total Cost
$2.046
Rank
#72
Total Output Tokens
249,242
Response Time (avg)
62.72s
Total Cost
$1.250
Recommended model Inkling (high)

Its score stays close to the best score here (8.4 vs 8.5), while costing about 1.6x less than Qwen3.7 Max (medium).

Detailed comparison

Metric Qwen3.7 Max Qwen3.7 Max medium Release: 2026-05-22 Inkling Inkling high Release: 2026-07-18 Free Available
Score 8.5 8.4
Rank #67 #72
Reliability 10.0 10.0
Consistency 8.7 9.0
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 85.5% 78.3%
Flaky tests 4 3
Total Runs 69 69
Cost per result 12.033 7.812
Total Cost $2.046 $1.250
Input Price $1.475 / 1M $1.000 / 1M
Output Price $4.425 / 1M $4.050 / 1M
Total Input Tokens 367,848 240,395
Output Tokens 8,753 7,169
Reasoning Tokens 250,279 242,073
Response Time (avg) 48.35s 62.72s
Response Time (max) 556.06s 327.51s
Response Time (total) 1112.11s 1442.48s
Parameters ~1T total (~40B active) 975B total (41B active)
Availability Closed Open source

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#67 Qwen3.7 Max

medium
Cost
$0.017
Time
68.8s
Tokens
4,526 tok

#72 Thinking Machines: Inkling

high
Cost
$0.005
Time
32.2s
Tokens
1,275 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.7 Max 10.0 10.0 100.0% 0 35.31s 7,893 423 34,808
Inkling 8.5 10.0 66.7% 0 148.36s 7,374 430 78,982

Quick Compare

Switch Comparison Pair

Muse Spark 1.3lowvsQwen3.7 MaxmediumGemini 3.1 Pro PreviewmediumvsInklinghighFree AvailableQwen3.7 MaxmediumvsGrok 4.6highMuse Glimmer 30BxhighvsInklinghighFree AvailableGPT-5 MinimediumvsInklinghighFree AvailableQwen3.8 2.4T A95BlowvsInklinghighFree AvailableMuse Glimmer 30BxhighvsQwen3.7 MaxmediumClaude Sonnet 5.5highvsQwen3.7 MaxmediumClaude Sonnet 5.5xhighvsQwen3.7 MaxmediumMuse Spark 1.1lowvsQwen3.7 MaxmediumKimi K3maxvsInklinghighFree AvailableClaude Sonnet 5mediumvsInklinghighFree Available