Navigate
Advertise here

GPT-5.2 (medium) vs Qwen3.8 27B (high)

The average score is effectively tied at 8.4 vs 8.4. Qwen3.8 27B (high) has the lower benchmark cost at ~$0.287 vs $1.182. GPT-5.2 (medium) is faster at 28.51s vs 167.89s, with pass rates of 72.7% vs 77.3%.

Last updated at: 2026-09-28

Compared models

Rank
#64
Total Output Tokens
71,252
Response Time (avg)
28.51s
Total Cost
$1.182
Rank
#65
Total Output Tokens
656,635
Response Time (avg)
167.89s
Total Cost
~$0.287
Recommended model Qwen3.8 27B (high)

It has the best score here (8.4), while costing about 4.1x less than GPT-5.2 (medium).

Detailed comparison

Metric GPT-5.2 GPT-5.2 medium Release: 2025-12-11 Qwen3.8 27B Qwen3.8 27B high Release: 2026-08-14
Score 8.4 8.4
Rank #64 #65
Reliability 10.0 9.6
Consistency 8.5 9.2
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 72.7% 77.3%
Flaky tests 4 2
Total Runs 66 66
Cost per result 8.438 ~1.792
Total Cost $1.182 ~$0.287
Input Price $1.750 / 1M N/A
Output Price $14.000 / 1M N/A
Total Input Tokens 105,013 100,179
Output Tokens 9,914 904
Reasoning Tokens 61,338 655,731
Response Time (avg) 28.51s 167.89s
Response Time (max) 116.86s 640.85s
Response Time (total) 456.13s 3693.54s
Parameters ~1.2T total (~80B active) 27.3B
Availability Closed Weights available

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#64 GPT-5.2

medium
Cost
$0.047
Time
49.2s
Tokens
3,396 tok

#65 Qwen3.8 27B

high
Cost
~$0.008
Time
270.1s
Tokens
18,963 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 10.0 10.0 100.0% 0 22.73s 7,302 511 11,912
Qwen3.8 27B 8.1 7.0 88.9% 1 248.62s 8,235 346 143,335

Quick Compare

Switch Comparison Pair