Navigate
AI BENCHY
Advertise here

GPT-5.2 (medium) vs Qwen3.8 27B (high)

The average score is effectively tied at 8.4 vs 8.4. Local hardware cost was not measured, so cost comparisons are unavailable. GPT-5.2 (medium) is faster at 28.51s vs 167.89s, with pass rates of 72.7% vs 77.3%.

Last updated at: 2026-08-15

Rank
#41
Total Output Tokens
71,252
Response Time (avg)
28.51s
Total Cost
$1.182
Rank
#42
Total Output Tokens
656,635
Response Time (avg)
167.89s
Total Cost
N/A
Recommended model GPT-5.2 (medium)

It has the best score here (8.4), while responding about 5.9x faster than Qwen3.8 27B (high).

Detailed comparison

Metric GPT-5.2 GPT-5.2 medium Release: 2025-12-11 Qwen3.8 27B Qwen3.8 27B high Release: 2026-08-14
Score 8.4 8.4
Rank #41 #42
Reliability 10.0 9.6
Consistency 8.5 9.2
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 72.7% 77.3%
Flaky tests 4 2
Total Runs 66 66
Cost per result 8.438 N/A
Total Cost $1.182 N/A
Input Price $1.750 / 1M N/A
Output Price $14.000 / 1M N/A
Total Input Tokens 105,013 100,179
Output Tokens 9,914 904
Reasoning Tokens 61,338 655,731
Response Time (avg) 28.51s 167.89s
Response Time (max) 116.86s 640.85s
Response Time (total) 456.13s 3693.54s
Parameters ~1.2T total (~80B active) 27.3B
Availability Closed Weights available

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#41 GPT-5.2

medium
Cost
$0.047
Time
49.2s
Tokens
3,396 tok

#42 Qwen3.8 27B

high
Cost
N/A
Time
270.1s
Tokens
18,963 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 10.0 10.0 100.0% 0 22.73s 7,302 511 11,912
Qwen3.8 27B 8.1 7.0 88.9% 1 248.62s 8,235 346 143,335

Quick Compare

Switch Comparison Pair

Seed 2.1 TurbomediumvsQwen3.8 27BhighGPT-5.2mediumvsGrok 4.5lowQwen3.8 27BhighvsGrok 4.5lowGPT-5.2mediumvsInkling SmallhighQwen3.8 27BhighvsGrok 4.6mediumMuse Spark 1.2lowvsGPT-5.2mediumMuse Spark 1.2lowvsQwen3.8 27BhighQwen3.8 27BhighvsGrok 4.5mediumMuse Spark 1.1lowvsQwen3.8 27BhighMuse Spark 1.1lowvsGPT-5.2mediumGPT-5.4mediumvsQwen3.8 27BhighGemini 2.5 FlashmediumvsQwen3.8 27Bhigh