Navigate
Advertise here

GPT-5.2 (medium) vs Qwen3.8 27B (high)

The average score is effectively tied at 8.7 vs 8.7. Qwen3.8 27B (high) has the lower benchmark cost at ~$0.298 vs $1.558. GPT-5.2 (medium) is faster at 31.29s vs 166.34s, with pass rates of 73.9% vs 78.3%.

Last updated at: 2026-11-13

Compared models

Rank
#89
Total Output Tokens
80,538
Response Time (avg)
31.29s
Total Cost
$1.558
Rank
#90
Total Output Tokens
677,080
Response Time (avg)
166.34s
Total Cost
~$0.298
Recommended model Qwen3.8 27B (high)

It has the best score here (8.7), while costing about 5.2x less than GPT-5.2 (medium).

Detailed comparison

Metric GPT-5.2 GPT-5.2 medium Release: 2025-12-11 Qwen3.8 27B Qwen3.8 27B high Release: 2026-08-14 Free Available
Score 8.7 8.7
Rank #89 #90
Reliability 10.0 9.7
Consistency 8.5 9.2
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 73.9% 78.3%
Flaky tests 4 2
Total Runs 69 69
Cost per result 10.261 ~1.751
Total Cost $1.558 ~$0.298
Input Price $1.750 / 1M N/A
Output Price $14.000 / 1M N/A
Cache Read Price $0.175 / 1M N/A
Cache Write Price N/A N/A
Total Input Tokens 235,207 348,967
Output Tokens 11,065 1,005
Reasoning Tokens 69,473 676,075
Response Time (avg) 31.29s 166.34s
Response Time (max) 116.86s 640.85s
Response Time (total) 531.98s 3825.81s
Parameters ~1.2T total (~80B active) 27.3B
Availability Closed Weights available

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#89 GPT-5.2

medium
Cost
$0.047
Time
49.2s
Tokens
3,396 tok

#90 Qwen3.8 27B

high
Cost
~$0.008
Time
270.1s
Tokens
18,963 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.2 10.0 10.0 100.0% 0 22.73s 7,302 511 11,912
Qwen3.8 27B 8.1 7.0 88.9% 1 248.62s 8,235 346 143,335

Switch Comparison Pair

Qwen3.8 27BhighFree AvailablevsMiMo-V2.6-PromediumSeed 2.1 TurbomediumvsQwen3.8 27BhighFree AvailableGPT-6 SollowvsQwen3.8 27BhighFree AvailableGPT-5.2mediumvsParticle-1xhighParticle-1xhighvsQwen3.8 27BhighFree AvailableClaude Fable 5.2highvsGPT-5.2mediumMuse EmberlowvsQwen3.8 27BhighFree AvailableMuse EmbermaxvsQwen3.8 27BhighFree AvailableMuse EmberlowvsGPT-5.2mediumMuse EmbermaxvsGPT-5.2mediumERNIE-Light-DT-1.0highvsGPT-5.2mediumDeepSeek V4.1 FlashmaxvsQwen3.8 27BhighFree Available