Navigate
Advertise here

GPT-5.6 Luna (high) vs Qwen3.5-27B (medium)

GPT-5.6 Luna (high) leads on average score with 8.0 vs 7.9. GPT-5.6 Luna (high) has the lower benchmark cost at $0.118 vs $1.135. GPT-5.6 Luna (high) is faster at 18.39s vs 114.73s, with pass rates of 71.0% vs 76.8%.

Last updated at: 2026-10-07

Compared models

Rank
#96
Total Output Tokens
139,395
Response Time (avg)
18.39s
Total Cost
$0.118
Rank
#102
Total Output Tokens
635,288
Response Time (avg)
114.73s
Total Cost
$1.135
Recommended model GPT-5.6 Luna (high)

It has the best score here (8.0), while costing about 9.6x less than Qwen3.5-27B (medium).

Detailed comparison

Metric GPT-5.6 Luna GPT-5.6 Luna high Release: 2026-07-09 Qwen3.5-27B Qwen3.5-27B medium Release: 2026-02-24
Score 8.0 7.9
Rank #96 #102
Reliability 10.0 10.0
Consistency 8.6 7.9
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 71.0% 76.8%
Flaky tests 4 6
Total Runs 69 69
Cost per result 5.882 8.104
Total Cost $0.118 $1.135
Input Price $0.200 / 1M $0.195 / 1M
Output Price $1.200 / 1M $1.560 / 1M
Cache Read Price $0.020 / 1M N/A
Cache Write Price $0.250 / 1M N/A
Total Input Tokens 197,896 288,919
Output Tokens 6,211 17,484
Reasoning Tokens 133,184 617,804
Response Time (avg) 18.39s 114.73s
Response Time (max) 111.09s 1026.43s
Response Time (total) 422.93s 2638.74s
Parameters ~400B total (~17B active) 27B
Availability Closed Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#96 GPT-5.6 Luna

high
Cost
$0.033
Time
34.2s
Tokens
5,484 tok

#102 Qwen3.5-27B

medium
Cost
$0.008
Time
62.0s
Tokens
3,099 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Luna 5.5 4.7 55.6% 2 15.63s 7,302 510 17,746
Qwen3.5-27B 6.2 7.1 55.6% 1 160.69s 7,895 6,381 89,388

Switch Comparison Pair