Navigate
Advertise here

GPT-6 Luna (low) vs Qwen3.8 27B (low)

The average score is effectively tied at 7.6 vs 7.6. GPT-6 Luna (low) has the lower benchmark cost at $0.033 vs ~$0.089. GPT-6 Luna (low) is faster at 23.23s vs 46.60s, with pass rates of 63.8% vs 68.1%.

Last updated at: 2026-10-26

Compared models

Rank
#153
Total Output Tokens
24,880
Response Time (avg)
23.23s
Total Cost
$0.033
Rank
#154
Total Output Tokens
209,143
Response Time (avg)
46.60s
Total Cost
~$0.089
Recommended model GPT-6 Luna (low)

It has the best score here (7.6), while costing about 2.8x less than Qwen3.8 27B (low).

Detailed comparison

Metric GPT-6 Luna GPT-6 Luna low Release: 2026-09-23 Qwen3.8 27B Qwen3.8 27B low Release: 2026-08-14 Free Available
Score 7.6 7.6
Rank #153 #154
Reliability 9.7 10.0
Consistency 8.5 9.7
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 63.8% 68.1%
Flaky tests 4 1
Total Runs 69 69
Cost per result 0.267 ~0.589
Total Cost $0.033 ~$0.089
Input Price $0.100 / 1M N/A
Output Price $0.500 / 1M N/A
Cache Read Price $0.010 / 1M N/A
Cache Write Price $0.125 / 1M N/A
Total Input Tokens 195,928 315,290
Output Tokens 5,728 1,607
Reasoning Tokens 19,152 207,536
Response Time (avg) 23.23s 46.60s
Response Time (max) 89.37s 376.04s
Response Time (total) 534.22s 1071.83s
Parameters ~400B total (~17B active) 27.3B
Availability Closed Weights available

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#153 GPT-6 Luna

low
Cost
$0.002
Time
19.2s
Tokens
2,598 tok

#154 Qwen3.8 27B

low
Cost
~$0.003
Time
92.8s
Tokens
6,902 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-6 Luna 6.0 7.2 55.6% 1 15.39s 7,302 493 6,655
Qwen3.8 27B 7.7 10.0 66.7% 0 140.92s 8,127 585 86,694

Switch Comparison Pair

GPT-6 LunalowvsQwen3.8 Flash NextmediumQwen3.8 27BlowFree AvailablevsSpace Bunny AlphahighGPT-6 LunalowvsSpace Bunny AlphahighQwen3.8 27BlowFree AvailablevsGLM 5.1mediumGPT-6 LunalowvsGLM 5.1mediumSeed-2.0-MinimediumvsQwen3.8 27BlowFree AvailableSeed-2.0-MinimediumvsGPT-6 LunalowMistral Large 4highvsQwen3.8 27BlowFree AvailableMistral Large 4highvsGPT-6 LunalowMuse WonderxhighvsGPT-6 LunalowMuse WonderxhighvsQwen3.8 27BlowFree AvailableSeed-2.0-CodehighvsQwen3.8 27BlowFree Available