Navigate
Advertise here

Muse Ember (medium) vs Qwen4 Max (high)

The average score is effectively tied at 8.5 vs 8.6. Muse Ember (medium) has the lower benchmark cost at $0.190 vs $1.363. Muse Ember (medium) is faster at 12.39s vs 52.90s, with pass rates of 75.4% vs 85.5%.

Last updated at: 2026-11-16

Compared models

Rank
#109
Total Output Tokens
324,857
Response Time (avg)
12.39s
Total Cost
$0.190
Rank
#105
Total Output Tokens
185,844
Response Time (avg)
52.90s
Total Cost
$1.363
Recommended model Muse Ember (medium)

It has the best score here (8.5), while costing about 7.2x less than Qwen4 Max (high).

Detailed comparison

Metric Muse Ember Muse Ember medium Release: 2026-11-09 Qwen4 Max Qwen4 Max high Release: 2026-11-16
Score 8.5 8.6
Rank #109 #105
Reliability 10.0 10.0
Consistency 8.2 9.6
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 75.4% 85.5%
Flaky tests 5 1
Total Runs 69 69
Cost per result 1.266 7.172
Total Cost $0.190 $1.363
Input Price $0.100 / 1M $1.500 / 1M
Output Price $0.500 / 1M $4.500 / 1M
Cache Read Price $0.004 / 1M $0.075 / 1M
Cache Write Price $0.125 / 1M $1.875 / 1M
Total Input Tokens 274,381 350,854
Output Tokens 12,835 8,427
Reasoning Tokens 312,022 177,417
Response Time (avg) 12.39s 52.90s
Response Time (max) 75.32s 437.98s
Response Time (total) 285.08s 1216.62s
Parameters ~150B total (~10B active) ~2.4T total (~95B active)
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#109 Muse Ember

medium
Cost
$0.003
Time
10.0s
Tokens
5,136 tok

#105 Qwen4 Max

high
Cost
$0.076
Time
277.5s
Tokens
16,848 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Muse Ember 10.0 10.0 100.0% 0 6.94s 7,410 1,074 25,110
Qwen4 Max 10.0 10.0 100.0% 0 15.68s 8,001 431 9,195

Switch Comparison Pair