Navigate
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Ember-1 (low) vs Qwen4 Max

The average score is effectively tied at 7.0 vs 7.0. Qwen4 Max has the lower benchmark cost at $0.465 vs $1.488. Qwen4 Max is faster at 6.38s vs 34.90s, with pass rates of 65.2% vs 63.8%.

Last updated at: 2026-11-16

Compared models

Rank
#232
Total Output Tokens
56,766
Response Time (avg)
34.90s
Total Cost
$1.488
Rank
#230
Total Output Tokens
9,342
Response Time (avg)
6.38s
Total Cost
$0.465
Recommended model Qwen4 Max

It has the best score here (7.0), while costing about 3.2x less than Ember-1 (low).

Detailed comparison

Metric Ember-1 Ember-1 low Release: 2026-09-28 Qwen4 Max Qwen4 Max none Release: 2026-11-16
Score 7.0 7.0
Rank #232 #230
Reliability 8.8 10.0
Consistency 8.2 9.6
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 65.2% 63.8%
Flaky tests 5 1
Total Runs 69 69
Cost per result 11.441 3.321
Total Cost $1.488 $0.465
Input Price $3.000 / 1M $1.500 / 1M
Output Price $15.000 / 1M $4.500 / 1M
Cache Read Price $0.300 / 1M $0.075 / 1M
Cache Write Price N/A $1.875 / 1M
Total Input Tokens 211,908 281,902
Output Tokens 14,158 9,342
Reasoning Tokens 42,608 0
Response Time (avg) 34.90s 6.38s
Response Time (max) 121.29s 67.27s
Response Time (total) 802.79s 146.64s
Parameters ~2.8T total (~104B active) ~2.4T total (~95B active)
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#232 Ember-1

low
Cost
$0.016
Time
24.2s
Tokens
1,165 tok

#230 Qwen4 Max

none
Cost
$0.027
Time
123.5s
Tokens
6,091 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Ember-1 10.0 10.0 100.0% 0 37.91s 8,097 2,518 13,142
Qwen4 Max 5.8 10.0 33.3% 0 1.97s 8,010 384 0

Switch Comparison Pair