Navigate
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Ember-1 (max) vs Qwen3.5-Flash

The average score is effectively tied at 6.7 vs 6.7. Qwen3.5-Flash has the lower benchmark cost at $0.089 vs $3.264. Qwen3.5-Flash is faster at 26.52s vs 97.34s, with pass rates of 59.4% vs 37.7%.

Last updated at: 2026-11-13

Compared models

Rank
#254
Total Output Tokens
186,901
Response Time (avg)
97.34s
Total Cost
$3.264
Rank
#250
Total Output Tokens
219,122
Response Time (avg)
26.52s
Total Cost
$0.089
Recommended model Qwen3.5-Flash

It has the best score here (6.7), while costing about 36.7x less than Ember-1 (max).

Detailed comparison

Metric Ember-1 Ember-1 max Release: 2026-09-28 Qwen3.5-Flash Qwen3.5-Flash none Release: 2026-02-24
Score 6.7 6.7
Rank #254 #250
Reliability 8.3 10.0
Consistency 7.8 9.3
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 59.4% 37.7%
Flaky tests 6 2
Total Runs 69 69
Cost per result 29.671 1.113
Total Cost $3.264 $0.089
Input Price $3.000 / 1M $0.065 / 1M
Output Price $15.000 / 1M $0.260 / 1M
Cache Read Price $0.300 / 1M N/A
Cache Write Price N/A N/A
Total Input Tokens 153,399 463,872
Output Tokens 7,803 219,122
Reasoning Tokens 179,098 0
Response Time (avg) 97.34s 26.52s
Response Time (max) 587.08s 480.96s
Response Time (total) 2238.73s 609.94s
Parameters ~2.8T total (~104B active) ~35B total (~3B active)
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#254 Ember-1

max
Cost
$0.163
Time
229.4s
Tokens
11,002 tok

#250 Qwen3.5-Flash

none
Cost
$0.003
Time
47.4s
Tokens
7,799 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Ember-1 5.2 4.4 55.6% 2 105.09s 3,362 1,149 27,957
Qwen3.5-Flash 5.5 10.0 33.3% 0 850ms 7,913 519 0

Quick Compare

Switch Comparison Pair

Qwen3.5-FlashnonevsGLM 5.3 FlashX LegallowEmber-1maxvsGPT 5.3 ChatdefaultEmber-1maxvsMiniMax M3mediumEmber-1maxvsGPT-5.6 SolnoneEmber-1maxvsGrok 4.7highApodex 1.1 MinihighFree AvailablevsEmber-1maxEmber-1maxvsSolar Pro 4lowQwen3.5-FlashnonevsSolar Pro 4lowQwen3.5-FlashnonevsGrok 4.7highQwen3.5-FlashnonevsGrok Build 0.1mediumMiniMax M3mediumvsQwen3.5-FlashnoneEmber-1maxvsGLM 5.3 FlashX Legallow