Navigate
Advertise here

Ember-1 (max) vs GLM 5.3 FlashX Legal (low)

The average score is effectively tied at 6.7 vs 6.7. GLM 5.3 FlashX Legal (low) has the lower benchmark cost at $0.135 vs $3.264. GLM 5.3 FlashX Legal (low) is faster at 8.30s vs 97.34s, with pass rates of 59.4% vs 55.1%.

Last updated at: 2026-11-10

Compared models

Rank
#242
Total Output Tokens
186,901
Response Time (avg)
97.34s
Total Cost
$3.264
Rank
#237
Total Output Tokens
37,995
Response Time (avg)
8.30s
Total Cost
$0.135
Recommended model GLM 5.3 FlashX Legal (low)

It has the best score here (6.7), while costing about 24.2x less than Ember-1 (max).

Detailed comparison

Metric Ember-1 Ember-1 max Release: 2026-09-28 GLM 5.3 FlashX Legal GLM 5.3 FlashX Legal low Release: 2026-11-02
Score 6.7 6.7
Rank #242 #237
Reliability 8.3 9.7
Consistency 7.8 7.8
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 59.4% 55.1%
Flaky tests 6 6
Total Runs 69 69
Cost per result 29.671 1.349
Total Cost $3.264 $0.135
Input Price $3.000 / 1M $0.370 / 1M
Output Price $15.000 / 1M $1.250 / 1M
Cache Read Price $0.300 / 1M $0.075 / 1M
Cache Write Price N/A N/A
Total Input Tokens 153,399 236,104
Output Tokens 7,803 11,222
Reasoning Tokens 179,098 26,773
Response Time (avg) 97.34s 8.30s
Response Time (max) 587.08s 64.18s
Response Time (total) 2238.73s 190.99s
Parameters ~2.8T total (~104B active) ~320B total (~18B active)
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#242 Ember-1

max
Cost
$0.163
Time
229.4s
Tokens
11,002 tok

#237 GLM 5.3 FlashX Legal

low
Cost
$0.003
Time
12.4s
Tokens
2,362 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Ember-1 5.2 4.4 55.6% 2 105.09s 3,362 1,149 27,957
GLM 5.3 FlashX Legal 5.4 7.2 44.4% 1 5.90s 7,317 465 3,760

Quick Compare

Switch Comparison Pair

Qwen3.5-FlashnonevsGLM 5.3 FlashX LegallowEmber-1maxvsGPT 5.3 ChatdefaultEmber-1maxvsMiniMax M3mediumEmber-1maxvsGPT-5.6 SolnoneEmber-1maxvsGrok 4.7highApodex 1.1 MinihighFree AvailablevsEmber-1maxEmber-1maxvsSolar Pro 4lowGrok Build 0.1mediumvsGLM 5.3 FlashX LegallowGrok 4.7highvsGLM 5.3 FlashX LegallowMiniMax M3mediumvsGLM 5.3 FlashX LegallowEmber-1maxvsQwen3.5-FlashnoneGrok 4.7xhighvsGLM 5.3 FlashX Legallow