Navigate
Advertise here

Ember-1 (high) vs GLM 5.3 Flash (max)

GLM 5.3 Flash (max) leads on average score with 9.0 vs 6.9. GLM 5.3 Flash (max) has the lower benchmark cost at $0.089 vs $2.405. GLM 5.3 Flash (max) is faster at 54.04s vs 58.14s, with pass rates of 71.0% vs 82.6%.

Last updated at: 2026-10-19

Compared models

Rank
#196
Total Output Tokens
121,223
Response Time (avg)
58.14s
Total Cost
$2.405
Rank
#53
Total Output Tokens
216,119
Response Time (avg)
54.04s
Total Cost
$0.089
Recommended model GLM 5.3 Flash (max)

It has the best score here (9.0), while costing about 27.3x less than Ember-1 (high).

Detailed comparison

Metric Ember-1 Ember-1 high Release: 2026-09-28 GLM 5.3 Flash GLM 5.3 Flash max Release: 2026-08-26
Score 6.9 9.0
Rank #196 #53
Reliability 8.6 10.0
Consistency 7.2 9.0
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 71.0% 82.6%
Flaky tests 8 3
Total Runs 69 69
Cost per result 20.041 0.519
Total Cost $2.405 $0.089
Input Price $3.000 / 1M $0.150 / 1M
Output Price $15.000 / 1M $0.500 / 1M
Cache Read Price $0.300 / 1M $0.030 / 1M
Cache Write Price N/A N/A
Total Input Tokens 195,489 255,743
Output Tokens 12,475 8,684
Reasoning Tokens 108,748 207,435
Response Time (avg) 58.14s 54.04s
Response Time (max) 255.06s 333.47s
Response Time (total) 1337.19s 1242.97s
Parameters ~2.8T total (~104B active) 320B total (18B active)
Availability Closed Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#196 Ember-1

high
Cost
$0.038
Time
55.1s
Tokens
2,671 tok

#53 GLM 5.3 Flash

max
Cost
$0.005
Time
296.5s
Tokens
16,250 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Ember-1 8.2 7.2 88.9% 1 72.23s 7,144 1,281 23,093
GLM 5.3 Flash 10.0 10.0 100.0% 0 43.37s 7,317 381 23,692

Switch Comparison Pair