Navigate
Advertise here

Ember-1 (low) vs Kimi K2.7 Code (medium)

The average score is effectively tied at 7.0 vs 7.0. Kimi K2.7 Code (medium) has the lower benchmark cost at $1.136 vs $1.488. Ember-1 (low) is faster at 34.90s vs 81.18s, with pass rates of 65.2% vs 60.9%.

Last updated at: 2026-11-13

Compared models

Rank
#227
Total Output Tokens
56,766
Response Time (avg)
34.90s
Total Cost
$1.488
Rank
#226
Total Output Tokens
207,661
Response Time (avg)
81.18s
Total Cost
$1.136
Recommended model Ember-1 (low)

It has the best score here (7.0), while responding about 2.3x faster than Kimi K2.7 Code (medium).

Detailed comparison

Metric Ember-1 Ember-1 low Release: 2026-09-28 Kimi K2.7 Code Kimi K2.7 Code medium Release: 2026-06-12
Score 7.0 7.0
Rank #227 #226
Reliability 8.8 10.0
Consistency 8.2 8.1
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 65.2% 60.9%
Flaky tests 5 5
Total Runs 69 69
Cost per result 11.441 8.755
Total Cost $1.488 $1.136
Input Price $3.000 / 1M $0.672 / 1M
Output Price $15.000 / 1M $3.350 / 1M
Cache Read Price $0.300 / 1M $0.180 / 1M
Cache Write Price N/A N/A
Total Input Tokens 211,908 245,179
Output Tokens 14,158 62,697
Reasoning Tokens 42,608 196,621
Response Time (avg) 34.90s 81.18s
Response Time (max) 121.29s 365.80s
Response Time (total) 802.79s 1785.87s
Parameters ~2.8T total (~104B active) 1T total (32B active)
Availability Closed Weights available

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#227 Ember-1

low
Cost
$0.016
Time
24.2s
Tokens
1,165 tok

#226 MoonshotAI: Kimi K2.7 Code

medium
Cost
$0.025
Time
138.0s
Tokens
6,093 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Ember-1 10.0 10.0 100.0% 0 37.91s 8,097 2,518 13,142
Kimi K2.7 Code 7.8 9.3 66.7% 0 146.73s 4,650 1,864 25,635

Switch Comparison Pair