Navigate
Advertise here

Kimi K2.5 vs Step 3.5 Flash (medium)

Step 3.5 Flash (medium) leads on average score with 5.4 vs 5.3. Step 3.5 Flash (medium) has the lower benchmark cost at $0.105 vs $0.262. Kimi K2.5 is faster at 35.86s vs 190.48s, with pass rates of 29.0% vs 49.3%.

Last updated at: 2026-11-13

Compared models

Rank
#379
Total Output Tokens
49,389
Response Time (avg)
35.86s
Total Cost
$0.262
Rank
#374
Total Output Tokens
454,482
Response Time (avg)
190.48s
Total Cost
$0.105
Recommended model Kimi K2.5

Its score stays close to the best score here (5.3 vs 5.4), while responding about 5.3x faster than Step 3.5 Flash (medium).

Detailed comparison

Metric Kimi K2.5 Kimi K2.5 none Release: 2026-01-27 Step 3.5 Flash Step 3.5 Flash medium Release: 2026-02-01
Score 5.3 5.4
Rank #379 #374
Reliability 10.0 10.0
Consistency 8.6 8.3
Attempts 69/69 66/69
Tests Correct
Attempt pass rate 29.0% 49.3%
Flaky tests 4 3
Total Runs 69 66
Cost per result 4.976 1.047
Total Cost $0.262 $0.105
Input Price $0.450 / 1M $0.100 / 1M
Output Price $2.250 / 1M $0.300 / 1M
Cache Read Price $0.070 / 1M N/A
Cache Write Price N/A N/A
Total Input Tokens 275,349 139,086
Output Tokens 49,377 193,584
Reasoning Tokens 12 413,546
Response Time (avg) 35.86s 190.48s
Response Time (max) 321.19s 1597.85s
Response Time (total) 609.61s 3238.23s
Parameters 1T total (32B active) 196B total (11B active)
Availability Weights available Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#379 MoonshotAI: Kimi K2.5

none
Cost
$0.015
Time
89.1s
Tokens
5,421 tok

#374 Step 3.5 Flash

medium
Cost
$0.008
Time
277.1s
Tokens
23,695 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Kimi K2.5 5.5 10.0 33.3% 0 24.56s 7,311 4,708 0
Step 3.5 Flash 2.4 5.2 0.0% 0 258.38s 2,211 13,207 22,429

Switch Comparison Pair