Advertise here
#281

Step 5 Preview

Stepfun Release: 2026-10-09 Tested on: 2026-10-09 03:47 stepfun/step-5-preview::low
600B total (27B active)MoEClosed
(high) (medium) (low)

Summary

Step 5 Preview scores 5.6 on AI BENCHY and ranks #281. It has 9.7 reliability, a 58.0% pass rate, $4.110 total cost, and 138.27s average response time.

What makes Step 5 Preview unique: It stands out most in Instructions following, where it ranks #1, while Coding is its weakest area at #17.

Model facts

Researched on 2026-10-09

Reported
Parameters
600B total (27B active)
Architecture
MoE
Availability
Closed
License
-

OpenRouter reports 600B total / 27B active sparse MoE parameters for this exact API checkpoint. Vendor documentation confirms 1M context, 64K output and low/medium/high reasoning controls. No official downloadable exact checkpoint and license were verified in this registration; community mirrors alone do not establish an official open-source release. OpenRouter declares mandatory reasoning with medium default.

Parameter source Availability source

Score

5.6

Consistency

7.5

Reliability

9.7

Total Cost (Current Price)

$4.110

Total Output Tokens

1,425,268

Total Input Tokens

261,256

Input Price

$1.000 / 1M

Output Price

$2.700 / 1M

Cache Read Price

$0.050 / 1M

Cache Write Price

N/A

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Tests Correct

Wrong Tests: 13

Attempt pass rate: 58.0%

Flaky tests

7

Flaky tests had mixed outcomes across runs (at least one pass and one fail).

Response Time (avg)

138.27s

Response Time (max): 436.56s

Response Time (total): 3180.10s

No answer: 7 API error: 2 Wrong answer: 2 Did not follow instructions: 1 Invalid tool call: 1

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#281 Step 5 Preview

low
Cost
$0.051
Time
125.6s
Tokens
18,795 tok

Charts

Choose the first model, then click a second model to open a side-by-side page.

Total Output Tokens

Score vs Total Output Tokens

Quick Compare

Step 5 PreviewlowvsSolar Pro 4noneStep 5 PreviewlowvsGLM 5noneStep 5 PreviewlowvsGPT-5.4noneStep 5 PreviewlowvsQwen3.5-35B-A3BnoneStep 5 PreviewlowvsSpace Bunny AlphalowStep 5 PreviewlowvsNemotron 3 SupermediumFree AvailableStep 5 PreviewlowvsGemma 4 31BnoneFree AvailableStep 5 PreviewlowvsKimi K2.6noneStep 5 PreviewlowvsDots 3 Note PreviewmediumFree AvailableStep 5 PreviewlowvsLing 3.1 Flashnone

Category Breakdown

Category Score Consistency Tests Correct
Agentic 3.4 2.2
Anti-AI Tricks 6.9 7.9
Coding 2.7 7.0
Combined 7.3 5.8
Data parsing and extraction 10.0 10.0
Domain specific 3.6 7.2
General Intelligence 3.5 2.2
Instructions following 10.0 10.0
Puzzle Solving 7.6 7.2
Tool Calling 10.0 10.0
Trivia 3.0 10.0

Compared models