- Score
- 9.4 (+2.40 points)
- Total Cost (Current Price)
- $0.183 · 96.0% cheaper
- Response Time (avg)
- 6.24s · 96.0% faster
Summary
Step 5 Preview scores 7.0 on AI BENCHY and ranks #169. It has 9.5 reliability, a 52.2% pass rate, $4.513 total cost, and 154.41s average response time.
What makes Step 5 Preview unique: It stands out most in Combined, where it ranks #1, while Anti-AI Tricks is its weakest area at #16.
Recommended alternatives
We recommend choosing one of these models instead:
- Score
- 8.6 (+1.62 points)
- Total Cost (Current Price)
- $0.061 · 98.7% cheaper
- Response Time (avg)
- 7.51s · 95.1% faster
- Score
- 9.6 (+2.60 points)
- Total Cost (Current Price)
- $0.460 · 89.8% cheaper
- Response Time (avg)
- 7.15s · 95.4% faster
Model facts
Researched on 2026-10-09
- Parameters
- 600B total (27B active)
- Architecture
- MoE
- Availability
- Closed
- License
- -
OpenRouter reports 600B total / 27B active sparse MoE parameters for this exact API checkpoint. Vendor documentation confirms 1M context, 64K output and low/medium/high reasoning controls. No official downloadable exact checkpoint and license were verified in this registration; community mirrors alone do not establish an official open-source release. OpenRouter declares mandatory reasoning with medium default.
7.0
Consistency
8.5
9.5
$4.513
Total Output Tokens
1,581,325
Total Input Tokens
243,381
Input Price
$1.000 / 1M
Output Price
$2.700 / 1M
Cache Read Price
$0.050 / 1M
Cache Write Price
N/A
Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.
Flaky tests
4
Flaky tests had mixed outcomes across runs (at least one pass and one fail).
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#169 Step 5 Preview
high- Cost
- $0.057
- Time
- 150.1s
- Tokens
- 20,970 tok
Charts
Choose the first model, then click a second model to open a side-by-side page.
Top Models by Score
Score vs Total Cost
Response Time (avg)
Score vs Response Time (avg)
Total Output Tokens
Score vs Total Output Tokens
Quick Compare
Category Breakdown
| Category | Score | Consistency | Tests Correct |
|---|---|---|---|
| Agentic | 10.0 | 10.0 | |
| Anti-AI Tricks | 6.5 | 8.0 | |
| Coding | 2.9 | 10.0 | |
| Combined | 10.0 | 10.0 | |
| Data parsing and extraction | 10.0 | 10.0 | |
| Domain specific | 3.0 | 10.0 | |
| General Intelligence | 3.4 | 9.3 | |
| Instructions following | 7.3 | 5.8 | |
| Puzzle Solving | 5.8 | 4.4 | |
| Tool Calling | 10.0 | 10.0 | |
| Trivia | 3.0 | 10.0 |