Advertise here
#411

Classify-1

Scaledown Release: 2026-10-13 Tested on: 2026-10-13 18:16 scaledown/classify-1::none
~1BDenseClosedEstimated

Summary

Classify-1 scores 2.2 on AI BENCHY and ranks #411. It has 9.4 reliability, a 18.8% pass rate, $0.008 total cost, and 4.58s average response time.

Model facts

Researched on 2026-10-13

Estimated
Parameters
~1B
Architecture
Dense
Availability
Closed
License
-

Best estimate from public evidence; the vendor did not disclose every value. ScaleDown does not disclose this checkpoint's parameter count, backbone or dense-versus-MoE architecture. The 1B dense value is a rough, low-confidence catalog estimate based only on its task-specific small-model positioning; it is not vendor-reported or measured. API-only pinned classify-1 checkpoint, with no official downloadable weights or checkpoint license found. The Jev-compatible Decisions endpoint returns choice, noul and score answers without free-form explanations or reasoning controls. Its state accepts a string or text/document fields. The direct /classify endpoint has a separate optional post-decision explanation; this OpenRouter Decisions route does not expose it. OpenRouter identifies the upstream snapshot as 20260928; its release_date field is null, so the fallback follows the request date.

Score

2.2

Consistency

4.5

Total Output Tokens

164

Total Input Tokens

195,645

Input Price

$0.040 / 1M

Output Price

$0.000 / 1M

Cache Read Price

N/A

Cache Write Price

N/A

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Tests Correct

Wrong Tests: 9

Attempt pass rate: 18.8%

Benchmark coverage: 36/69 attempts. Choices supplied by adapters. Supports 12/23 tests. Other tests are unsupported, not failed. Score uses the full suite.

Flaky tests

2

Flaky tests had mixed outcomes across runs (at least one pass and one fail).

Response Time (avg)

4.58s

Response Time (max): 13.35s

Response Time (total): 55.01s

Charts

Choose the first model, then click a second model to open a side-by-side page.

Total Output Tokens

Score vs Total Output Tokens

Quick Compare

Category Breakdown

Category Score Consistency Tests Correct
Agentic 0.0 0.0
Anti-AI Tricks 4.0 7.5
Coding 2.7 3.7
Combined 0.0 0.0
Data parsing and extraction 7.3 5.9
Domain specific 5.3 10.0
General Intelligence 0.0 0.0
Instructions following 1.5 5.0
Puzzle Solving 1.0 3.3
Tool Calling 0.0 0.0
Trivia 0.0 0.0

Compared models