Summary
Classify-1 scores 2.2 on AI BENCHY and ranks #411. It has 9.4 reliability, a 18.8% pass rate, $0.008 total cost, and 4.58s average response time.
Model facts
Researched on 2026-10-13
- Parameters
- ~1B
- Architecture
- Dense
- Availability
- Closed
- License
- -
Best estimate from public evidence; the vendor did not disclose every value. ScaleDown does not disclose this checkpoint's parameter count, backbone or dense-versus-MoE architecture. The 1B dense value is a rough, low-confidence catalog estimate based only on its task-specific small-model positioning; it is not vendor-reported or measured. API-only pinned classify-1 checkpoint, with no official downloadable weights or checkpoint license found. The Jev-compatible Decisions endpoint returns choice, noul and score answers without free-form explanations or reasoning controls. Its state accepts a string or text/document fields. The direct /classify endpoint has a separate optional post-decision explanation; this OpenRouter Decisions route does not expose it. OpenRouter identifies the upstream snapshot as 20260928; its release_date field is null, so the fallback follows the request date.
2.2
Consistency
4.5
9.4
$0.008
Total Output Tokens
164
Total Input Tokens
195,645
Input Price
$0.040 / 1M
Output Price
$0.000 / 1M
Cache Read Price
N/A
Cache Write Price
N/A
Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.
Wrong Tests: 9
Attempt pass rate: 18.8%
Benchmark coverage: 36/69 attempts. Choices supplied by adapters. Supports 12/23 tests. Other tests are unsupported, not failed. Score uses the full suite.
Flaky tests
2
Flaky tests had mixed outcomes across runs (at least one pass and one fail).
Charts
Choose the first model, then click a second model to open a side-by-side page.
Score vs Total Cost
Response Time (avg)
Score vs Response Time (avg)
Total Output Tokens
Score vs Total Output Tokens
Quick Compare
Category Breakdown
| Category | Score | Consistency | Tests Correct |
|---|---|---|---|
| Agentic | 0.0 | 0.0 | |
| Anti-AI Tricks | 4.0 | 7.5 | |
| Coding | 2.7 | 3.7 | |
| Combined | 0.0 | 0.0 | |
| Data parsing and extraction | 7.3 | 5.9 | |
| Domain specific | 5.3 | 10.0 | |
| General Intelligence | 0.0 | 0.0 | |
| Instructions following | 1.5 | 5.0 | |
| Puzzle Solving | 1.0 | 3.3 | |
| Tool Calling | 0.0 | 0.0 | |
| Trivia | 0.0 | 0.0 |