Advertise here
#478

Joey 1

Baseten Release: 2026-10-29 Tested on: 2026-11-09 21:38 baseten/joey-1::none
2BDenseOpen sourceEstimated

Summary

Joey 1 scores 1.9 on AI BENCHY and ranks #478. It has 10.0 reliability, a 13.0% pass rate, $0.001 total cost, and 646ms average response time.

Model facts

Researched on 2026-11-09

Estimated
Parameters
2B
Architecture
Dense
Availability
Open source
License
MIT

Best estimate from public evidence; the vendor did not disclose every value. Base Labs reports a 2B decision model post-trained from Qwen3.5-2B; the repository stores about 2.7B parameters including the vision encoder. Dense (no mixture of experts) is inferred from the base checkpoint. MIT weights and a pinned self-hosting setup script are public and ungated; the model returns typed decisions, not generated text.

Parameter source 1 Parameter source 2 Availability source

Score

1.9

Consistency

5.2

Reliability

10.0

Total Cost (Current Price)

$0.001

Total Output Tokens

69

Total Input Tokens

53,139

Input Price

$0.010 / 1M

Output Price

$0.000 / 1M

Cache Read Price

N/A

Cache Write Price

N/A

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Tests Correct

Wrong Tests: 9

Attempt pass rate: 13.0%

Benchmark coverage: 36/69 attempts. Choices supplied by adapters. Supports 12/23 tests. Other tests are unsupported, not failed. Score uses the full suite.

Flaky tests

0

Flaky tests had mixed outcomes across runs (at least one pass and one fail).

Response Time (avg)

646ms

Response Time (max): 789ms

Response Time (total): 7.75s

Wrong answer: 9

Charts

Choose the first model, then click a second model to open a side-by-side page.

Total Output Tokens

Score vs Total Output Tokens

Quick Compare

Joey 1defaultvsDecider Flash V1.2defaultJoey 1defaultvsD1defaultJoey 1defaultvsClef OmnidefaultJoey 1defaultvsGemini 3 Flash PreviewhighJoey 1defaultvsDecisions FastdefaultFree AvailableJoey 1defaultvsSolar Decide FlashdefaultJoey 1defaultvsClassify-1defaultJoey 1defaultvsMicrosoft-Decision-1defaultJoey 1defaultvsMammoth 1defaultFree AvailableJoey 1defaultvsd1.1default

Category Breakdown

Category Score Consistency Tests Correct
Agentic 0.0 0.0
Anti-AI Tricks 4.0 7.5
Coding 2.2 6.7
Combined 0.0 0.0
Data parsing and extraction 6.5 10.0
Domain specific 5.3 10.0
General Intelligence 0.0 0.0
Instructions following 1.5 5.0
Puzzle Solving 1.0 3.3
Tool Calling 0.0 0.0
Trivia 0.0 0.0

Compared models