Advertise here
#70

Claude Haiku 5.5

Anthropic Release: 2026-10-07 Tested on: 2026-10-07 22:01 anthropic/claude-haiku-5.5::max
~50BDenseClosedEstimated
(max) (xhigh) (high) (medium) (low)

Summary

Claude Haiku 5.5 scores 8.5 on AI BENCHY and ranks #70. It has 10.0 reliability, a 85.5% pass rate, $0.509 total cost, and 61.71s average response time.

What makes Claude Haiku 5.5 unique: It stands out most in Domain specific, where it ranks #4, while Agentic is its weakest area at #15. It uses unusually many reasoning tokens, which can help explain its slower or more expensive runs.

Model facts

Researched on 2026-10-07

Estimated
Parameters
~50B
Architecture
Dense
Availability
Closed
License
-

Best estimate from public evidence; the vendor did not disclose every value. Anthropic does not disclose parameter counts or architecture. The 50B dense entry is a low-confidence catalog estimate for the small, latency-oriented Haiku tier, not a vendor claim or a measured count. The cited announcement establishes the exact model identity, positioning and closed API availability. OpenRouter declares low, medium, high, xhigh and max effort levels with medium default and adaptive thinking.

Parameter source 1 Parameter source 2 Availability source

Score

8.5

Consistency

9.6

Reliability

10.0

Total Cost (Current Price)

$0.509

Total Output Tokens

919,699

Total Input Tokens

487,516

Input Price

$0.100 / 1M

Output Price

$0.500 / 1M

Cache Read Price

$0.010 / 1M

Cache Write Price

$0.125 / 1M

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Tests Correct

Wrong Tests: 4

Attempt pass rate: 85.5%

Flaky tests

1

Flaky tests had mixed outcomes across runs (at least one pass and one fail).

Response Time (avg)

61.71s

Response Time (max): 288.94s

Response Time (total): 1419.40s

No answer: 3 Wrong answer: 1

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#70 Claude Haiku 5.5

max
OpenRouter returned no showcase content (finish_reason: error).
Cost
$0.000
Time
164.5s
Tokens
0 tok

Charts

Choose the first model, then click a second model to open a side-by-side page.

Total Output Tokens

Score vs Total Output Tokens

Quick Compare

Claude Haiku 5.5maxvsQwen3.7 MaxmediumClaude Haiku 5.5maxvsQwen3.8 2.4T A95BlowClaude Haiku 5.5maxvsClaude Sonnet 5mediumClaude Haiku 5.5maxvsGPT-5 MinimediumClaude Haiku 5.5maxvsMuse Spark 1.3lowClaude Haiku 5.5maxvsMuse Glimmer 30BxhighClaude Haiku 5.5maxvsGrok 4.6highClaude Haiku 5.5maxvsGemini 3.1 Pro PreviewmediumClaude Haiku 5.5maxvsQwen3.8 Max (0902)lowClaude Haiku 5.5maxvsInklinghighFree Available

Category Breakdown

Category Score Consistency Tests Correct
Agentic 4.7 1.6
Anti-AI Tricks 10.0 10.0
Coding 10.0 10.0
Combined 10.0 10.0
Data parsing and extraction 10.0 10.0
Domain specific 5.3 10.0
General Intelligence 10.0 10.0
Instructions following 10.0 10.0
Puzzle Solving 10.0 10.0
Tool Calling 10.0 10.0
Trivia 3.0 10.0

Compared models