AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com
#30

Claude Sonnet 5

Anthropic Release: 2026-06-30 Tested on: 2026-06-30 21:33 anthropic/claude-sonnet-5::medium
~1T total (~100B active)MoEClosedEstimated
(medium) (none)

Summary

Claude Sonnet 5 scores 7.9 on AI BENCHY and ranks #30. It has 10.0 reliability, a 79.4% pass rate, $0.550 total cost, and 9.94s average response time.

What makes Claude Sonnet 5 unique: It stands out most in Domain specific, where it ranks #1, while Combined is its weakest area at #18.

Model facts

Researched on 2026-08-12

Estimated
Parameters
~1T total (~100B active)
Architecture
MoE
Availability
Closed
License
-

Best estimate from public evidence; the vendor did not disclose every value. Vendor does not disclose parameter counts.

Parameter source Availability source

Score

7.9

Consistency

9.0

Reliability

10.0

Total Cost (Current Price)

$0.550

Total Output Tokens

41,685

Total Input Tokens

67,416

Input Price

$2.000 / 1M

Output Price

$10.000 / 1M

Tests Correct

Wrong Tests: 6

Attempt pass rate: 79.4%

Flaky tests

3

Flaky tests had mixed outcomes across runs (at least one pass and one fail).

Response Time (avg)

9.94s

Response Time (max): 56.94s

Response Time (total): 208.71s

Wrong answer: 4 Did not follow instructions: 1 Invalid tool call: 1

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#30 Claude Sonnet 5

medium
Cost
$0.007
Time
6.4s
Tokens
832 tok

Run history

Tested on Score Reliability Tests Correct Total Cost Compare
2026-08-14 02:11 Re-test 8.2 10.0 $0.922 Compare
2026-07-16 22:33 New test added 8.3 10.0 $0.922 Compare
2026-06-30 21:33 Initial run 7.9 10.0 $0.550 Current run

Price History

Historical pricing data for this model from OpenRouter.

Date Input Price Output Price
2026-06-30 21:35 $2.000 / 1M $10.000 / 1M

Charts

Choose the first model, then click a second model to open a side-by-side page.

Total Output Tokens

Score vs Total Output Tokens

Quick Compare

Claude Sonnet 5mediumvsGemini 2.5 FlashmediumClaude Sonnet 5mediumvsQwen3.8 2.4T A95BlowClaude Sonnet 5mediumvsMuse Spark 1.1lowClaude Sonnet 5mediumvsGPT-5 MinimediumClaude Sonnet 5mediumvsInkling SmallhighClaude Sonnet 5mediumvsMuse Glimmer 30BxhighClaude Sonnet 5mediumvsSeed 2.1 TurbomediumClaude Sonnet 5mediumvsInklinghighClaude Sonnet 5mediumvsGPT-5.2mediumClaude Sonnet 5mediumvsMuse Spark 1.1high

Category Breakdown

Category Score Consistency Tests Correct
Anti-AI Tricks 10.0 10.0
Coding 9.0 7.9
Combined 4.5 2.1
Data parsing and extraction 10.0 10.0
Domain specific 7.7 10.0
General Intelligence 4.8 3.2
Instructions following 9.9 10.0
Puzzle Solving 7.7 10.0
Tool Calling 10.0 10.0
Trivia 3.0 10.0

Compared models