AI BENCHY
Advertise here
#42

Claude Opus 4.6

Anthropic Release: 2026-02-05 Tested on: 2026-04-11 01:44 anthropic/claude-opus-4.6::medium

Summary

Claude Opus 4.6 scores 7.6 on AI BENCHY and ranks #42. It has N/A reliability, a 70.4% pass rate, $1.446 total cost, and 21.08s average response time.

What makes Claude Opus 4.6 unique: It stands out most in Coding, where it ranks #1, while Anti-AI Tricks is its weakest area at #15.

Score

7.6

Consistency

9.1

Reliability

N/A

Total Cost (Current Price)

$1.446

Total Output Tokens

48,767

Total Input Tokens

0

Input Price

$5.000 / 1M

Output Price

$25.000 / 1M

Tests Correct

Wrong Tests: 6

Attempt pass rate: 70.4%

Flaky tests

2

Flaky tests had mixed outcomes across runs (at least one pass and one fail).

Response Time (avg)

21.08s

Response Time (max): 83.40s

Response Time (total): 231.84s

Extra formatting: 4 Wrong answer: 2

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#42 Claude Opus 4.6

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

Run history

Tested on Score Reliability Tests Correct Total Cost Compare
2026-06-04 13:45 New test added 7.0 10.0 $2.053 Compare
2026-05-22 00:17 Suite changed 7.2 10.0 $1.896 Compare
2026-04-11 01:44 First recorded run 7.6 N/A $1.446 Current run

Run comparison

RunScoreConsistencyReliabilityTests CorrectFlaky testsTotal Output TokensTotal Input TokensTotal CostResponse Time (avg)
2026-04-11 01:44 · First recorded run7.69.1N/A12/18248,7670$1.44621.08s
2026-06-04 13:45 · New test added7.08.810.012/21371,44653,227$2.05325.89s
Difference+0.6+0.30-1-22679-53227-$0.607-4816ms

These two runs used different benchmark suites, so the deltas reflect both model changes and suite changes.

Charts

Choose the first model, then click a second model to open a side-by-side page.

Total Output Tokens

Score vs Total Output Tokens

Quick Compare

Claude Opus 4.6mediumvsClaude Opus 4.8lowClaude Opus 4.6mediumvsQwen3.5-122B-A10BmediumClaude Opus 4.6mediumvsStep 3.7 FlashlowClaude Opus 4.6mediumvsKimi K2.6mediumFree AvailableClaude Opus 4.6mediumvsMiniMax M3mediumClaude Opus 4.6mediumvsGemini 3.5 FlashhighClaude Opus 4.6mediumvsGemini 3 Flash PreviewmediumClaude Opus 4.6mediumvsNemotron 3 Ultra 550b A55bmediumFree AvailableClaude Opus 4.6mediumvsGPT-5.5low

Category Breakdown

Category Score Consistency Tests Correct
Anti-AI Tricks 6.4 5.8
Coding 10.0 10.0
Combined 10.0 10.0
Data parsing and extraction 10.0 10.0
Domain specific 3.0 10.0
General Intelligence 10.0 10.0
Instructions following 10.0 10.0
Puzzle Solving 7.7 10.0
Tool Calling 10.0 10.0

Compared models