Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Anthropic: Claude Opus 4.7 vs Anthropic: Claude Opus 4.7

Last updated at: 2026-05-10

Metric Claude Opus 4.7 Claude Opus 4.7 medium Release: 2026-04-16 Claude Opus 4.7 Claude Opus 4.7 none Release: 2026-04-16
Score 8.9 8.9
Rank #3 #5
Reliability 10.0 10.0
Consistency 10.0 10.0
Tests Correct
Attempt pass rate 84.2% 84.2%
Flaky tests 0 0
Total Runs 57 57
Cost per result 2.802 3.164
Total Cost $0.449 $0.507
Input Price $5.000 / 1M $5.000 / 1M
Output Price $25.000 / 1M $25.000 / 1M
Output Tokens 5,399 6,329
Reasoning Tokens 1,341 0
Response Time (avg) 3.46s 3.04s
Response Time (max) 21.45s 18.27s
Response Time (total) 62.29s 57.79s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Claude Opus 4.7 8.3 10.0 75.0% 0 1.85s 348 0
Claude Opus 4.7 8.3 10.0 75.0% 0 2.12s 522 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Claude Opus 4.7 10.0 10.0 100.0% 0 6.41s 1,141 257
Claude Opus 4.7 10.0 10.0 100.0% 0 2.84s 494 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Claude Opus 4.7 10.0 10.0 100.0% 0 21.45s 2,369 1,084
Claude Opus 4.7 9.5 10.0 100.0% 0 18.27s 3,504 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Claude Opus 4.7 10.0 10.0 100.0% 0 2.37s 324 0
Claude Opus 4.7 10.0 10.0 100.0% 0 2.15s 324 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Claude Opus 4.7 7.7 10.0 66.7% 0 1.17s 51 0
Claude Opus 4.7 7.7 10.0 66.7% 0 1.19s 78 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Claude Opus 4.7 10.0 10.0 100.0% 0 2.87s 256 0
Claude Opus 4.7 10.0 10.0 100.0% 0 3.47s 257 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Claude Opus 4.7 10.0 10.0 100.0% 0 1.57s 114 0
Claude Opus 4.7 10.0 10.0 100.0% 0 1.46s 114 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Claude Opus 4.7 10.0 10.0 100.0% 0 2.51s 399 0
Claude Opus 4.7 10.0 10.0 100.0% 0 2.58s 661 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Claude Opus 4.7 10.0 10.0 100.0% 0 4.17s 373 0
Claude Opus 4.7 10.0 10.0 100.0% 0 4.74s 372 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Claude Opus 4.7 3.0 10.0 0.0% 0 2.25s 24 0
Claude Opus 4.7 3.0 10.0 0.0% 0 1.46s 3 0

Quick Compare

Switch Comparison Pair