Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Anthropic: Claude Opus 4.6 vs Google: Gemini 2.5 Flash

Summary

Claude Opus 4.6 vs Gemini 2.5 Flash benchmark comparison: Gemini 2.5 Flash leads on average score with 8.2 vs 7.7. Gemini 2.5 Flash has the lower benchmark cost at $0.379 vs $2.053. Gemini 2.5 Flash is faster at 15.49s vs 25.89s, with pass rates of 61.9% vs 69.8%.

Recommended model: Gemini 2.5 Flash - It has the best score here (8.2), while costing about 5.4x less than Claude Opus 4.6.

Last updated at: 2026-07-02

Metric Claude Opus 4.6 Claude Opus 4.6 medium Release: 2026-02-05 Gemini 2.5 Flash Gemini 2.5 Flash medium Release: 2025-06-17
Score 7.7 8.2
Rank #40 #24
Reliability 10.0 10.0
Consistency 8.8 9.6
Tests Correct
Attempt pass rate 61.9% 69.8%
Flaky tests 3 1
Total Runs 63 63
Cost per result 17.103 2.701
Total Cost $2.053 $0.379
Input Price $5.000 / 1M $0.300 / 1M
Output Price $25.000 / 1M $2.500 / 1M
Total Input Tokens 53,227 34,476
Output Tokens 47,446 1,930
Reasoning Tokens 24,000 145,145
Response Time (avg) 25.89s 15.49s
Response Time (max) 83.40s 95.48s
Response Time (total) 362.49s 325.39s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#40 Claude Opus 4.6

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

#24 Gemini 2.5 Flash

medium
Invalid SVG
Cost
$0.000
Time
274.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Opus 4.6 6.4 5.8 66.7% 2 7.45s 840 986 1,071
Gemini 2.5 Flash 8.4 10.0 75.0% 0 6.30s 492 255 10,233
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Opus 4.6 5.7 7.1 44.4% 1 30.10s 8,522 13,057 4,121
Gemini 2.5 Flash 7.8 10.0 66.7% 0 41.01s 6,669 543 32,303
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Opus 4.6 10.0 10.0 100.0% 0 76.66s 20,685 8,178 5,194
Gemini 2.5 Flash 10.0 10.0 100.0% 0 28.44s 12,522 303 11,922
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Opus 4.6 10.0 10.0 100.0% 0 7.37s 8,676 691 757
Gemini 2.5 Flash 10.0 10.0 100.0% 0 4.06s 7,257 279 2,325
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Opus 4.6 3.0 10.0 0.0% 0 83.40s 674 14,642 8,687
Gemini 2.5 Flash 5.9 7.2 55.6% 1 37.34s 633 18 80,702
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Opus 4.6 10.0 10.0 100.0% 0 5.04s 564 188 292
Gemini 2.5 Flash 4.8 10.0 0.0% 0 4.86s 486 92 1,899
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Opus 4.6 10.0 10.0 100.0% 0 2.43s 792 266 467
Gemini 2.5 Flash 9.8 10.0 100.0% 0 2.62s 615 69 1,203
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Opus 4.6 7.7 10.0 66.7% 0 4.71s 816 532 630
Gemini 2.5 Flash 7.7 10.0 66.7% 0 3.18s 558 126 2,499
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Opus 4.6 10.0 10.0 100.0% 0 9.73s 11,454 861 329
Gemini 2.5 Flash 10.0 10.0 100.0% 0 6.20s 5,088 234 1,140
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Opus 4.6 3.0 10.0 0.0% 0 63.24s 204 8,045 2,452
Gemini 2.5 Flash 3.0 10.0 0.0% 0 2.76s 156 11 919

Quick Compare

Switch Comparison Pair

Claude Opus 4.6mediumvsStep 3.7 FlashlowDeepSeek V4 FlashhighvsGemini 2.5 FlashmediumClaude Opus 4.6mediumvsDeepSeek V4 ProhighClaude Opus 4.6mediumvsGPT-5.3 ChatnoneGemini 2.5 FlashmediumvsGPT-5.2 ChatnoneClaude Opus 4.6mediumvsGemini 3 Flash PreviewlowClaude Opus 4.8lowvsGemini 2.5 FlashmediumClaude Opus 4.6mediumvsDeepSeek V4 PrononeGemini 2.5 FlashmediumvsStep 3.7 FlashlowClaude Opus 4.6mediumvsQwen3.7 PlusnoneClaude Opus 4.6mediumvsDeepSeek V4 FlashhighClaude Opus 4.6mediumvsGLM 5.2none