Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

Anthropic: Claude Opus 4.7 vs Google: Gemma 4 31B

Last updated at: 2026-04-16

Metric Claude Opus 4.7 Claude Opus 4.7 none Release: 2026-04-16 Gemma 4 31B Gemma 4 31B medium Release: 2026-04-02 Free Available
Score 9.2 8.3
Rank #4 #14
Consistency 10.0 9.2
Tests Correct
Attempt pass rate 88.9% 79.6%
Flaky tests 0 2
Total Runs 54 54
Cost per result 3.155 0.136
Total Cost $0.505 $0.018
Input Price $5.000 / 1M $0.130 / 1M
Output Price $25.000 / 1M $0.380 / 1M
Output Tokens 6,326 12,734
Reasoning Tokens 0 27,950
Response Time (avg) 3.13s 24.88s
Response Time (max) 18.27s 70.97s
Response Time (total) 56.33s 398.13s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Claude Opus 4.7 8.3 10.0 75.0% 0 2.12s 522 0
Gemma 4 31B 10.0 10.0 100.0% 0 12.89s 962 2,046
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Claude Opus 4.7 10.0 10.0 100.0% 0 2.84s 494 0
Gemma 4 31B 4.7 1.6 66.7% 1 70.97s 3,166 5,449
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Claude Opus 4.7 9.5 10.0 100.0% 0 18.27s 3,504 0
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Claude Opus 4.7 10.0 10.0 100.0% 0 2.15s 324 0
Gemma 4 31B 10.0 10.0 100.0% 0 21.11s 1,822 2,951
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Claude Opus 4.7 7.7 10.0 66.7% 0 1.19s 78 0
Gemma 4 31B 7.7 10.0 66.7% 0 38.48s 4,349 8,985
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Claude Opus 4.7 10.0 10.0 100.0% 0 3.47s 257 0
Gemma 4 31B 10.0 10.0 100.0% 0 9.57s 105 888
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Claude Opus 4.7 10.0 10.0 100.0% 0 1.46s 114 0
Gemma 4 31B 10.0 10.0 100.0% 0 12.76s 533 2,035
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Claude Opus 4.7 10.0 10.0 100.0% 0 2.58s 661 0
Gemma 4 31B 8.8 7.9 88.9% 1 27.63s 1,797 5,596
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Claude Opus 4.7 10.0 10.0 100.0% 0 4.74s 372 0
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0

Quick Compare

Switch Comparison Pair