Navigate
Advertise here

Claude Opus 4.8 vs Gemma 4 31B (medium)

The average score is effectively tied at 6.9 vs 6.9. Gemma 4 31B (medium) has the lower benchmark cost at $0.144 vs $2.334. Claude Opus 4.8 is faster at 7.54s vs 78.76s, with pass rates of 60.9% vs 66.7%.

Last updated at: 2026-11-13

Compared models

Rank
#239
Total Output Tokens
24,343
Response Time (avg)
7.54s
Total Cost
$2.334
Rank
#236
Total Output Tokens
277,315
Response Time (avg)
78.76s
Total Cost
$0.144
Recommended model Gemma 4 31B (medium)

It has the best score here (6.9), while costing about 16.3x less than Claude Opus 4.8.

Detailed comparison

Metric Claude Opus 4.8 Claude Opus 4.8 none Release: 2026-05-28 Gemma 4 31B Gemma 4 31B medium Release: 2026-04-02 Free Available
Score 6.9 6.9
Rank #239 #236
Reliability 10.0 10.0
Consistency 9.3 8.7
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 60.9% 66.7%
Flaky tests 2 3
Total Runs 69 69
Cost per result 17.953 1.195
Total Cost $2.334 $0.144
Input Price $5.000 / 1M $0.090 / 1M
Output Price $25.000 / 1M $0.340 / 1M
Cache Read Price $0.500 / 1M $0.050 / 1M
Cache Write Price $6.250 / 1M N/A
Total Input Tokens 345,059 251,164
Output Tokens 24,343 36,112
Reasoning Tokens 0 241,203
Response Time (avg) 7.54s 78.76s
Response Time (max) 65.07s 437.40s
Response Time (total) 173.31s 1653.96s
Parameters ~5T total (~500B active) 30.7B
Availability Closed Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#239 Claude Opus 4.8

none
Cost
$0.053
Time
22.0s
Tokens
2,253 tok

#236 Gemma 4 31B

medium
Cost
$0.002
Time
45.7s
Tokens
2,696 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Opus 4.8 5.5 10.0 33.3% 0 3.29s 10,590 1,332 0
Gemma 4 31B 4.3 5.8 22.2% 1 219.76s 5,568 11,098 33,212

Switch Comparison Pair