Navigate
Advertise here

Claude Sonnet 5 vs Gemini 3.1 Flash Lite (minimal)

The average score is effectively tied at 5.9 vs 5.9. Gemini 3.1 Flash Lite (minimal) has the lower benchmark cost at $0.080 vs $1.095. Gemini 3.1 Flash Lite (minimal) is faster at 3.95s vs 8.60s, with pass rates of 40.6% vs 49.3%.

Last updated at: 2026-11-17

Compared models

Rank
#351
Total Output Tokens
30,777
Response Time (avg)
8.60s
Total Cost
$1.095
Rank
#347
Total Output Tokens
12,875
Response Time (avg)
3.95s
Total Cost
$0.080
Recommended model Gemini 3.1 Flash Lite (minimal)

It has the best score here (5.9), while costing about 13.9x less than Claude Sonnet 5.

Detailed comparison

Metric Claude Sonnet 5 Claude Sonnet 5 none Release: 2026-06-30 Gemini 3.1 Flash Lite Gemini 3.1 Flash Lite minimal Release: 2026-05-08
Score 5.9 5.9
Rank #351 #347
Reliability 10.0 10.0
Consistency 8.4 8.9
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 40.6% 49.3%
Flaky tests 5 3
Total Runs 69 69
Cost per result 15.642 0.791
Total Cost $1.095 $0.080
Input Price $2.000 / 1M $0.250 / 1M
Output Price $10.000 / 1M $1.500 / 1M
Cache Read Price $0.200 / 1M $0.025 / 1M
Cache Write Price $2.500 / 1M $0.084 / 1M
Total Input Tokens 393,560 238,785
Output Tokens 30,466 12,875
Reasoning Tokens 311 0
Response Time (avg) 8.60s 3.95s
Response Time (max) 64.73s 50.03s
Response Time (total) 197.73s 90.76s
Parameters ~1T total (~100B active) ~150B total (~10B active)
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#351 Claude Sonnet 5

none
Cost
$0.061
Time
53.7s
Tokens
6,172 tok

#347 Gemini 3.1 Flash Lite

minimal
Cost
$0.001
Time
3.7s
Tokens
635 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Sonnet 5 4.6 7.9 22.2% 1 3.67s 10,590 1,864 0
Gemini 3.1 Flash Lite 5.5 10.0 33.3% 0 831ms 8,126 666 0

Switch Comparison Pair