Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Claude Sonnet 4.6 (medium) vs Gemini 3.5 Flash Lite (medium)

The average score is effectively tied at 7.8 vs 7.8. Gemini 3.5 Flash Lite (medium) has the lower benchmark cost at $0.272 vs $2.126. Gemini 3.5 Flash Lite (medium) is faster at 5.12s vs 28.08s, with pass rates of 65.2% vs 78.8%.

Last updated at: 2026-08-15

Rank
#67
Total Output Tokens
120,427
Response Time (avg)
28.08s
Total Cost
$2.126
Rank
#64
Total Output Tokens
96,235
Response Time (avg)
5.12s
Total Cost
$0.272
Recommended model Gemini 3.5 Flash Lite (medium)

It has the best score here (7.8), while costing about 7.8x less than Claude Sonnet 4.6 (medium).

Detailed comparison

Metric Claude Sonnet 4.6 Claude Sonnet 4.6 medium Release: 2026-02-17 Gemini 3.5 Flash Lite Gemini 3.5 Flash Lite medium Release: 2026-07-21
Score 7.8 7.8
Rank #67 #64
Reliability 10.0 10.0
Consistency 9.5 7.8
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 65.2% 78.8%
Flaky tests 1 6
Total Runs 66 66
Cost per result 15.182 1.942
Total Cost $2.126 $0.272
Input Price $3.000 / 1M $0.300 / 1M
Output Price $15.000 / 1M $2.500 / 1M
Total Input Tokens 106,316 103,916
Output Tokens 79,338 8,892
Reasoning Tokens 41,089 87,343
Response Time (avg) 28.08s 5.12s
Response Time (max) 140.96s 26.41s
Response Time (total) 421.15s 112.73s
Parameters ~1T total (~100B active) ~150B total (~10B active)
Availability Closed Closed

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#67 Claude Sonnet 4.6

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

#64 Gemini 3.5 Flash Lite

medium
Cost
$0.010
Time
17.8s
Tokens
4,000 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Sonnet 4.6 5.7 6.6 44.4% 1 33.29s 6,995 16,089 3,686
Gemini 3.5 Flash Lite 7.9 9.9 66.7% 0 9.96s 8,122 471 28,930

Quick Compare

Switch Comparison Pair

Gemini 3.5 Flash LitemediumvsQwen3.8 27BlowClaude Sonnet 4.6mediumvsQwen3.8 27BlowGemini 3.5 Flash LitemediumvsGPT-5.2 ChatnoneClaude Sonnet 4.6mediumvsQwen3.7 FlashhighGemini 3.5 Flash LitemediumvsKimi K3maxClaude Opus 4.8lowvsGemini 3.5 Flash LitemediumClaude Sonnet 4.6mediumvsGPT-5.2 ChatnoneGemini 3.5 Flash LitemediumvsQwen3.7 FlashhighClaude Sonnet 4.6mediumvsKimi K3maxClaude Sonnet 4.6mediumvsSeed-2.0-CodelowGemini 3.5 Flash LitemediumvsGPT-5.6 TerrahighSeed-2.0-CodelowvsGemini 3.5 Flash Litemedium