Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Gemini 3.1 Flash Lite Preview (medium) vs Mercury 2.5 Preview (medium)

The average score is effectively tied at 7.4 vs 7.5. Mercury 2.5 Preview (medium) has the lower benchmark cost at $0.024 vs $0.117. Mercury 2.5 Preview (medium) is faster at 3.58s vs 4.59s, with pass rates of 63.6% vs 69.7%.

Last updated at: 2026-09-02

Rank
#94
Total Output Tokens
57,778
Response Time (avg)
4.59s
Total Cost
$0.117
Rank
#91
Total Output Tokens
127,034
Response Time (avg)
3.58s
Total Cost
$0.024
Recommended model Mercury 2.5 Preview (medium)

It has the best score here (7.5), while costing about 4.9x less than Gemini 3.1 Flash Lite Preview (medium).

Detailed comparison

Metric Gemini 3.1 Flash Lite Preview Gemini 3.1 Flash Lite Preview medium Release: 2026-03-03 Mercury 2.5 Preview Mercury 2.5 Preview medium Release: 2026-09-02
Score 7.4 7.5
Rank #94 #91
Reliability 10.0 10.0
Consistency 9.9 9.6
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 63.6% 69.7%
Flaky tests 0 1
Total Runs 66 66
Cost per result 0.829 0.158
Total Cost $0.117 $0.024
Input Price $0.250 / 1M $0.040 / 1M
Output Price $1.500 / 1M $0.150 / 1M
Total Input Tokens 117,493 112,713
Output Tokens 10,589 5,436
Reasoning Tokens 47,189 121,598
Response Time (avg) 4.59s 3.58s
Response Time (max) 18.34s 17.84s
Response Time (total) 101.04s 78.66s
Parameters ~150B total (~10B active) ~100B
Availability Closed Closed

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#94 Gemini 3.1 Flash Lite Preview

medium
Cost
$0.003
Time
5.2s
Tokens
1,944 tok

#91 Mercury 2.5 Preview

medium
Cost
$0.001
Time
2.7s
Tokens
2,241 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 3.1 Flash Lite Preview 5.5 10.0 33.3% 0 4.09s 8,126 461 8,597
Mercury 2.5 Preview 7.8 10.0 66.7% 0 3.86s 7,839 552 22,126

Quick Compare

Switch Comparison Pair

Gemini 3.1 Flash Lite PreviewmediumvsQwen3.7 MaxnoneMercury 2.5 PreviewmediumvsGPT 5.3 ChatnoneMercury 2.5 PreviewmediumvsGPT-5.6 TerralowMercury 2.5 PreviewmediumvsQwen3.7 MaxnoneGemini 3.1 Flash Lite PreviewmediumvsGPT 5.3 ChatnoneGemini 3.1 Flash Lite PreviewmediumvsGPT-5.6 TerralowGemini 3.1 Flash Lite PreviewmediumvsQwen3.8 2.4T A95BhighGemini 3.1 Flash Lite PreviewmediumvsGrok 4.6lowMercury 2.5 PreviewmediumvsQwen3.8 2.4T A95BhighClaude Opus 5nonevsMercury 2.5 PreviewmediumMercury 2.5 PreviewmediumvsSolar Pro 4xhighMercury 2.5 PreviewmediumvsGrok 4.6low