Navigate
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Gemini 3.1 Flash Lite Preview (medium) vs Mercury 2.5 Preview (medium)

Gemini 3.1 Flash Lite Preview (medium) leads on average score with 7.0 vs 6.8. Mercury 2.5 Preview (medium) has the lower benchmark cost at $0.039 vs $0.158. Mercury 2.5 Preview (medium) is faster at 6.66s vs 6.78s, with pass rates of 60.9% vs 66.7%.

Last updated at: 2026-10-16

Compared models

Rank
#182
Total Output Tokens
59,534
Response Time (avg)
6.78s
Total Cost
$0.158
Rank
#199
Total Output Tokens
150,107
Response Time (avg)
6.66s
Total Cost
$0.039
Recommended model Mercury 2.5 Preview (medium)

Its score stays close to the best score here (6.8 vs 7.0), while costing about 4.1x less than Gemini 3.1 Flash Lite Preview (medium).

Detailed comparison

Metric Gemini 3.1 Flash Lite Preview Gemini 3.1 Flash Lite Preview medium Release: 2026-03-03 Mercury 2.5 Preview Mercury 2.5 Preview medium Release: 2026-09-02
Score 7.0 6.8
Rank #182 #199
Reliability 10.0 10.0
Consistency 9.9 9.6
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 60.9% 66.7%
Flaky tests 0 1
Total Runs 69 69
Cost per result 1.124 0.244
Total Cost $0.158 $0.039
Input Price $0.250 / 1M $0.040 / 1M
Output Price $1.500 / 1M $0.150 / 1M
Cache Read Price $0.025 / 1M N/A
Cache Write Price $0.084 / 1M N/A
Total Input Tokens 272,221 397,291
Output Tokens 12,345 6,355
Reasoning Tokens 47,189 143,752
Response Time (avg) 6.78s 6.66s
Response Time (max) 54.91s 74.63s
Response Time (total) 155.96s 153.29s
Parameters ~150B total (~10B active) ~100B
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#182 Gemini 3.1 Flash Lite Preview

medium
Cost
$0.003
Time
5.2s
Tokens
1,944 tok

#199 Mercury 2.5 Preview

medium
Cost
$0.001
Time
2.7s
Tokens
2,241 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 3.1 Flash Lite Preview 5.5 10.0 33.3% 0 4.09s 8,126 461 8,597
Mercury 2.5 Preview 7.8 10.0 66.7% 0 3.86s 7,839 552 22,126

Switch Comparison Pair