Navigate
AI BENCHY
Advertise here

Gemini 3.1 Flash Lite Preview vs Mercury 2.5 Preview (high)

Mercury 2.5 Preview (high) leads on average score with 6.6 vs 6.4. Mercury 2.5 Preview (high) has the lower benchmark cost at $0.030 vs $0.052. Gemini 3.1 Flash Lite Preview is faster at 1.56s vs 4.01s, with pass rates of 57.6% vs 65.2%.

Last updated at: 2026-09-02

Rank
#162
Total Output Tokens
14,161
Response Time (avg)
1.56s
Total Cost
$0.052
Rank
#157
Total Output Tokens
163,505
Response Time (avg)
4.01s
Total Cost
$0.030
Recommended model Gemini 3.1 Flash Lite Preview

Its score stays close to the best score here (6.4 vs 6.6), while responding about 2.6x faster than Mercury 2.5 Preview (high).

Detailed comparison

Metric Gemini 3.1 Flash Lite Preview Gemini 3.1 Flash Lite Preview none Release: 2026-03-03 Mercury 2.5 Preview Mercury 2.5 Preview high Release: 2026-09-02
Score 6.4 6.6
Rank #162 #157
Reliability 10.0 10.0
Consistency 9.7 8.2
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 57.6% 65.2%
Flaky tests 1 5
Total Runs 66 66
Cost per result 0.430 0.243
Total Cost $0.052 $0.030
Input Price $0.250 / 1M $0.040 / 1M
Output Price $1.500 / 1M $0.150 / 1M
Total Input Tokens 120,955 115,759
Output Tokens 14,161 2,562
Reasoning Tokens 0 160,943
Response Time (avg) 1.56s 4.01s
Response Time (max) 9.27s 17.71s
Response Time (total) 34.32s 88.25s
Parameters ~150B total (~10B active) ~100B
Availability Closed Closed

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#162 Gemini 3.1 Flash Lite Preview

none
Cost
$0.003
Time
4.7s
Tokens
1,827 tok

#157 Mercury 2.5 Preview

high
Cost
$0.001
Time
4.5s
Tokens
3,851 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 3.1 Flash Lite Preview 5.5 10.0 33.3% 0 967ms 8,128 670 0
Mercury 2.5 Preview 6.7 7.8 55.6% 1 6.13s 7,751 485 42,569

Quick Compare

Switch Comparison Pair

Mercury 2.5 PreviewhighvsQwen3.6 35B A3BmediumDots 3 Note PreviewlowFree AvailablevsGemini 3.1 Flash Lite PreviewnoneDots 3 Note PreviewhighFree AvailablevsGemini 3.1 Flash Lite PreviewnoneGemini 3.1 Flash LitelowvsMercury 2.5 PreviewhighMercury 2.5 PreviewhighvsQwen3.5 Plus 2026-02-15noneMercury 2.5 PreviewhighvsInkling SmallmediumGemini 3.1 Flash Lite PreviewlowvsMercury 2.5 PreviewhighMercury 2.5 PreviewhighvsQwen3.5-27BnoneGemini 3.5 Flash LitelowvsMercury 2.5 PreviewhighGemini 3.1 Flash Lite PreviewnonevsMiMo-V2.5mediumMercury 2.5 PreviewhighvsQwen3.6 27BmediumMercury 2.5 PreviewhighvsLaguna XS 2.1mediumFree Available