Navigate
Advertise here

Gemini 3 Flash Preview vs Mercury 2 (medium)

Mercury 2 (medium) leads on average score with 6.6 vs 6.4. Mercury 2 (medium) has the lower benchmark cost at $0.121 vs $0.155. Mercury 2 (medium) is faster at 4.40s vs 6.05s, with pass rates of 62.3% vs 53.6%.

Last updated at: 2026-11-17

Compared models

Rank
#295
Total Output Tokens
12,432
Response Time (avg)
6.05s
Total Cost
$0.155
Rank
#279
Total Output Tokens
96,943
Response Time (avg)
4.40s
Total Cost
$0.121
Recommended model Mercury 2 (medium)

It has the strongest score in this comparison (6.6) and the best overall balance of cost and response time across 2 models.

Detailed comparison

Metric Gemini 3 Flash Preview Gemini 3 Flash Preview none Release: 2025-12-17 Mercury 2 Mercury 2 medium Release: 2026-02-24
Score 6.4 6.6
Rank #295 #279
Reliability 10.0 10.0
Consistency 8.9 8.1
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 62.3% 53.6%
Flaky tests 3 5
Total Runs 69 69
Cost per result 1.187 1.201
Total Cost $0.155 $0.121
Input Price $0.500 / 1M $0.250 / 1M
Output Price $3.000 / 1M $0.750 / 1M
Cache Read Price $0.050 / 1M $0.025 / 1M
Cache Write Price $0.084 / 1M N/A
Total Input Tokens 233,893 189,300
Output Tokens 12,432 10,854
Reasoning Tokens 0 86,089
Response Time (avg) 6.05s 4.40s
Response Time (max) 57.84s 34.92s
Response Time (total) 102.89s 96.81s
Parameters ~500B total (~20B active) ~100B
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#295 Gemini 3 Flash Preview

none
Cost
$0.003
Time
5.6s
Tokens
981 tok

#279 Mercury 2

medium
Cost
$0.002
Time
2.1s
Tokens
1,702 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 3 Flash Preview 5.5 10.0 33.3% 0 1.80s 8,122 453 0
Mercury 2 8.2 7.7 77.8% 1 2.04s 7,065 296 11,328

Switch Comparison Pair