Navigate
Advertise here

DeepSeek V4.1 Flash (max) vs Gemini 2.5 Flash (medium)

DeepSeek V4.1 Flash (max) leads on average score with 8.3 vs 8.2. DeepSeek V4.1 Flash (max) has the lower benchmark cost at $0.537 vs $0.644. Gemini 2.5 Flash (medium) is faster at 21.14s vs 61.35s, with pass rates of 68.2% vs 71.2%.

Last updated at: 2026-09-10

Compared models

Rank
#62
Total Output Tokens
871,126
Response Time (avg)
61.35s
Total Cost
$0.537
Rank
#65
Total Output Tokens
241,365
Response Time (avg)
21.14s
Total Cost
$0.644
Recommended model Gemini 2.5 Flash (medium)

Its score stays close to the best score here (8.2 vs 8.3), while responding about 2.9x faster than DeepSeek V4.1 Flash (max).

Detailed comparison

Metric DeepSeek V4.1 Flash DeepSeek V4.1 Flash max Release: 2026-09-10 Gemini 2.5 Flash Gemini 2.5 Flash medium Release: 2025-06-17
Score 8.3 8.2
Rank #62 #65
Reliability 9.1 10.0
Consistency 9.2 9.6
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 68.2% 71.2%
Flaky tests 2 1
Total Runs 66 66
Cost per result 3.829 4.288
Total Cost $0.537 $0.644
Input Price $0.150 / 1M $0.300 / 1M
Output Price $0.600 / 1M $2.500 / 1M
Total Input Tokens 89,024 132,507
Output Tokens 5,558 12,739
Reasoning Tokens 865,568 228,626
Response Time (avg) 61.35s 21.14s
Response Time (max) 335.08s 140.50s
Response Time (total) 1349.61s 465.10s
Parameters 748B total (16B active) ~350B total (~20B active)
Availability Open source Closed

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#62 DeepSeek V4.1 Flash

max
Cost
$0.066
Time
211.0s
Tokens
54,712 tok

#65 Gemini 2.5 Flash

medium
No output was saved. The original provider response or failure reason is unavailable.
Cost
$0.000
Time
274.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4.1 Flash 10.0 10.0 100.0% 0 62.50s 7,509 373 132,357
Gemini 2.5 Flash 7.8 10.0 66.7% 0 41.01s 6,669 543 32,303

Quick Compare

Switch Comparison Pair