Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

DeepSeek: DeepSeek V4 Pro vs Google: Gemini 2.5 Flash

Summary

DeepSeek V4 Pro vs Gemini 2.5 Flash benchmark comparison: Gemini 2.5 Flash leads on average score with 8.2 vs 7.2. DeepSeek V4 Pro has the lower benchmark cost at $0.034 vs $0.379. DeepSeek V4 Pro is faster at 6.41s vs 15.49s, with pass rates of 52.4% vs 69.8%.

Recommended model: DeepSeek V4 Pro - It offers the best overall trade-off: a competitive score (7.2), lower cost than Gemini 2.5 Flash, and balanced response time.

Last updated at: 2026-06-18

Metric DeepSeek V4 Pro DeepSeek V4 Pro none Release: 2026-04-24 Gemini 2.5 Flash Gemini 2.5 Flash medium Release: 2025-06-17
Score 7.2 8.2
Rank #58 #24
Reliability 9.9 10.0
Consistency 8.8 9.6
Tests Correct
Attempt pass rate 52.4% 69.8%
Flaky tests 3 1
Total Runs 63 63
Cost per result 0.333 2.701
Total Cost $0.034 $0.379
Input Price $0.435 / 1M $0.300 / 1M
Output Price $0.870 / 1M $2.500 / 1M
Total Input Tokens 53,558 34,476
Output Tokens 11,424 1,930
Reasoning Tokens 0 145,145
Response Time (avg) 6.41s 15.49s
Response Time (max) 30.09s 95.48s
Response Time (total) 134.66s 325.39s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#58 DeepSeek V4 Pro

none
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

#24 Gemini 2.5 Flash

medium
Invalid SVG
Cost
$0.000
Time
274.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 3.2 6.1 16.7% 2 4.02s 540 1,168 0
Gemini 2.5 Flash 8.4 10.0 75.0% 0 6.30s 492 255 10,233
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 5.6 10.0 33.3% 0 13.38s 7,275 5,500 0
Gemini 2.5 Flash 7.8 10.0 66.7% 0 41.01s 6,669 543 32,303
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 9.5 10.0 100.0% 0 23.74s 27,529 2,235 0
Gemini 2.5 Flash 10.0 10.0 100.0% 0 28.44s 12,522 303 11,922
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 10.0 10.0 100.0% 0 4.61s 7,568 200 0
Gemini 2.5 Flash 10.0 10.0 100.0% 0 4.06s 7,257 279 2,325
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 5.3 10.0 33.3% 0 3.72s 666 24 0
Gemini 2.5 Flash 5.9 7.2 55.6% 1 37.34s 633 18 80,702
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 5.0 10.0 0.0% 0 2.05s 471 126 0
Gemini 2.5 Flash 4.8 10.0 0.0% 0 4.86s 486 92 1,899
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 6.3 5.8 66.7% 1 4.12s 627 713 0
Gemini 2.5 Flash 9.8 10.0 100.0% 0 2.62s 615 69 1,203
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 10.0 10.0 100.0% 0 3.61s 594 442 0
Gemini 2.5 Flash 7.7 10.0 66.7% 0 3.18s 558 126 2,499
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 10.0 10.0 100.0% 0 7.40s 8,105 328 0
Gemini 2.5 Flash 10.0 10.0 100.0% 0 6.20s 5,088 234 1,140
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 3.0 10.0 0.0% 0 5.76s 183 688 0
Gemini 2.5 Flash 3.0 10.0 0.0% 0 2.76s 156 11 919

Quick Compare

Switch Comparison Pair

DeepSeek V4 PrononevsGemma 4 26B A4BmediumFree AvailableDeepSeek V4 FlashhighvsGemini 2.5 FlashmediumDeepSeek V4 PrononevsStep 3.7 FlashhighDeepSeek V4 PrononevsGLM 5.1mediumDeepSeek V4 PrononevsKimi K2.7 CodemediumDeepSeek V4 PrononevsGrok 4.20mediumDeepSeek V4 PrononevsGemini 3 Flash PreviewlowDeepSeek V4 PrononevsMiMo-V2.5-PromediumSeed-2.0-MinimediumvsDeepSeek V4 PrononeGemini 2.5 FlashmediumvsGPT-5.2 ChatnoneDeepSeek V4 PrononevsQwen3.6 FlashmediumDeepSeek V4 PrononevsGPT-5.4 Nanomedium