Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

DeepSeek: DeepSeek V4 Pro vs Qwen: Qwen3.6 Flash

Summary

DeepSeek V4 Pro vs Qwen3.6 Flash benchmark comparison: Qwen3.6 Flash leads on average score with 7.5 vs 7.2. DeepSeek V4 Pro has the lower benchmark cost at $0.034 vs $0.288. DeepSeek V4 Pro is faster at 6.41s vs 19.25s, with pass rates of 52.4% vs 71.4%.

Recommended model: DeepSeek V4 Pro - Its score stays close to the best score here (7.2 vs 7.5), while costing about 8.6x less than Qwen3.6 Flash.

Last updated at: 2026-06-18

Metric DeepSeek V4 Pro DeepSeek V4 Pro none Release: 2026-04-24 Qwen3.6 Flash Qwen3.6 Flash medium Release: 2026-04-20
Score 7.2 7.5
Rank #58 #47
Reliability 9.9 10.0
Consistency 8.8 8.1
Tests Correct
Attempt pass rate 52.4% 71.4%
Flaky tests 3 5
Total Runs 63 63
Cost per result 0.333 3.030
Total Cost $0.034 $0.288
Input Price $0.435 / 1M $0.188 / 1M
Output Price $0.870 / 1M $1.125 / 1M
Total Input Tokens 53,558 42,362
Output Tokens 11,424 2,995
Reasoning Tokens 0 245,358
Response Time (avg) 6.41s 19.25s
Response Time (max) 30.09s 122.87s
Response Time (total) 134.66s 404.20s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#58 DeepSeek V4 Pro

none
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

#47 Qwen3.6 Flash

medium
Invalid SVG
Cost
$0.008
Time
29.9s
Tokens
6,784 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 3.2 6.1 16.7% 2 4.02s 540 1,168 0
Qwen3.6 Flash 10.0 10.0 100.0% 0 6.10s 672 624 14,024
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 5.6 10.0 33.3% 0 13.38s 7,275 5,500 0
Qwen3.6 Flash 5.0 5.1 44.5% 2 42.85s 7,895 495 67,967
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 9.5 10.0 100.0% 0 23.74s 27,529 2,235 0
Qwen3.6 Flash 10.0 10.0 100.0% 0 20.28s 14,934 483 13,839
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 10.0 10.0 100.0% 0 4.61s 7,568 200 0
Qwen3.6 Flash 10.0 10.0 100.0% 0 9.65s 7,782 270 13,155
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 5.3 10.0 33.3% 0 3.72s 666 24 0
Qwen3.6 Flash 3.5 4.4 33.3% 2 14.65s 771 60 24,409
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 5.0 10.0 0.0% 0 2.05s 471 126 0
Qwen3.6 Flash 4.8 9.9 0.0% 0 9.88s 516 140 5,445
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 6.3 5.8 66.7% 1 4.12s 627 713 0
Qwen3.6 Flash 10.0 10.0 100.0% 0 6.05s 699 102 7,423
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 10.0 10.0 100.0% 0 3.61s 594 442 0
Qwen3.6 Flash 8.2 7.2 88.9% 1 6.29s 696 460 10,860
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 10.0 10.0 100.0% 0 7.40s 8,105 328 0
Qwen3.6 Flash 10.0 10.0 100.0% 0 4.00s 8,193 335 1,188
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 3.0 10.0 0.0% 0 5.76s 183 688 0
Qwen3.6 Flash 3.0 10.0 0.0% 0 122.87s 204 26 87,048

Quick Compare

Switch Comparison Pair

DeepSeek V4 PrononevsGemma 4 26B A4BmediumFree AvailableGPT-5.3 ChatnonevsQwen3.6 FlashmediumGemini 3 Flash PreviewlowvsQwen3.6 FlashmediumDeepSeek V4 PrononevsStep 3.7 FlashhighDeepSeek V4 PrononevsGLM 5.1mediumDeepSeek V4 ProhighvsQwen3.6 FlashmediumClaude Sonnet 4.6nonevsQwen3.6 FlashmediumDeepSeek V4 PrononevsKimi K2.7 CodemediumDeepSeek V4 PrononevsGrok 4.20mediumDeepSeek V4 PrononevsGemini 3 Flash PreviewlowQwen3.6 FlashmediumvsStep 3.7 FlashlowClaude Opus 4.8nonevsQwen3.6 Flashmedium