Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

DeepSeek: DeepSeek V4 Flash vs Qwen: Qwen3.7 Max

Last updated at: 2026-06-04

Metric DeepSeek V4 Flash DeepSeek V4 Flash high Release: 2026-04-24 Qwen3.7 Max Qwen3.7 Max none Release: 2026-05-22
Score 7.7 7.7
Rank #31 #34
Reliability 10.0 10.0
Consistency 8.5 10.0
Tests Correct
Attempt pass rate 74.6% 66.7%
Flaky tests 4 0
Total Runs 63 63
Cost per result 0.299 0.744
Total Cost $0.029 $0.054
Input Price $0.099 / 1M $1.250 / 1M
Output Price $0.197 / 1M $3.750 / 1M
Total Input Tokens 39,745 37,107
Output Tokens 10,310 1,994
Reasoning Tokens 123,501 0
Response Time (avg) 45.85s 1.30s
Response Time (max) 218.13s 3.92s
Response Time (total) 962.79s 27.21s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Flash 8.3 10.0 75.0% 0 28.51s 540 140 7,770
Qwen3.7 Max 6.5 10.0 50.0% 0 1.08s 696 242 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Flash 7.8 10.0 66.7% 0 50.60s 7,279 395 34,862
Qwen3.7 Max 5.5 10.0 33.3% 0 1.35s 7,911 582 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Flash 10.0 10.0 100.0% 0 76.57s 14,016 465 7,347
Qwen3.7 Max 3.0 10.0 0.0% 0 2.17s 9,549 171 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Flash 10.0 10.0 100.0% 0 28.03s 7,290 201 1,179
Qwen3.7 Max 10.0 10.0 100.0% 0 1.35s 7,794 243 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Flash 4.1 4.4 44.5% 2 100.31s 666 27 59,249
Qwen3.7 Max 7.7 10.0 66.7% 0 975ms 789 15 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Flash 6.1 3.1 66.7% 1 25.15s 471 79 632
Qwen3.7 Max 10.0 10.0 100.0% 0 1.04s 522 120 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Flash 10.0 10.0 100.0% 0 15.36s 627 63 1,622
Qwen3.7 Max 10.0 10.0 100.0% 0 943ms 711 72 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Flash 8.2 7.2 88.9% 1 26.11s 594 196 1,767
Qwen3.7 Max 10.0 10.0 100.0% 0 1.13s 714 314 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Flash 10.0 10.0 100.0% 0 74.73s 8,079 228 542
Qwen3.7 Max 10.0 10.0 100.0% 0 3.92s 8,211 222 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Flash 3.0 10.0 0.0% 0 54.46s 183 8,516 8,531
Qwen3.7 Max 3.0 10.0 0.0% 0 856ms 210 13 0

Quick Compare

Switch Comparison Pair

DeepSeek V4 FlashhighvsQwen3.5-27BmediumDeepSeek V4 FlashhighvsGemini 3.5 FlashminimalDeepSeek V4 FlashhighvsQwen3.5-122B-A10BmediumGemini 3.5 FlashminimalvsQwen3.7 MaxnoneGemini 3 PRO PreviewmediumvsQwen3.7 MaxnoneGemma 4 26B A4BmediumFree AvailablevsQwen3.7 MaxnoneDeepSeek V4 FlashhighvsGemini 2.5 FlashmediumDeepSeek V4 FlashhighvsGemma 4 31BmediumFree AvailableQwen3.7 MaxnonevsGrok 4.3mediumDeepSeek V4 FlashhighvsGemini 3 PRO PreviewmediumDeepSeek V4 FlashhighvsQwen3.5 Plus 2026-04-20mediumDeepSeek V4 FlashhighvsQwen3.6 Plusmedium