Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Qwen: Qwen3.7 Max vs StepFun: Step 3.7 Flash

Last updated at: 2026-05-29

Metric Qwen3.7 Max Qwen3.7 Max none Release: 2026-05-22 Step 3.7 Flash Step 3.7 Flash medium Release: 2026-05-29
Score 7.9 7.9
Rank #29 #32
Reliability 10.0 9.9
Consistency 10.0 9.2
Tests Correct
Attempt pass rate 70.0% 71.7%
Flaky tests 0 2
Total Runs 60 58
Cost per result 0.719 2.663
Total Cost $0.101 $0.347
Input Price $1.250 / 1M $0.200 / 1M
Output Price $3.750 / 1M $1.150 / 1M
Output Tokens 1,988 294,481
Reasoning Tokens 0 0
Response Time (avg) 1.30s 18.32s
Response Time (max) 3.92s 113.98s
Response Time (total) 25.95s 366.45s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.7 Max 6.5 10.0 50.0% 0 1.08s 242 0
Step 3.7 Flash 8.7 7.9 91.7% 1 9.65s 32,185 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.7 Max 6.8 10.0 50.0% 0 1.39s 576 0
Step 3.7 Flash 8.2 6.7 83.3% 1 10.64s 19,320 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.7 Max 3.0 10.0 0.0% 0 2.17s 171 0
Step 3.7 Flash 10.0 10.0 100.0% 0 9.06s 7,106 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.7 Max 10.0 10.0 100.0% 0 1.35s 243 0
Step 3.7 Flash 10.0 10.0 100.0% 0 2.75s 3,020 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.7 Max 7.7 10.0 66.7% 0 975ms 15 0
Step 3.7 Flash 7.7 10.0 66.7% 0 48.27s 70,347 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.7 Max 10.0 10.0 100.0% 0 1.04s 120 0
Step 3.7 Flash 4.0 10.0 0.0% 0 6.85s 3,987 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.7 Max 10.0 10.0 100.0% 0 943ms 72 0
Step 3.7 Flash 9.8 10.0 100.0% 0 1.83s 2,166 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.7 Max 10.0 10.0 100.0% 0 1.13s 314 0
Step 3.7 Flash 5.7 9.9 33.3% 0 6.19s 15,071 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.7 Max 10.0 10.0 100.0% 0 3.92s 222 0
Step 3.7 Flash 10.0 10.0 100.0% 0 4.16s 2,115 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.7 Max 3.0 10.0 0.0% 0 856ms 13 0
Step 3.7 Flash 3.0 10.0 0.0% 0 113.98s 139,164 0

Quick Compare

Switch Comparison Pair

GPT-5.4mediumvsQwen3.7 MaxnoneQwen3.7 MaxnonevsGLM 5 TurbomediumGPT-5.2 ChatnonevsStep 3.7 FlashmediumGemini 3.5 FlashminimalvsQwen3.7 MaxnoneGemini 3.5 FlashminimalvsStep 3.7 FlashmediumGemma 4 26B A4BmediumFree AvailablevsQwen3.7 MaxnoneGemma 4 31BmediumFree AvailablevsQwen3.7 MaxnoneQwen3.7 MaxnonevsGrok 4.3mediumSeed-2.0-LitemediumvsQwen3.7 MaxnoneGemini 3.1 Flash Lite PreviewmediumvsQwen3.7 MaxnoneGemini 3.1 Flash LitemediumvsQwen3.7 MaxnoneGemini 2.5 FlashmediumvsQwen3.7 Maxnone