Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Qwen: Qwen3.5-35B-A3B vs StepFun: Step 3.7 Flash

Last updated at: 2026-05-29

Metric Qwen3.5-35B-A3B Qwen3.5-35B-A3B medium Release: 2026-02-24 Step 3.7 Flash Step 3.7 Flash low Release: 2026-05-29
Score 7.3 7.4
Rank #68 #60
Reliability 10.0 10.0
Consistency 7.5 8.7
Tests Correct
Attempt pass rate 73.3% 68.3%
Flaky tests 6 3
Total Runs 60 60
Cost per result 4.865 2.796
Total Cost $0.536 $0.336
Input Price $0.139 / 1M $0.200 / 1M
Output Price $1.000 / 1M $1.150 / 1M
Output Tokens 31,242 285,209
Reasoning Tokens 330,546 0
Response Time (avg) 69.66s 16.06s
Response Time (max) 409.98s 124.75s
Response Time (total) 1393.17s 321.11s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 21.13s 798 42,652
Step 3.7 Flash 8.7 7.9 91.7% 1 4.02s 10,896 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 6.5 10.0 50.0% 0 244.54s 14,456 88,431
Step 3.7 Flash 10.0 10.0 100.0% 0 9.43s 14,569 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 4.7 1.6 66.7% 1 75.34s 775 12,485
Step 3.7 Flash 10.0 10.0 100.0% 0 7.98s 6,426 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 7.3 5.9 83.3% 1 59.33s 235 19,493
Step 3.7 Flash 7.3 5.8 83.3% 1 2.29s 2,667 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 4.1 4.4 44.5% 2 88.34s 41 46,368
Step 3.7 Flash 5.3 7.2 44.4% 1 43.31s 104,487 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 2.8 1.6 33.3% 1 30.30s 20 3,753
Step 3.7 Flash 3.4 9.3 0.0% 0 7.00s 4,604 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 24.45s 97 17,361
Step 3.7 Flash 9.8 10.0 100.0% 0 1.58s 1,857 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 8.2 7.2 88.9% 1 33.13s 3,592 26,585
Step 3.7 Flash 5.5 9.9 33.3% 0 1.84s 3,564 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 4.65s 309 1,365
Step 3.7 Flash 10.0 10.0 100.0% 0 3.25s 1,360 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 3.0 10.0 0.0% 0 177.35s 10,919 72,053
Step 3.7 Flash 3.0 10.0 0.0% 0 124.75s 134,779 0

Quick Compare

Switch Comparison Pair

Kimi K2.6mediumFree AvailablevsStep 3.7 FlashlowStep 3.7 FlashlowvsMiMo-V2.5mediumClaude Opus 4.8nonevsQwen3.5-35B-A3BmediumRing-2.6-1TnonevsQwen3.5-35B-A3BmediumGPT-5.3 ChatnonevsStep 3.7 FlashlowStep 3.7 FlashlowvsGLM 5V TurbomediumStep 3.7 FlashlowvsGLM 5.1mediumGPT-5.2mediumvsStep 3.7 FlashlowGPT-5.4 MinimediumvsStep 3.7 FlashlowGemini 3.1 Flash Lite PreviewnonevsStep 3.7 FlashlowClaude Opus 4.8nonevsStep 3.7 FlashlowQwen3.5-35B-A3BmediumvsStep 3.7 Flashhigh