Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

Qwen: Qwen3.6 35B A3B vs StepFun: Step 3.7 Flash

Last updated at: 2026-06-03

Metric Qwen3.6 35B A3B Qwen3.6 35B A3B medium Release: 2026-04-20 Step 3.7 Flash Step 3.7 Flash low Release: 2026-05-29
Score 7.3 7.4
Rank #58 #56
Reliability 10.0 10.0
Consistency 9.6 8.7
Tests Correct
Attempt pass rate 61.7% 68.3%
Flaky tests 1 3
Total Runs 60 60
Cost per result 1.048 2.796
Total Cost $0.130 $0.336
Input Price $0.140 / 1M $0.200 / 1M
Output Price $1.000 / 1M $1.150 / 1M
Total Input Tokens 13,550 37,458
Output Tokens 18,304 285,209
Reasoning Tokens 115,531 0
Response Time (avg) 17.26s 16.06s
Response Time (max) 86.11s 124.75s
Response Time (total) 310.65s 321.11s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 6.02s 672 1,154 12,385
Step 3.7 Flash 8.7 7.9 91.7% 1 4.02s 756 10,896 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.6 35B A3B 6.6 10.0 50.0% 0 59.35s 2,216 6,601 22,535
Step 3.7 Flash 10.0 10.0 100.0% 0 9.43s 4,794 14,569 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.6 35B A3B 3.0 10.0 0.0% 0 0ms 0 0 0
Step 3.7 Flash 10.0 10.0 100.0% 0 7.98s 13,683 6,426 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 12.99s 7,776 2,591 9,968
Step 3.7 Flash 7.3 5.8 83.3% 1 2.29s 7,398 2,667 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.6 35B A3B 5.3 7.2 44.4% 1 22.50s 771 6,193 39,116
Step 3.7 Flash 5.3 7.2 44.4% 1 43.31s 828 104,487 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.6 35B A3B 4.4 9.9 0.0% 0 8.66s 516 129 4,569
Step 3.7 Flash 3.4 9.3 0.0% 0 7.00s 525 4,604 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 7.50s 699 219 7,404
Step 3.7 Flash 9.8 10.0 100.0% 0 1.58s 735 1,857 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.6 35B A3B 8.0 10.0 66.7% 0 5.95s 696 655 9,228
Step 3.7 Flash 5.5 9.9 33.3% 0 1.84s 756 3,564 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.6 35B A3B 3.0 10.0 0.0% 0 0ms 0 0 0
Step 3.7 Flash 10.0 10.0 100.0% 0 3.25s 7,746 1,360 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.6 35B A3B 3.0 10.0 0.0% 0 32.90s 204 762 10,326
Step 3.7 Flash 3.0 10.0 0.0% 0 124.75s 237 134,779 0

Quick Compare

Switch Comparison Pair

Step 3.7 FlashlowvsMiMo-V2.5mediumGPT-5.3 ChatnonevsStep 3.7 FlashlowStep 3.7 FlashlowvsGLM 5.1mediumStep 3.7 FlashlowvsGLM 5V TurbomediumKimi K2.6mediumFree AvailablevsStep 3.7 FlashlowGPT-5.2mediumvsStep 3.7 FlashlowGPT-5.3 ChatnonevsQwen3.6 35B A3BmediumGPT-5.4 MinimediumvsStep 3.7 FlashlowClaude Opus 4.8nonevsQwen3.6 35B A3BmediumGemini 3.1 Flash Lite PreviewnonevsStep 3.7 FlashlowGemini 3.1 Flash LitelowvsQwen3.6 35B A3BmediumClaude Opus 4.8nonevsStep 3.7 Flashlow