Qwen3.6 Plus (medium) vs Step 3.7 Flash (low)

Compared models

Recommended model Step 3.7 Flash (low)

Its score stays close to the best score here (7.2 vs 7.3), while responding about 2.8x faster than Qwen3.6 Plus (medium).

Metric	Qwen3.6 Plus Qwen3.6 Plus medium Release: 2026-04-20	Step 3.7 Flash Step 3.7 Flash low Release: 2026-05-29

Metric	Qwen3.6 Plus Qwen3.6 Plus medium Release: 2026-04-20	Step 3.7 Flash Step 3.7 Flash low Release: 2026-05-29
Score	7.3	7.2
Rank	#137	#147
Reliability	10.0	10.0
Consistency	9.0	7.9
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	69.6%	63.8%
Flaky tests	3	6
Total Runs	69	69
Cost per result	2.605	4.078
Total Cost	$0.391	$0.449
Input Price	$0.325 / 1M	$0.200 / 1M
Output Price	$1.950 / 1M	$1.150 / 1M
Total Input Tokens	222,601	292,685
Output Tokens	8,185	339,108
Reasoning Tokens	238,605	0
Response Time (avg)	57.41s	20.72s
Response Time (max)	307.08s	124.75s
Response Time (total)	1263.02s	476.67s
Parameters	~397B total (~17B active)	198B total (11B active)
Availability	Closed	Open source

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

medium

low

Invalid SVG

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.6 Plus	4.7	3.1	33.3%	1		307.08s	124,903	1,768	47,390
Step 3.7 Flash	7.4	3.8	66.7%	1		83.63s	188,843	18,715	0

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.6 Plus	10.0	10.0	100.0%	0		9.90s	672	207	7,557
Step 3.7 Flash	8.7	7.9	91.7%	1		4.02s	756	10,896	0

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.6 Plus	6.1	7.8	44.4%	1		153.12s	7,098	58	50,586
Step 3.7 Flash	8.2	7.2	88.9%	1		9.46s	7,437	18,685	0

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.6 Plus	10.0	10.0	100.0%	0		163.25s	71,058	5,011	55,925
Step 3.7 Flash	7.3	5.8	83.3%	1		66.18s	77,415	93,682	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.6 Plus	10.0	10.0	100.0%	0		14.95s	7,782	270	10,706
Step 3.7 Flash	7.3	5.8	83.3%	1		2.29s	7,398	2,667	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.6 Plus	2.9	7.2	11.1%	1		46.39s	780	61	39,854
Step 3.7 Flash	2.9	7.2	11.1%	1		22.65s	837	48,299	0

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.6 Plus	5.1	10.0	0.0%	0		27.05s	516	111	5,232
Step 3.7 Flash	3.4	9.3	0.0%	0		7.00s	525	4,604	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.6 Plus	10.0	10.0	100.0%	0		7.54s	699	102	5,552
Step 3.7 Flash	9.8	10.0	100.0%	0		1.58s	735	1,857	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.6 Plus	10.0	10.0	100.0%	0		6.34s	696	309	6,712
Step 3.7 Flash	5.5	9.9	33.3%	0		1.84s	756	3,564	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.6 Plus	10.0	10.0	100.0%	0		5.87s	8,193	267	1,330
Step 3.7 Flash	10.0	10.0	100.0%	0		3.25s	7,746	1,360	0

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.6 Plus	3.0	10.0	0.0%	0		47.51s	204	21	7,761
Step 3.7 Flash	3.0	10.0	0.0%	0		124.75s	237	134,779	0

Switch Comparison Pair