Qwen3.7 Max (medium) vs Grok 4.6 (high)

Compared models

Recommended model Qwen3.7 Max (medium)

It has the best score here (8.5), while responding about 1.8x faster than Grok 4.6 (high).

Metric	Qwen3.7 Max Qwen3.7 Max medium Release: 2026-05-22	Grok 4.6 Grok 4.6 high Release: 2026-08-12

Metric	Qwen3.7 Max Qwen3.7 Max medium Release: 2026-05-22	Grok 4.6 Grok 4.6 high Release: 2026-08-12
Score	8.5	8.5
Rank	#67	#64
Reliability	10.0	10.0
Consistency	8.7	10.0
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	85.5%	82.6%
Flaky tests	4	0
Total Runs	69	69
Cost per result	12.033	13.833
Total Cost	$2.046	$2.629
Input Price	$1.475 / 1M	$2.000 / 1M
Output Price	$4.425 / 1M	$6.000 / 1M
Total Input Tokens	367,848	376,233
Output Tokens	8,753	6,687
Reasoning Tokens	250,279	305,927
Response Time (avg)	48.35s	87.48s
Response Time (max)	556.06s	618.49s
Response Time (total)	1112.11s	2012.15s
Parameters	~1T total (~40B active)	~1.7T total (~170B active)
Availability	Closed	Closed

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

medium

high

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Max	6.1	3.1	66.7%	1		137.00s	261,819	3,005	29,925
Grok 4.6	5.0	10.0	0.0%	0		160.89s	268,958	1,593	28,804

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Max	10.0	10.0	100.0%	0		6.36s	672	222	8,742
Grok 4.6	10.0	10.0	100.0%	0		14.44s	2,991	79	6,805

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Max	10.0	10.0	100.0%	0		35.31s	7,893	423	34,808
Grok 4.6	10.0	10.0	100.0%	0		102.20s	9,579	379	51,829

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Max	8.7	6.9	83.3%	1		287.83s	78,594	3,985	96,450
Grok 4.6	10.0	10.0	100.0%	0		91.77s	68,548	3,931	34,529

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Max	10.0	10.0	100.0%	0		8.80s	7,782	270	6,254
Grok 4.6	10.0	10.0	100.0%	0		16.08s	8,937	225	6,590

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Max	4.1	4.4	44.5%	2		52.45s	780	61	41,143
Grok 4.6	5.3	10.0	33.3%	0		369.95s	2,523	14	154,471

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Max	10.0	10.0	100.0%	0		11.70s	516	135	4,457
Grok 4.6	10.0	10.0	100.0%	0		19.51s	1,077	56	2,448

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Max	10.0	10.0	100.0%	0		7.46s	699	102	5,452
Grok 4.6	9.8	10.0	100.0%	0		13.82s	1,857	57	4,318

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Max	10.0	10.0	100.0%	0		8.84s	696	259	8,908
Grok 4.6	10.0	10.0	100.0%	0		15.56s	2,430	122	5,706

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Max	10.0	10.0	100.0%	0		6.63s	8,193	267	1,220
Grok 4.6	10.0	10.0	100.0%	0		13.30s	8,544	216	1,505

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Max	3.0	10.0	0.0%	0		33.37s	204	24	12,920
Grok 4.6	3.0	10.0	0.0%	0		54.22s	789	15	8,922

Switch Comparison Pair