Qwen3.7 Flash (high) vs Grok 4.7 (medium)

Compared models

Recommended model Qwen3.7 Flash (high)

Its score stays close to the best score here (7.2 vs 7.3), while costing about 56.4x less than Grok 4.7 (medium).

Metric	Qwen3.7 Flash Qwen3.7 Flash high Release: 2026-07-28	Grok 4.7 Grok 4.7 medium Release: 2026-09-21

Metric	Qwen3.7 Flash Qwen3.7 Flash high Release: 2026-07-28	Grok 4.7 Grok 4.7 medium Release: 2026-09-21
Score	7.2	7.3
Rank	#144	#134
Reliability	10.0	9.8
Consistency	7.6	8.3
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	71.0%	78.3%
Flaky tests	7	5
Total Runs	69	69
Cost per result	0.478	19.582
Total Cost	$0.063	$3.501
Input Price	$0.030 / 1M	$2.000 / 1M
Output Price	$0.130 / 1M	$6.000 / 1M
Total Input Tokens	293,775	326,066
Output Tokens	13,527	5,726
Reasoning Tokens	396,291	469,019
Response Time (avg)	45.48s	117.65s
Response Time (max)	431.47s	660.89s
Response Time (total)	1045.97s	2706.03s
Parameters	~35B total (~3B active)	~1.7T total (~170B active)
Availability	Closed	Closed

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

high

Reached the allocated time limit (600 seconds) without receiving showcase output.

medium

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Flash	4.7	1.6	66.7%	1		135.86s	177,444	1,197	38,371
Grok 4.7	3.9	9.6	0.0%	0		372.09s	218,873	1,065	39,947

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Flash	10.0	10.0	100.0%	0		10.21s	672	713	13,968
Grok 4.7	10.0	10.0	100.0%	0		16.01s	2,991	54	7,224

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Flash	8.2	9.7	66.7%	0		58.84s	7,893	503	62,350
Grok 4.7	6.6	4.6	77.8%	2		312.17s	10,266	349	172,347

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Flash	6.9	5.9	66.7%	1		231.97s	88,896	9,866	203,866
Grok 4.7	10.0	10.0	100.0%	0		96.50s	67,788	3,524	38,447

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Flash	10.0	10.0	100.0%	0		20.10s	7,782	270	10,800
Grok 4.7	10.0	10.0	100.0%	0		5.16s	8,937	225	2,344

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Flash	2.9	4.4	22.2%	2		34.43s	780	59	35,675
Grok 4.7	5.3	7.2	44.4%	1		300.37s	2,523	15	169,756

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Flash	5.1	3.4	33.3%	1		10.73s	516	120	3,898
Grok 4.7	5.4	2.5	66.7%	1		32.39s	1,077	76	5,830

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Flash	9.8	10.0	100.0%	0		9.41s	699	97	7,838
Grok 4.7	8.4	6.9	83.3%	1		6.68s	1,857	57	2,742

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Flash	7.1	5.1	77.8%	2		10.79s	696	369	10,474
Grok 4.7	10.0	10.0	100.0%	0		18.46s	2,430	135	9,678

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Flash	10.0	10.0	100.0%	0		5.72s	8,193	309	1,436
Grok 4.7	10.0	10.0	100.0%	0		4.79s	8,535	206	406

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.7 Flash	3.0	10.0	0.0%	0		17.70s	204	24	7,615
Grok 4.7	3.0	10.0	0.0%	0		123.05s	789	20	20,298

Switch Comparison Pair