GPT-5.6 Sol vs Qwen3.7 Flash (medium)

Compared models

Rank: #219
Total Output Tokens: 5,555
Response Time (avg): 4.61s
Total Cost: $0.795

Rank: #224
Total Output Tokens: 514,925
Response Time (avg): 51.80s
Total Cost: $0.076

Recommended model Qwen3.7 Flash (medium)

Its score stays close to the best score here (6.6 vs 6.7), while costing about 10.5x less than GPT-5.6 Sol.

Detailed comparison

Metric	GPT-5.6 Sol GPT-5.6 Sol none Release: 2026-07-09	Qwen3.7 Flash Qwen3.7 Flash medium Release: 2026-07-28

Metric	GPT-5.6 Sol GPT-5.6 Sol none Release: 2026-07-09	Qwen3.7 Flash Qwen3.7 Flash medium Release: 2026-07-28
Score	6.7	6.6
Rank	#219	#224
Reliability	10.0	10.0
Consistency	9.1	7.3
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	60.9%	62.3%
Flaky tests	3	8
Total Runs	69	69
Cost per result	6.619	0.760
Total Cost	$0.795	$0.076
Input Price	$2.000 / 1M	$0.030 / 1M
Output Price	$10.000 / 1M	$0.130 / 1M
Cache Read Price	$0.200 / 1M	$0.006 / 1M
Cache Write Price	$2.500 / 1M	$0.039 / 1M
Total Input Tokens	207,852	300,394
Output Tokens	5,555	14,081
Reasoning Tokens	0	500,844
Response Time (avg)	4.61s	51.80s
Response Time (max)	58.28s	593.64s
Response Time (total)	105.93s	1191.42s
Parameters	~2T total (~150B active)	~35B total (~3B active)
Availability	Closed	Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#219 GPT-5.6 Sol

none

Cost: $0.116
Time: 78.7s
Tokens: 3,944 tok

#224 Qwen3.7 Flash

medium

Reached the allocated time limit (600 seconds) without receiving showcase output.

Cost: $0.000
Time: 600.0s
Tokens: 0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	5.0	10.0	0.0%	0		58.28s	129,250	1,198	0
Qwen3.7 Flash	5.2	3.2	33.3%	1		148.99s	185,917	1,295	43,554

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	8.3	10.0	75.0%	0		1.27s	606	154	0
Qwen3.7 Flash	10.0	10.0	100.0%	0		9.56s	672	525	12,844

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	5.5	10.0	33.3%	0		1.39s	7,302	390	0
Qwen3.7 Flash	6.2	6.9	55.6%	1		46.78s	7,893	563	61,902

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	6.5	10.0	50.0%	0		8.37s	55,394	2,881	0
Qwen3.7 Flash	6.4	5.8	66.7%	1		314.17s	87,042	10,432	296,919

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	10.0	10.0	100.0%	0		1.53s	7,140	222	0
Qwen3.7 Flash	10.0	10.0	100.0%	0		15.42s	7,782	270	11,588

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	5.9	7.2	55.6%	1		1.44s	732	54	0
Qwen3.7 Flash	2.9	7.2	11.1%	1		38.02s	780	59	38,977

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	6.5	3.4	66.7%	1		1.52s	477	91	0
Qwen3.7 Flash	5.5	10.0	0.0%	0		10.18s	516	143	3,647

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	8.5	6.8	83.3%	1		1.33s	660	84	0
Qwen3.7 Flash	5.8	2.7	66.7%	2		9.27s	699	100	7,457

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	7.7	10.0	66.7%	0		1.49s	642	211	0
Qwen3.7 Flash	7.1	5.1	77.8%	2		8.30s	696	355	9,138

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	10.0	10.0	100.0%	0		3.70s	5,454	246	0
Qwen3.7 Flash	10.0	10.0	100.0%	0		7.80s	8,193	309	2,171

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	3.0	10.0	0.0%	0		1.95s	195	24	0
Qwen3.7 Flash	3.0	10.0	0.0%	0		29.17s	204	30	12,647

Switch Comparison Pair

Ember-1maxvsGPT-5.6 Solnone Apodex 1.1 MinihighFree AvailablevsGPT-5.6 Solnone MiniMax M3mediumvsGPT-5.6 Solnone GPT-5.6 SolnonevsGrok 4.7high LongCat 2.0lowvsQwen3.7 Flashmedium GPT-5.6 SolnonevsSolar Pro 4low Qwen3.7 FlashmediumvsGLM 5.2none GPT-5.5nonevsQwen3.7 Flashmedium GPT-5.6 SolnonevsGLM 5.3 Flashlow Qwen3.7 FlashmediumvsGLM 5.3 Flashlow Qwen3.7 FlashmediumvsStep 3.7 Flashhigh GPT-5.6 SolnonevsGrok Build 0.1medium