GPT-5.6 Sol (low) vs Qwen3.8 Max (medium)

Recommended model GPT-5.6 Sol (low)

It has the best score here (9.5), while responding about 2.5x faster than Qwen3.8 Max (medium).

Detailed comparison

Metric	GPT-5.6 Sol GPT-5.6 Sol low Release: 2026-07-09	Qwen3.8 Max Qwen3.8 Max medium Release: 2026-08-04

Metric	GPT-5.6 Sol GPT-5.6 Sol low Release: 2026-07-09	Qwen3.8 Max Qwen3.8 Max medium Release: 2026-08-04
Score	9.5	9.1
Rank	#6	#19
Reliability	10.0	10.0
Consistency	9.2	9.7
Attempts	66/66	66/66
Tests Correct
Attempt pass rate	86.4%	84.9%
Flaky tests	2	1
Total Runs	66	66
Cost per result	5.391	4.040
Total Cost	$0.971	$0.728
Input Price	$5.000 / 1M	$2.000 / 1M
Output Price	$30.000 / 1M	$6.000 / 1M
Total Input Tokens	78,571	109,046
Output Tokens	4,476	6,567
Reasoning Tokens	14,770	78,259
Response Time (avg)	8.79s	21.53s
Response Time (max)	53.91s	126.60s
Response Time (total)	193.33s	473.75s
Parameters	~2T total (~150B active)	2.4T total (~100B active)
Availability	Closed	Closed

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

low

medium

Category:

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	8.3	10.0	75.0%	0		2.60s	606	174	492
Qwen3.8 Max	10.0	10.0	100.0%	0		4.17s	672	312	2,075

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	10.0	10.0	100.0%	0		11.25s	7,302	412	3,482
Qwen3.8 Max	10.0	10.0	100.0%	0		41.35s	7,893	430	23,804

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	10.0	10.0	100.0%	0		14.58s	55,372	2,896	1,539
Qwen3.8 Max	8.7	6.9	83.3%	1		91.25s	81,584	4,526	30,688

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	10.0	10.0	100.0%	0		1.82s	7,140	222	0
Qwen3.8 Max	10.0	10.0	100.0%	0		8.72s	7,782	270	2,519

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	5.3	7.2	44.4%	1		29.07s	723	71	7,822
Qwen3.8 Max	5.3	10.0	33.3%	0		28.52s	771	63	13,581

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	10.0	10.0	100.0%	0		3.07s	477	99	135
Qwen3.8 Max	10.0	10.0	100.0%	0		6.41s	516	168	700

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	10.0	10.0	100.0%	0		2.27s	660	90	146
Qwen3.8 Max	10.0	10.0	100.0%	0		3.49s	699	102	914

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	8.2	7.2	88.9%	1		3.44s	642	224	534
Qwen3.8 Max	10.0	10.0	100.0%	0		4.93s	696	401	1,575

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	10.0	10.0	100.0%	0		7.56s	5,454	258	294
Qwen3.8 Max	10.0	10.0	100.0%	0		7.83s	8,229	267	636

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	10.0	10.0	100.0%	0		3.67s	195	30	326
Qwen3.8 Max	3.0	10.0	0.0%	0		11.49s	204	28	1,767

Switch Comparison Pair