GPT-6 Sol (low) vs Qwen3.8 27B (high)

Compared models

Rank: #77
Total Output Tokens: 13,211
Response Time (avg): 8.72s
Total Cost: $0.477

Rank: #74
Total Output Tokens: 677,080
Response Time (avg): 166.34s
Total Cost: ~$0.298

Recommended model GPT-6 Sol (low)

It has the best score here (8.7), while responding about 19.1x faster than Qwen3.8 27B (high).

Detailed comparison

Metric	GPT-6 Sol GPT-6 Sol low Release: 2026-09-23	Qwen3.8 27B Qwen3.8 27B high Release: 2026-08-14 Free Available

Metric	GPT-6 Sol GPT-6 Sol low Release: 2026-09-23	Qwen3.8 27B Qwen3.8 27B high Release: 2026-08-14 Free Available
Score	8.7	8.7
Rank	#77	#74
Reliability	10.0	9.7
Consistency	8.6	9.2
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	87.0%	78.3%
Flaky tests	4	2
Total Runs	69	69
Cost per result	2.650	~1.751
Total Cost	$0.477	~$0.298
Input Price	$2.000 / 1M	N/A
Output Price	$10.000 / 1M	N/A
Cache Read Price	$0.200 / 1M	N/A
Cache Write Price	$2.500 / 1M	N/A
Total Input Tokens	172,359	348,967
Output Tokens	5,026	1,005
Reasoning Tokens	8,185	676,075
Response Time (avg)	8.72s	166.34s
Response Time (max)	48.43s	640.85s
Response Time (total)	200.61s	3825.81s
Parameters	~2T total (~150B active)	27.3B
Availability	Closed	Weights available

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#77 GPT-6 Sol

low

Cost: $0.018
Time: 17.4s
Tokens: 1,850 tok

#74 Qwen3.8 27B

high

Cost: ~$0.008
Time: 270.1s
Tokens: 18,963 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		48.43s	94,477	979	555
Qwen3.8 27B	10.0	10.0	100.0%	0		132.27s	248,788	101	20,344

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		2.43s	606	172	339
Qwen3.8 27B	10.0	10.0	100.0%	0		8.10s	1,128	114	5,319

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	6.2	4.8	66.7%	2		8.74s	7,302	405	1,296
Qwen3.8 27B	8.1	7.0	88.9%	1		248.62s	8,235	346	143,335

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		8.13s	54,674	2,524	512
Qwen3.8 27B	10.0	10.0	100.0%	0		185.57s	68,997	66	72,556

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		13.63s	7,140	224	17
Qwen3.8 27B	10.0	10.0	100.0%	0		34.85s	9,675	123	10,320

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	5.3	7.2	44.4%	1		11.45s	732	71	4,573
Qwen3.8 27B	5.3	10.0	33.3%	0		526.74s	975	6	234,555

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		17.91s	477	83	0
Qwen3.8 27B	5.0	10.0	0.0%	0		8.45s	630	63	1,191

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		2.37s	660	93	185
Qwen3.8 27B	9.8	10.0	100.0%	0		8.24s	927	42	2,871

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		2.66s	642	209	314
Qwen3.8 27B	7.6	7.2	77.8%	1		199.90s	1,038	120	138,427

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		4.03s	5,454	236	16
Qwen3.8 27B	10.0	10.0	100.0%	0		5.62s	8,256	21	912

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	4.7	1.6	66.7%	1		3.67s	195	30	378
Qwen3.8 27B	3.0	10.0	0.0%	0		263.98s	318	3	46,245

Switch Comparison Pair