GPT-6 Sol (low) vs Grok 4.5 (low)

Compared models

Rank: #68
Total Output Tokens: 11,677
Response Time (avg): 6.92s
Total Cost: $0.273

Rank: #63
Total Output Tokens: 115,489
Response Time (avg): 16.17s
Total Cost: $0.945

Recommended model GPT-6 Sol (low)

It has the best score here (8.4), while costing about 3.5x less than Grok 4.5 (low).

Detailed comparison

Metric	GPT-6 Sol GPT-6 Sol low Release: 2026-09-23	Grok 4.5 Grok 4.5 low Release: 2026-07-08

Metric	GPT-6 Sol GPT-6 Sol low Release: 2026-09-23	Grok 4.5 Grok 4.5 low Release: 2026-07-08
Score	8.4	8.4
Rank	#68	#63
Reliability	10.0	10.0
Consistency	8.5	9.3
Attempts	66/66	66/66
Tests Correct
Attempt pass rate	86.4%	77.3%
Flaky tests	4	2
Total Runs	66	66
Cost per result	1.604	5.901
Total Cost	$0.273	$0.945
Input Price	$2.000 / 1M	$2.000 / 1M
Output Price	$10.000 / 1M	$6.000 / 1M
Total Input Tokens	77,882	125,605
Output Tokens	4,047	7,505
Reasoning Tokens	7,630	107,984
Response Time (avg)	6.92s	16.17s
Response Time (max)	17.91s	205.28s
Response Time (total)	152.17s	355.67s
Parameters	~2T total (~150B active)	~1.7T total (~170B active)
Availability	Closed	Closed

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#68 GPT-6 Sol

low

Cost: $0.018
Time: 17.4s
Tokens: 1,850 tok

#63 SpaceXAI: Grok 4.5

low

Cost: $0.011
Time: 12.4s
Tokens: 2,018 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		2.43s	606	172	339
Grok 4.5	10.0	10.0	100.0%	0		2.75s	2,991	261	3,000

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	6.2	4.8	66.7%	2		8.74s	7,302	405	1,296
Grok 4.5	10.0	10.0	100.0%	0		13.72s	9,579	303	15,641

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		8.13s	54,674	2,524	512
Grok 4.5	6.5	10.0	50.0%	0		12.75s	82,028	6,031	3,583

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		13.63s	7,140	224	17
Grok 4.5	10.0	10.0	100.0%	0		3.44s	8,937	225	2,549

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	5.3	7.2	44.4%	1		11.45s	732	71	4,573
Grok 4.5	2.9	7.2	11.1%	1		77.09s	2,523	14	71,813

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		17.91s	477	83	0
Grok 4.5	6.1	3.1	66.7%	1		4.88s	1,077	98	1,253

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		2.37s	660	93	185
Grok 4.5	9.8	10.0	100.0%	0		2.80s	1,857	57	1,878

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		2.66s	642	209	314
Grok 4.5	10.0	10.0	100.0%	0		3.20s	2,430	217	2,590

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		4.03s	5,454	236	16
Grok 4.5	10.0	10.0	100.0%	0		5.83s	13,394	284	871

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	4.7	1.6	66.7%	1		3.67s	195	30	378
Grok 4.5	3.0	10.0	0.0%	0		13.98s	789	15	4,806

Quick Compare

Switch Comparison Pair

GPT-6 SollowvsInkling Smallhigh GPT-5.2mediumvsGrok 4.5low Seed 2.1 TurbomediumvsGPT-6 Sollow GPT-6 SollowvsMiMo-V2.6-Promedium Qwen3.8 27BhighvsGrok 4.5low GPT-6 SollowvsQwen3.8 27Bhigh Grok 4.5lowvsMiMo-V2.6-Promedium Seed 2.1 TurbomediumvsGrok 4.5low GPT-6 SollowvsGLM 5.3 FlashXmax Inkling SmallhighvsGrok 4.5low DeepSeek V4.1 FlashmaxvsGPT-6 Sollow Grok 4.5lowvsGLM 5.3 FlashXmax