GPT-6 Sol (medium) vs Grok 4.6 (high)

Compared models

Recommended model GPT-6 Sol (medium)

It has the best score here (9.4), while costing about 4.3x less than Grok 4.6 (high).

Metric	GPT-6 Sol GPT-6 Sol medium Release: 2026-09-23	Grok 4.6 Grok 4.6 high Release: 2026-08-12

Metric	GPT-6 Sol GPT-6 Sol medium Release: 2026-09-23	Grok 4.6 Grok 4.6 high Release: 2026-08-12
Score	9.4	9.3
Rank	#14	#19
Reliability	10.0	10.0
Consistency	9.6	10.0
Attempts	66/66	66/66
Tests Correct
Attempt pass rate	93.9%	86.4%
Flaky tests	1	0
Total Runs	66	66
Cost per result	2.240	10.042
Total Cost	$0.448	$1.908
Input Price	$2.000 / 1M	$2.000 / 1M
Output Price	$10.000 / 1M	$6.000 / 1M
Total Input Tokens	78,376	107,275
Output Tokens	4,309	5,094
Reasoning Tokens	24,806	277,123
Response Time (avg)	10.33s	84.15s
Response Time (max)	82.74s	618.49s
Response Time (total)	227.17s	1851.26s
Parameters	~2T total (~150B active)	~1.7T total (~170B active)
Availability	Closed	Closed

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

medium

high

Category:

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		2.70s	606	142	564
Grok 4.6	10.0	10.0	100.0%	0		14.44s	2,991	79	6,805

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	8.2	7.2	88.9%	1		11.78s	7,302	392	2,532
Grok 4.6	10.0	10.0	100.0%	0		102.20s	9,579	379	51,829

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		10.78s	55,168	2,825	1,234
Grok 4.6	10.0	10.0	100.0%	0		91.77s	68,548	3,931	34,529

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		7.34s	7,140	234	162
Grok 4.6	10.0	10.0	100.0%	0		16.08s	8,937	225	6,590

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	7.7	10.0	66.7%	0		36.36s	732	67	18,352
Grok 4.6	5.3	10.0	33.3%	0		369.95s	2,523	14	154,471

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		13.97s	477	90	136
Grok 4.6	10.0	10.0	100.0%	0		19.51s	1,077	56	2,448

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		2.00s	660	93	304
Grok 4.6	9.8	10.0	100.0%	0		13.82s	1,857	57	4,318

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		2.79s	642	196	724
Grok 4.6	10.0	10.0	100.0%	0		15.56s	2,430	122	5,706

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		4.77s	5,454	240	53
Grok 4.6	10.0	10.0	100.0%	0		13.30s	8,544	216	1,505

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		4.61s	195	30	745
Grok 4.6	3.0	10.0	0.0%	0		54.22s	789	15	8,922

Switch Comparison Pair