GPT-6 Sol vs Grok 4.7 (xhigh)

Compared models

Rank: #205
Total Output Tokens: 7,989
Response Time (avg): 9.02s
Total Cost: $0.551

Rank: #208
Total Output Tokens: 572,315
Response Time (avg): 123.96s
Total Cost: $3.398

Recommended model GPT-6 Sol

It has the best score here (6.8), while costing about 6.2x less than Grok 4.7 (xhigh).

Detailed comparison

Metric	GPT-6 Sol GPT-6 Sol none Release: 2026-09-23	Grok 4.7 Grok 4.7 xhigh Release: 2026-09-21

Metric	GPT-6 Sol GPT-6 Sol none Release: 2026-09-23	Grok 4.7 Grok 4.7 xhigh Release: 2026-09-21
Score	6.8	6.7
Rank	#205	#208
Reliability	10.0	9.7
Consistency	8.5	7.8
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	63.8%	73.9%
Flaky tests	4	6
Total Runs	69	69
Cost per result	4.232	24.272
Total Cost	$0.551	$3.398
Input Price	$2.000 / 1M	$2.000 / 1M
Output Price	$10.000 / 1M	$6.000 / 1M
Cache Read Price	$0.200 / 1M	$0.500 / 1M
Cache Write Price	$2.500 / 1M	N/A
Total Input Tokens	235,086	310,049
Output Tokens	7,989	6,094
Reasoning Tokens	0	566,221
Response Time (avg)	9.02s	123.96s
Response Time (max)	57.02s	775.64s
Response Time (total)	207.45s	2851.07s
Parameters	~2T total (~150B active)	~1.7T total (~170B active)
Availability	Closed	Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#205 GPT-6 Sol

none

Cost: $0.030
Time: 31.9s
Tokens: 3,055 tok

#208 SpaceXAI: Grok 4.7

xhigh

Cost: $0.235
Time: 544.2s
Tokens: 39,247 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	5.0	10.0	0.0%	0		57.02s	128,754	1,293	0
Grok 4.7	3.0	10.0	0.0%	0		304.76s	185,153	1,204	66,042

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	6.9	5.8	75.0%	2		1.23s	606	141	0
Grok 4.7	8.7	7.9	91.7%	1		35.37s	2,754	108	21,953

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	5.5	10.0	33.3%	0		12.23s	7,302	389	0
Grok 4.7	5.3	4.5	55.6%	2		414.53s	10,168	327	256,935

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	6.5	10.0	50.0%	0		10.61s	83,124	5,296	0
Grok 4.7	10.0	10.0	100.0%	0		170.10s	85,391	3,689	90,375

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		20.98s	7,140	222	0
Grok 4.7	10.0	10.0	100.0%	0		7.50s	8,943	225	3,639

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	5.3	7.2	44.4%	1		3.41s	732	52	0
Grok 4.7	3.5	4.4	33.3%	2		190.55s	2,922	11	85,304

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		23.89s	477	81	0
Grok 4.7	4.7	1.6	66.7%	1		26.32s	1,080	86	4,949

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		1.23s	660	81	0
Grok 4.7	9.8	10.0	100.0%	0		17.31s	1,863	57	7,728

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	7.6	7.2	77.8%	1		1.40s	642	187	0
Grok 4.7	10.0	10.0	100.0%	0		20.50s	2,439	169	10,900

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		3.43s	5,454	226	0
Grok 4.7	10.0	10.0	100.0%	0		5.36s	8,544	206	568

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	3.0	10.0	0.0%	0		1.45s	195	21	0
Grok 4.7	3.0	10.0	0.0%	0		106.61s	792	12	17,828

Switch Comparison Pair

Mercury 2.5 PreviewmediumvsGPT-6 Solnone GPT-6 SolnonevsInklinglowFree Available GPT-6 SolnonevsQwen3.5-Flashmedium Qwen3.5-FlashnonevsGrok 4.7xhigh Space Bunny AlphamaxvsGrok 4.7xhigh Kimi K2.6mediumvsGPT-6 Solnone Solar Pro 4lowvsGrok 4.7xhigh MiniMax M3mediumvsGrok 4.7xhigh Ember-1maxvsGrok 4.7xhigh GPT-6 SolnonevsSpace Bunny Alphamax GPT 5.3 ChatdefaultvsGrok 4.7xhigh GPT-5.6 SolnonevsGrok 4.7xhigh