GPT-6 Sol (low) vs Grok 4.5 (medium)

Compared models

Recommended model GPT-6 Sol (low)

Its score stays close to the best score here (8.4 vs 8.5), while costing about 7.5x less than Grok 4.5 (medium).

Metric	GPT-6 Sol GPT-6 Sol low Release: 2026-09-23	Grok 4.5 Grok 4.5 medium Release: 2026-07-08

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

low

medium

Category:

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		2.43s	606	172	339
Grok 4.5	10.0	10.0	100.0%	0		23.50s	2,991	147	4,018

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	6.2	4.8	66.7%	2		8.74s	7,302	405	1,296
Grok 4.5	7.6	7.2	77.8%	1		155.69s	9,579	390	104,634

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		8.13s	54,674	2,524	512
Grok 4.5	10.0	10.0	100.0%	0		29.01s	83,730	4,154	16,180

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		13.63s	7,140	224	17
Grok 4.5	10.0	10.0	100.0%	0		6.29s	8,937	225	3,657

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	5.3	7.2	44.4%	1		11.45s	732	71	4,573
Grok 4.5	5.3	7.2	44.4%	1		249.34s	2,221	11	140,815

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		17.91s	477	83	0
Grok 4.5	6.5	3.4	66.7%	1		12.84s	1,077	71	2,384

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		2.37s	660	93	185
Grok 4.5	9.8	10.0	100.0%	0		6.06s	1,857	57	2,728

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		2.66s	642	209	314
Grok 4.5	10.0	10.0	100.0%	0		7.75s	2,430	254	3,641

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		4.03s	5,454	236	16
Grok 4.5	10.0	10.0	100.0%	0		6.57s	8,544	192	968

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	4.7	1.6	66.7%	1		3.67s	195	30	378
Grok 4.5	3.0	10.0	0.0%	0		74.44s	789	13	14,921

Switch Comparison Pair