Navigate
Advertise here

GPT-6 Sol (low) vs Grok 4.6 (high)

GPT-6 Sol (low) leads on average score with 8.7 vs 8.5. GPT-6 Sol (low) has the lower benchmark cost at $0.477 vs $2.629. GPT-6 Sol (low) is faster at 8.72s vs 87.48s, with pass rates of 87.0% vs 82.6%.

Last updated at: 2026-10-07

Compared models

Rank
#59
Total Output Tokens
13,211
Response Time (avg)
8.72s
Total Cost
$0.477
Rank
#66
Total Output Tokens
312,614
Response Time (avg)
87.48s
Total Cost
$2.629
Recommended model GPT-6 Sol (low)

It has the best score here (8.7), while costing about 5.5x less than Grok 4.6 (high).

Detailed comparison

Metric GPT-6 Sol GPT-6 Sol low Release: 2026-09-23 Grok 4.6 Grok 4.6 high Release: 2026-08-12
Score 8.7 8.5
Rank #59 #66
Reliability 10.0 10.0
Consistency 8.6 10.0
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 87.0% 82.6%
Flaky tests 4 0
Total Runs 69 69
Cost per result 2.650 13.833
Total Cost $0.477 $2.629
Input Price $2.000 / 1M $2.000 / 1M
Output Price $10.000 / 1M $6.000 / 1M
Cache Read Price $0.200 / 1M $0.500 / 1M
Cache Write Price $2.500 / 1M N/A
Total Input Tokens 172,359 376,233
Output Tokens 5,026 6,687
Reasoning Tokens 8,185 305,927
Response Time (avg) 8.72s 87.48s
Response Time (max) 48.43s 618.49s
Response Time (total) 200.61s 2012.15s
Parameters ~2T total (~150B active) ~1.7T total (~170B active)
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#59 GPT-6 Sol

low
Cost
$0.018
Time
17.4s
Tokens
1,850 tok

#66 SpaceXAI: Grok 4.6

high
Cost
$0.107
Time
265.1s
Tokens
18,001 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-6 Sol 6.2 4.8 66.7% 2 8.74s 7,302 405 1,296
Grok 4.6 10.0 10.0 100.0% 0 102.20s 9,579 379 51,829

Quick Compare

Switch Comparison Pair

Seed 2.1 TurbomediumvsGPT-6 SollowGPT-6 SollowvsMiMo-V2.6-PromediumGPT-6 SollowvsQwen3.8 27BhighFree AvailableMuse Spark 1.3lowvsGrok 4.6highClaude Sonnet 5mediumvsGrok 4.6highQwen3.7 MaxmediumvsGrok 4.6highQwen3.8 Max (0902)lowvsGrok 4.6highDeepSeek V4.1 FlashmaxvsGPT-6 SollowClaude Haiku 5.5lowvsGrok 4.6highClaude Haiku 5.5maxvsGrok 4.6highClaude Sonnet 5.5highvsGPT-6 SollowMuse Spark 1.1lowvsGrok 4.6high