Navigate
Advertise here

Solar Pro 4 (xhigh) vs Grok Build 0.1 (medium)

The average score is effectively tied at 6.7 vs 6.7. Solar Pro 4 (xhigh) has the lower benchmark cost at $0.067 vs $1.419. Grok Build 0.1 (medium) is faster at 55.13s vs 142.76s, with pass rates of 58.0% vs 58.0%.

Last updated at: 2026-11-13

Compared models

Rank
#246
Total Output Tokens
424,490
Response Time (avg)
142.76s
Total Cost
$0.067
Rank
#248
Total Output Tokens
529,806
Response Time (avg)
55.13s
Total Cost
$1.419
Recommended model Solar Pro 4 (xhigh)

It has the best score here (6.7), while costing about 21.2x less than Grok Build 0.1 (medium).

Detailed comparison

Metric Solar Pro 4 Solar Pro 4 xhigh Release: 2026-08-11 Grok Build 0.1 Grok Build 0.1 medium Release: 2026-05-21
Score 6.7 6.7
Rank #246 #248
Reliability 9.9 10.0
Consistency 9.4 9.6
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 58.0% 58.0%
Flaky tests 2 1
Total Runs 69 69
Cost per result 0.559 10.910
Total Cost $0.067 $1.419
Input Price $0.090 / 1M $1.000 / 1M
Output Price $0.360 / 1M $2.000 / 1M
Cache Read Price $0.018 / 1M $0.200 / 1M
Cache Write Price N/A N/A
Total Input Tokens 150,033 358,616
Output Tokens 22,347 9,651
Reasoning Tokens 402,143 520,155
Response Time (avg) 142.76s 55.13s
Response Time (max) 491.42s 252.69s
Response Time (total) 3283.43s 1268.10s
Parameters ~100B ~300B total (~30B active)
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#246 Solar Pro 4

xhigh
No showcase result has been generated for this model yet.
Cost
N/A
Time
-
Tokens
0 tok

#248 SpaceXAI: Grok Build 0.1

medium
Cost
$0.028
Time
81.3s
Tokens
14,009 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Solar Pro 4 5.8 9.9 33.3% 0 292.21s 7,887 15,575 115,426
Grok Build 0.1 5.7 9.7 33.3% 0 108.46s 8,304 1,138 161,452

Switch Comparison Pair