Navigate
Advertise here

Solar Pro 4 (high) vs Grok 4.20 (medium)

The average score is effectively tied at 6.3 vs 6.3. Solar Pro 4 (high) has the lower benchmark cost at $0.077 vs $1.246. Grok 4.20 (medium) is faster at 36.73s vs 128.91s, with pass rates of 60.9% vs 58.0%.

Last updated at: 2026-11-13

Compared models

Rank
#299
Total Output Tokens
402,203
Response Time (avg)
128.91s
Total Cost
$0.077
Rank
#307
Total Output Tokens
302,087
Response Time (avg)
36.73s
Total Cost
$1.246
Recommended model Solar Pro 4 (high)

It has the best score here (6.3), while costing about 16.2x less than Grok 4.20 (medium).

Detailed comparison

Metric Solar Pro 4 Solar Pro 4 high Release: 2026-08-11 Grok 4.20 Grok 4.20 medium Release: 2026-03-31
Score 6.3 6.3
Rank #299 #307
Reliability 10.0 10.0
Consistency 8.0 8.2
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 60.9% 58.0%
Flaky tests 6 5
Total Runs 69 69
Cost per result 0.652 14.374
Total Cost $0.077 $1.246
Input Price $0.090 / 1M $1.250 / 1M
Output Price $0.360 / 1M $2.500 / 1M
Cache Read Price $0.018 / 1M $0.200 / 1M
Cache Write Price N/A N/A
Total Input Tokens 209,002 392,127
Output Tokens 24,675 7,754
Reasoning Tokens 377,528 294,333
Response Time (avg) 128.91s 36.73s
Response Time (max) 491.07s 199.66s
Response Time (total) 2965.04s 844.68s
Parameters ~100B ~1T total (~100B active)
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#299 Solar Pro 4

high
No showcase result has been generated for this model yet.
Cost
N/A
Time
-
Tokens
0 tok

#307 SpaceXAI: Grok 4.20

medium
Cost
$0.041
Time
110.3s
Tokens
16,336 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Solar Pro 4 5.7 9.9 33.3% 0 244.73s 7,887 18,577 101,928
Grok 4.20 6.3 6.6 55.6% 1 109.93s 8,307 268 103,150

Switch Comparison Pair