Navigate
Advertise here

GPT 5.3 Chat (default) vs Solar Pro 4 (low)

The average score is effectively tied at 6.7 vs 6.7. Solar Pro 4 (low) has the lower benchmark cost at $0.101 vs $0.533. GPT 5.3 Chat (default) is faster at 6.31s vs 145.21s, with pass rates of 62.3% vs 60.9%.

Last updated at: 2026-11-13

Compared models

Rank
#255
Total Output Tokens
28,179
Response Time (avg)
6.31s
Total Cost
$0.533
Rank
#251
Total Output Tokens
385,862
Response Time (avg)
145.21s
Total Cost
$0.101
Recommended model GPT 5.3 Chat (default)

It has the best score here (6.7), while responding about 23.0x faster than Solar Pro 4 (low).

Detailed comparison

Metric GPT 5.3 Chat GPT 5.3 Chat default Release: 2026-03-03 Solar Pro 4 Solar Pro 4 low Release: 2026-08-11
Score 6.7 6.7
Rank #255 #251
Reliability 10.0 10.0
Consistency 8.6 7.7
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 62.3% 60.9%
Flaky tests 4 7
Total Runs 69 69
Cost per result 4.097 0.791
Total Cost $0.533 $0.101
Input Price $1.750 / 1M $0.090 / 1M
Output Price $14.000 / 1M $0.360 / 1M
Cache Read Price N/A $0.018 / 1M
Cache Write Price N/A N/A
Total Input Tokens 78,846 384,974
Output Tokens 7,635 13,946
Reasoning Tokens 20,544 371,916
Response Time (avg) 6.31s 145.21s
Response Time (max) 18.33s 640.89s
Response Time (total) 138.73s 3339.87s
Parameters ~400B total (~17B active) ~100B
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#255 GPT 5.3 Chat

default
Cost
$0.008
Time
8.1s
Tokens
634 tok

#251 Solar Pro 4

low
No showcase result has been generated for this model yet.
Cost
N/A
Time
-
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT 5.3 Chat 5.6 4.7 55.6% 2 10.52s 7,302 808 5,824
Solar Pro 4 5.5 7.4 44.4% 1 259.63s 6,033 515 76,894

Switch Comparison Pair