Upstage
Release: 2026-08-11
Tested on: 2026-08-11 17:26
upstage/solar-pro4::xhigh
~100BDenseClosedEstimated
Summary
Solar Pro 4 scores 7.7 on AI BENCHY and ranks #63. It has 10.0 reliability, a 65.2% pass rate, $0.049 total cost, and 115.81s average response time.
What makes Solar Pro 4 unique: It stands out most in Combined, where it ranks #1, while Coding is its weakest area at #18. Its total benchmark cost is unusually low for its score range. It uses unusually many reasoning tokens, which can help explain its slower or more expensive runs.
Model facts
Researched on 2026-08-12
- Parameters
- ~100B
- Architecture
- Dense
- Availability
- Closed
- License
- -
Best estimate from public evidence; the vendor did not disclose every value. Vendor does not disclose the parameter count.
7.7
Consistency
9.4
10.0
$0.049
Total Output Tokens
379,812
Total Input Tokens
98,107
Input Price
$0.030 / 1M
Output Price
$0.120 / 1M
Cache Read Price
N/A
Cache Write Price
N/A
Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.
Flaky tests
2
Flaky tests had mixed outcomes across runs (at least one pass and one fail).
Run history
| Tested on | Score | Reliability | Tests Correct | Total Cost | Compare |
|---|---|---|---|---|---|
| 2026-08-14 03:59 Re-test | 7.6 | 10.0 | $0.050 | Compare | |
| 2026-08-11 17:26 Initial run | 7.7 | 10.0 | $0.049 | Current run |
Run comparison
| Run | Benchmark coverage | Score | Consistency | Reliability | Tests Correct | Flaky tests | Total Output Tokens | Total Input Tokens | Total Cost | Response Time (avg) |
|---|---|---|---|---|---|---|---|---|---|---|
| 2026-08-11 17:26 · Initial run | 66/66 attempts | 7.7 | 9.4 | 10.0 | 13/22 | 2 | 379,812 | 98,107 | $0.049 | 115.81s |
| 2026-08-14 03:59 · Re-test | 66/66 attempts | 7.6 | 9.4 | 10.0 | 12/22 | 2 | 389,450 | 98,116 | $0.050 | 134.85s |
| Difference | — | +0.1 | 0.0 | 0.0 | +1 | 0 | -9638 | -9 | -$0.002 | -19040ms |
These two runs used different benchmark suites, so the deltas reflect both model changes and suite changes.
Price History
Historical pricing data for this model from OpenRouter.
| Date | Input Price | Output Price | Cache Read Price | Cache Write Price |
|---|---|---|---|---|
| 2026-08-11 17:51 | $0.030 / 1M | $0.120 / 1M | N/A | N/A |
Charts
Choose the first model, then click a second model to open a side-by-side page.
Score vs Total Cost
Response Time (avg)
Score vs Response Time (avg)
Total Output Tokens
Score vs Total Output Tokens
Quick Compare
Solar Pro 4xhighvsSpace Bunny AlphamaxSolar Pro 4xhighvsGrok 4.7xhighSolar Pro 4xhighvsGPT-6 SolnoneSolar Pro 4xhighvsGrok Build 0.1mediumSolar Pro 4xhighvsMercury 2.5 PreviewmediumSolar Pro 4xhighvsGLM 5.3 FlashX LegallowSolar Pro 4xhighvsInklinglowFree AvailableSolar Pro 4xhighvsQwen3.5-FlashnoneSolar Pro 4xhighvsQwen3.5-FlashmediumSolar Pro 4xhighvsSolar Pro 4low
Category Breakdown
| Category | Score | Consistency | Tests Correct |
|---|---|---|---|
| Anti-AI Tricks | 8.3 | 10.0 | |
| Coding | 5.8 | 9.9 | |
| Combined | 10.0 | 10.0 | |
| Data parsing and extraction | 10.0 | 10.0 | |
| Domain specific | 5.3 | 10.0 | |
| General Intelligence | 5.5 | 10.0 | |
| Instructions following | 8.4 | 6.9 | |
| Puzzle Solving | 8.9 | 7.8 | |
| Tool Calling | 10.0 | 10.0 | |
| Trivia | 3.0 | 10.0 |