- Score
- 7.5 (+1.23 points)
- Total Cost (Current Price)
- $0.000 · 100.0% cheaper
- Response Time (avg)
- 29.38s · 77.2% faster
Upstage
Release: 2026-08-11
Tested on: 2026-10-01 03:28
upstage/solar-pro4::high
~100BDenseClosedEstimated
Summary
Solar Pro 4 scores 6.3 on AI BENCHY and ranks #286. It has 10.0 reliability, a 60.9% pass rate, $0.077 total cost, and 128.91s average response time.
What makes Solar Pro 4 unique: It stands out most in Combined, where it ranks #2, while Agentic is its weakest area at #16.
Recommended alternatives
We recommend choosing one of these models instead:
- Score
- 8.6 (+2.27 points)
- Total Cost (Current Price)
- $0.061 · 21.1% cheaper
- Response Time (avg)
- 7.51s · 94.2% faster
- Score
- 6.8 (+0.50 points)
- Total Cost (Current Price)
- $0.039 · 49.9% cheaper
- Response Time (avg)
- 6.66s · 94.8% faster
Model facts
Researched on 2026-08-12
- Parameters
- ~100B
- Architecture
- Dense
- Availability
- Closed
- License
- -
Best estimate from public evidence; the vendor did not disclose every value. Vendor does not disclose the parameter count.
6.3
Consistency
8.0
10.0
Total Output Tokens
402,203
Total Input Tokens
209,002
Input Price
$0.090 / 1M
Output Price
$0.360 / 1M
Cache Read Price
$0.018 / 1M
Cache Write Price
N/A
Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.
Flaky tests
6
Flaky tests had mixed outcomes across runs (at least one pass and one fail).
Run history
| Tested on | Score | Reliability | Tests Correct | Total Cost | Compare |
|---|---|---|---|---|---|
| 2026-10-01 03:28 Re-test | 6.3 | 10.0 | $0.077 ↑ | Current run | |
| 2026-08-11 16:35 Initial run | 7.2 | 9.9 | $0.045 | Compare |
This run used a different benchmark suite. Keep suite changes in mind when reading historical movement.
Price History
Historical pricing data for this model from OpenRouter.
| Date | Input Price | Output Price | Cache Read Price | Cache Write Price |
|---|---|---|---|---|
| 2026-08-14 12:51 | $0.030 / 1M | $0.120 / 1M | N/A | N/A |
| 2026-10-01 18:33 | $0.090 / 1M | $0.360 / 1M | $0.018 / 1M | N/A |
Charts
Choose the first model, then click a second model to open a side-by-side page.
Top Models by Score
Score vs Total Cost
Response Time (avg)
Score vs Response Time (avg)
Total Output Tokens
Score vs Total Output Tokens
Quick Compare
Solar Pro 4highvsGemini 3.1 Flash LitelowSolar Pro 4highvsQwen3.5 Plus 2026-02-15noneSolar Pro 4highvsMinimax M3.1 FlashmediumFree AvailableSolar Pro 4highvsLing 3.1 FlashlowSolar Pro 4highvsGemini 3.1 Flash Lite PreviewlowSolar Pro 4highvsSpace Bunny AlphamediumSolar Pro 4highvsGemini 3.5 Flash LitelowSolar Pro 4highvsDeepSeek V3.2mediumSolar Pro 4highvsQwen3.6 27BnoneSolar Pro 4highvsTrinity Large Thinkinglow
Category Breakdown
| Category | Score | Consistency | Tests Correct |
|---|---|---|---|
| Agentic | 2.8 | 1.6 | |
| Anti-AI Tricks | 8.7 | 7.9 | |
| Coding | 5.7 | 9.9 | |
| Combined | 7.3 | 5.8 | |
| Data parsing and extraction | 10.0 | 10.0 | |
| Domain specific | 3.6 | 7.2 | |
| General Intelligence | 5.5 | 10.0 | |
| Instructions following | 7.9 | 6.9 | |
| Puzzle Solving | 8.7 | 7.9 | |
| Tool Calling | 10.0 | 10.0 | |
| Trivia | 3.0 | 10.0 |