Upstage
Release: 2026-08-11
Tested on: 2026-08-11 16:48
upstage/solar-pro4::medium
~100BDenseClosedEstimated
Summary
Solar Pro 4 scores 6.9 on AI BENCHY and ranks #108. It has 9.8 reliability, a 66.7% pass rate, $0.046 total cost, and 114.27s average response time.
What makes Solar Pro 4 unique: It stands out most in Domain specific, where it ranks #1, while General Intelligence is its weakest area at #17. Its total benchmark cost is unusually low for its score range.
Model facts
Researched on 2026-08-12
- Parameters
- ~100B
- Architecture
- Dense
- Availability
- Closed
- License
- -
Best estimate from public evidence; the vendor did not disclose every value. Vendor does not disclose the parameter count.
6.9
Consistency
8.6
9.8
$0.046
Total Output Tokens
359,862
Total Input Tokens
87,984
Input Price
$0.030 / 1M
Output Price
$0.120 / 1M
Flaky tests
4
Flaky tests had mixed outcomes across runs (at least one pass and one fail).
Run history
| Tested on | Score | Reliability | Tests Correct | Total Cost | Compare |
|---|---|---|---|---|---|
| 2026-08-14 04:00 Re-test | 6.8 | 9.9 | $0.047 | Compare | |
| 2026-08-11 16:48 Initial run | 6.9 | 9.8 | $0.046 | Current run |
Charts
Choose the first model, then click a second model to open a side-by-side page.
Score vs Total Cost
Response Time (avg)
Score vs Response Time (avg)
Total Output Tokens
Score vs Total Output Tokens
Quick Compare
Solar Pro 4mediumvsSolar Pro 4lowSolar Pro 4mediumvsDeepSeek V4 PrononeSolar Pro 4mediumvsGLM 5.3 FlashXhighSolar Pro 4mediumvsGLM 5.3lowSolar Pro 4mediumvsSeed-2.0-CodemediumSolar Pro 4mediumvsMiMo-V2.5-PromediumSolar Pro 4mediumvsStep 3.7 FlashhighSolar Pro 4mediumvsMercury 2.5mediumSolar Pro 4mediumvsQwen3.6 FlashmediumSolar Pro 4mediumvsGemini 3 Flash Previewnone
Category Breakdown
| Category | Score | Consistency | Tests Correct |
|---|---|---|---|
| Anti-AI Tricks | 8.2 | 7.9 | |
| Coding | 5.5 | 7.4 | |
| Combined | 6.4 | 5.8 | |
| Data parsing and extraction | 10.0 | 10.0 | |
| Domain specific | 5.3 | 10.0 | |
| General Intelligence | 3.0 | 10.0 | |
| Instructions following | 9.8 | 10.0 | |
| Puzzle Solving | 9.0 | 7.9 | |
| Tool Calling | 10.0 | 10.0 | |
| Trivia | 3.0 | 10.0 |