Upstage
Release: 2026-08-11
Tested on: 2026-08-11 16:35
upstage/solar-pro4::high
Summary
Solar Pro 4 scores 7.2 on AI BENCHY and ranks #94. It has 9.9 reliability, a 63.6% pass rate, $0.045 total cost, and 100.28s average response time.
What makes Solar Pro 4 unique: It stands out most in Domain specific, where it ranks #1, while Instructions following is its weakest area at #15. Its total benchmark cost is unusually low for its score range.
7.2
Consistency
8.7
9.9
$0.045
Total Output Tokens
353,055
Total Input Tokens
79,731
Input Price
$0.030 / 1M
Output Price
$0.120 / 1M
Flaky tests
4
Flaky tests had mixed outcomes across runs (at least one pass and one fail).
Price History
Historical pricing data for this model from OpenRouter.
| Date | Input Price | Output Price |
|---|---|---|
| 2026-08-11 17:51 | $0.030 / 1M | $0.120 / 1M |
Charts
Choose the first model, then click a second model to open a side-by-side page.
Score vs Total Cost
Response Time (avg)
Score vs Response Time (avg)
Total Output Tokens
Score vs Total Output Tokens
Quick Compare
Solar Pro 4highvsMuse Glimmer 30BmediumSolar Pro 4highvsQwen3.5 Plus 2026-04-20mediumSolar Pro 4highvsKAT-Coder-Pro V2.5highSolar Pro 4highvsQwen3.7 PlusnoneSolar Pro 4highvsKimi K2.6mediumSolar Pro 4highvsQwen3.5-122B-A10BmediumSolar Pro 4highvsStep 3.7 FlashlowSolar Pro 4highvsGrok 4.3mediumSolar Pro 4highvsClaude Opus 4.8noneSolar Pro 4highvsMuse Glimmer 30Blow
Category Breakdown
| Category | Score | Consistency | Tests Correct |
|---|---|---|---|
| Anti-AI Tricks | 8.7 | 7.9 | |
| Coding | 5.7 | 9.9 | |
| Combined | 7.3 | 5.8 | |
| Data parsing and extraction | 10.0 | 10.0 | |
| Domain specific | 5.3 | 10.0 | |
| General Intelligence | 5.5 | 10.0 | |
| Instructions following | 7.9 | 6.9 | |
| Puzzle Solving | 8.7 | 7.9 | |
| Tool Calling | 10.0 | 10.0 | |
| Trivia | 3.0 | 10.0 |