- Rank
- #296
- Total Output Tokens
- 438,891
- Response Time (avg)
- 19.04s
- Total Cost
- $0.736
Gemini 3.1 Flash Lite Preview (low) vs Solar Pro 4 (high)
The average score is effectively tied at 6.3 vs 6.3. Solar Pro 4 (high) has the lower benchmark cost at $0.077 vs $0.736. Gemini 3.1 Flash Lite Preview (low) is faster at 19.04s vs 128.91s, with pass rates of 60.9% vs 60.9%.
Compared models
- Rank
- #299
- Total Output Tokens
- 402,203
- Response Time (avg)
- 128.91s
- Total Cost
- $0.077
Recommended model
Solar Pro 4 (high)
It has the best score here (6.3), while costing about 9.6x less than Gemini 3.1 Flash Lite Preview (low).
Detailed comparison
| Metric | Gemini 3.1 Flash Lite Preview Gemini 3.1 Flash Lite Preview low | Solar Pro 4 Solar Pro 4 high |
|---|---|---|
| Score | 6.3 | 6.3 |
| Rank | #296 | #299 |
| Reliability | 10.0 | 10.0 |
| Consistency | 10.0 | 8.0 |
| Attempts | 69/69 | 69/69 |
| Tests Correct | ||
| Attempt pass rate | 60.9% | 60.9% |
| Flaky tests | 0 | 6 |
| Total Runs | 69 | 69 |
| Cost per result | 5.256 | 0.652 |
| Total Cost | $0.736 | $0.077 |
| Input Price | $0.250 / 1M | $0.090 / 1M |
| Output Price | $1.500 / 1M | $0.360 / 1M |
| Cache Read Price | $0.025 / 1M | $0.018 / 1M |
| Cache Write Price | $0.084 / 1M | N/A |
| Total Input Tokens | 309,715 | 209,002 |
| Output Tokens | 16,170 | 24,675 |
| Reasoning Tokens | 422,721 | 377,528 |
| Response Time (avg) | 19.04s | 128.91s |
| Response Time (max) | 309.35s | 491.07s |
| Response Time (total) | 437.98s | 2965.04s |
| Parameters | ~150B total (~10B active) | ~100B |
| Availability | Closed | Closed |
Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.
Model generation showcase
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#296 Gemini 3.1 Flash Lite Preview
low- Cost
- $0.002
- Time
- 3.7s
- Tokens
- 1,203 tok
#299 Solar Pro 4
high
No showcase result has been generated for this model yet.
- Cost
- N/A
- Time
- -
- Tokens
- 0 tok
Category Breakdown
| Agentic | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.1 Flash Lite Preview | 5.0 | 10.0 | 0.0% | 0 | 71.29s | 199,519 | 1,453 | 25,259 | |
| Solar Pro 4 | 2.8 | 1.6 | 33.3% | 1 | 312.27s | 129,262 | 1,318 | 37,691 |
| Anti-AI Tricks | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.1 Flash Lite Preview | 8.3 | 10.0 | 75.0% | 0 | 2.12s | 506 | 462 | 1,638 | |
| Solar Pro 4 | 8.7 | 7.9 | 91.7% | 1 | 58.83s | 1,104 | 313 | 40,629 |
| Coding | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.1 Flash Lite Preview | 5.5 | 10.0 | 33.3% | 0 | 1.39s | 8,138 | 660 | 1,060 | |
| Solar Pro 4 | 5.7 | 9.9 | 33.3% | 0 | 244.73s | 7,887 | 18,577 | 101,928 |
| Combined | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.1 Flash Lite Preview | 3.0 | 10.0 | 0.0% | 0 | 160.63s | 85,851 | 12,656 | 389,079 | |
| Solar Pro 4 | 7.3 | 5.8 | 83.3% | 1 | 167.40s | 51,594 | 3,394 | 37,597 |
| Data parsing and extraction | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.1 Flash Lite Preview | 10.0 | 10.0 | 100.0% | 0 | 3.00s | 7,455 | 291 | 696 | |
| Solar Pro 4 | 10.0 | 10.0 | 100.0% | 0 | 62.46s | 7,575 | 252 | 22,209 |
| Domain specific | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.1 Flash Lite Preview | 7.7 | 10.0 | 66.7% | 0 | 2.10s | 652 | 18 | 1,191 | |
| Solar Pro 4 | 3.6 | 7.2 | 22.2% | 1 | 280.84s | 1,098 | 37 | 79,201 |
| General Intelligence | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.1 Flash Lite Preview | 4.0 | 10.0 | 0.0% | 0 | 1.54s | 490 | 69 | 384 | |
| Solar Pro 4 | 5.5 | 10.0 | 0.0% | 0 | 42.22s | 609 | 123 | 7,474 |
| Instructions following | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.1 Flash Lite Preview | 10.0 | 10.0 | 100.0% | 0 | 1.49s | 621 | 72 | 753 | |
| Solar Pro 4 | 7.9 | 6.9 | 66.7% | 1 | 41.51s | 909 | 75 | 13,182 |
| Puzzle Solving | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.1 Flash Lite Preview | 10.0 | 10.0 | 100.0% | 0 | 1.69s | 566 | 243 | 1,248 | |
| Solar Pro 4 | 8.7 | 7.9 | 77.8% | 1 | 55.22s | 1,017 | 345 | 23,424 |
| Tool Calling | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.1 Flash Lite Preview | 10.0 | 10.0 | 100.0% | 0 | 9.54s | 5,757 | 237 | 993 | |
| Solar Pro 4 | 10.0 | 10.0 | 100.0% | 0 | 8.96s | 7,620 | 225 | 770 |
| Trivia | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.1 Flash Lite Preview | 3.0 | 10.0 | 0.0% | 0 | 1.35s | 160 | 9 | 420 | |
| Solar Pro 4 | 3.0 | 10.0 | 0.0% | 0 | 81.13s | 327 | 16 | 13,423 |
Quick Compare
Switch Comparison Pair
Qwen3.5 Plus 2026-02-15nonevsSolar Pro 4highGemini 3.1 Flash LitelowvsSolar Pro 4highLing 3.1 FlashlowvsSolar Pro 4highGemini 3.1 Flash Lite PreviewlowvsMinimax M3.1 FlashmediumFree AvailableMinimax M3.1 FlashmediumFree AvailablevsSolar Pro 4highGemini 3.1 Flash Lite PreviewlowvsQwen3.6 27BnoneGemini 3.1 Flash Lite PreviewlowvsQwen3.5 Plus 2026-02-15noneGemini 3.1 Flash Lite PreviewlowvsQwen3.5-35B-A3BmediumSpace Bunny AlphamediumvsSolar Pro 4highGemini 3.5 Flash LitelowvsSolar Pro 4highGemini 3.1 Flash Lite PreviewlowvsLongCat 2.0noneDeepSeek V3.2mediumvsSolar Pro 4high