- Rank
- #48
- Total Output Tokens
- 219,926
- Response Time (avg)
- 11.92s
- Total Cost
- $0.624
Gemini 3.5 Flash Lite (high) vs Muse Spark Open (xhigh)
Muse Spark Open (xhigh) leads on average score with 9.0 vs 9.0. Gemini 3.5 Flash Lite (high) has the lower benchmark cost at $0.624 vs $2.081. Gemini 3.5 Flash Lite (high) is faster at 11.92s vs 92.38s, with pass rates of 84.1% vs 81.2%.
Compared models
- Rank
- #44
- Total Output Tokens
- 409,641
- Response Time (avg)
- 92.38s
- Total Cost
- $2.081
Recommended model
Gemini 3.5 Flash Lite (high)
Its score stays close to the best score here (9.0 vs 9.0), while costing about 3.3x less than Muse Spark Open (xhigh).
Detailed comparison
| Metric | Gemini 3.5 Flash Lite Gemini 3.5 Flash Lite high | Muse Spark Open Muse Spark Open xhigh |
|---|---|---|
| Score | 9.0 | 9.0 |
| Rank | #48 | #44 |
| Reliability | 10.0 | 9.6 |
| Consistency | 9.3 | 8.3 |
| Attempts | 69/69 | 69/69 |
| Tests Correct | ||
| Attempt pass rate | 84.1% | 81.2% |
| Flaky tests | 2 | 5 |
| Total Runs | 69 | 69 |
| Cost per result | 3.463 | 13.001 |
| Total Cost | $0.624 | $2.081 |
| Input Price | $0.300 / 1M | $1.250 / 1M |
| Output Price | $2.500 / 1M | $4.250 / 1M |
| Cache Read Price | $0.030 / 1M | $0.150 / 1M |
| Cache Write Price | $0.084 / 1M | N/A |
| Total Input Tokens | 244,529 | 271,242 |
| Output Tokens | 6,784 | 11,803 |
| Reasoning Tokens | 213,142 | 397,838 |
| Response Time (avg) | 11.92s | 92.38s |
| Response Time (max) | 53.09s | 482.30s |
| Response Time (total) | 274.14s | 2124.67s |
| Parameters | ~150B total (~10B active) | 816B total (42B active) |
| Availability | Closed | Weights available |
Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.
Model generation showcase
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#48 Gemini 3.5 Flash Lite
high- Cost
- $0.025
- Time
- 36.8s
- Tokens
- 9,964 tok
#44 Muse Spark Open
xhigh- Cost
- $0.049
- Time
- 244.5s
- Tokens
- 11,567 tok
Category Breakdown
| Agentic | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash Lite | 10.0 | 10.0 | 100.0% | 0 | 53.09s | 151,483 | 900 | 14,401 | |
| Muse Spark Open | 10.0 | 10.0 | 100.0% | 0 | 84.28s | 163,040 | 3,187 | 7,548 |
| Anti-AI Tricks | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash Lite | 10.0 | 10.0 | 100.0% | 0 | 2.96s | 498 | 142 | 7,917 | |
| Muse Spark Open | 8.7 | 7.9 | 91.7% | 1 | 20.08s | 2,219 | 575 | 7,718 |
| Coding | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash Lite | 8.4 | 7.4 | 88.9% | 1 | 16.58s | 8,130 | 434 | 57,369 | |
| Muse Spark Open | 10.0 | 10.0 | 100.0% | 0 | 51.43s | 8,478 | 1,796 | 53,029 |
| Combined | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash Lite | 9.9 | 10.0 | 100.0% | 0 | 27.90s | 68,427 | 4,360 | 52,993 | |
| Muse Spark Open | 10.0 | 10.0 | 100.0% | 0 | 133.96s | 71,468 | 4,663 | 49,355 |
| Data parsing and extraction | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash Lite | 10.0 | 10.0 | 100.0% | 0 | 3.17s | 7,362 | 279 | 5,636 | |
| Muse Spark Open | 10.0 | 10.0 | 100.0% | 0 | 16.36s | 7,767 | 229 | 3,876 |
| Domain specific | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash Lite | 3.6 | 7.2 | 22.2% | 1 | 23.14s | 656 | 17 | 54,566 | |
| Muse Spark Open | 2.9 | 4.4 | 22.2% | 2 | 341.54s | 1,277 | 58 | 215,539 |
| General Intelligence | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash Lite | 10.0 | 10.0 | 100.0% | 0 | 3.10s | 488 | 81 | 2,124 | |
| Muse Spark Open | 6.5 | 3.4 | 66.7% | 1 | 7.26s | 879 | 140 | 4,172 |
| Instructions following | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash Lite | 9.8 | 10.0 | 100.0% | 0 | 2.16s | 625 | 69 | 3,513 | |
| Muse Spark Open | 10.0 | 10.0 | 100.0% | 0 | 23.45s | 1,467 | 105 | 5,478 |
| Puzzle Solving | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash Lite | 10.0 | 10.0 | 100.0% | 0 | 2.09s | 572 | 183 | 4,004 | |
| Muse Spark Open | 8.2 | 7.2 | 88.9% | 1 | 112.47s | 1,711 | 386 | 39,934 |
| Tool Calling | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash Lite | 10.0 | 10.0 | 100.0% | 0 | 4.55s | 6,132 | 310 | 2,955 | |
| Muse Spark Open | 10.0 | 10.0 | 100.0% | 0 | 5.06s | 12,354 | 261 | 986 |
| Trivia | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash Lite | 3.0 | 10.0 | 0.0% | 0 | 9.68s | 156 | 9 | 7,664 | |
| Muse Spark Open | 3.0 | 10.0 | 0.0% | 0 | 83.89s | 582 | 403 | 10,203 |
Quick Compare
Switch Comparison Pair
Gemini 3.5 Flash LitehighvsMuse Spark 1.3mediumClaude Opus 5lowvsGemini 3.5 Flash LitehighGemini 3.5 FlashlowvsMuse Spark OpenxhighGemini 3.5 Flash LitehighvsGLM 5.3 FlashmaxGemini 3.5 Flash LitehighvsQwen3.8 Max (0902)mediumMuse Spark OpenxhighvsQwen3.8 Max (0902)mediumGemini 3.5 Flash LitehighvsMuse Spark OpenlowSeed 2.1 TurbohighvsMuse Spark OpenxhighMuse Spark OpenxhighvsParetodefaultMuse Spark OpenxhighvsGPT-5.3-CodexmediumMuse Spark OpenxhighvsQwen3.8 Max (0902)highGemini 4 ArgonmediumvsMuse Spark Openxhigh