- Rank
- #48
- Total Output Tokens
- 219,926
- Response Time (avg)
- 11.92s
- Total Cost
- $0.624
Gemini 3.5 Flash Lite (high) vs Muse Spark Open (low)
The average score is effectively tied at 9.0 vs 8.9. Muse Spark Open (low) has the lower benchmark cost at $0.600 vs $0.624. Gemini 3.5 Flash Lite (high) is faster at 11.92s vs 21.62s, with pass rates of 84.1% vs 76.8%.
Compared models
- Rank
- #53
- Total Output Tokens
- 59,058
- Response Time (avg)
- 21.62s
- Total Cost
- $0.600
Recommended model
Gemini 3.5 Flash Lite (high)
It has the best score here (9.0), while responding about 1.8x faster than Muse Spark Open (low).
Detailed comparison
| Metric | Gemini 3.5 Flash Lite Gemini 3.5 Flash Lite high | Muse Spark Open Muse Spark Open low |
|---|---|---|
| Score | 9.0 | 8.9 |
| Rank | #48 | #53 |
| Reliability | 10.0 | 9.9 |
| Consistency | 9.3 | 9.1 |
| Attempts | 69/69 | 69/69 |
| Tests Correct | ||
| Attempt pass rate | 84.1% | 76.8% |
| Flaky tests | 2 | 3 |
| Total Runs | 69 | 69 |
| Cost per result | 3.463 | 3.746 |
| Total Cost | $0.624 | $0.600 |
| Input Price | $0.300 / 1M | $1.250 / 1M |
| Output Price | $2.500 / 1M | $4.250 / 1M |
| Cache Read Price | $0.030 / 1M | $0.150 / 1M |
| Cache Write Price | $0.084 / 1M | N/A |
| Total Input Tokens | 244,529 | 278,684 |
| Output Tokens | 6,784 | 10,151 |
| Reasoning Tokens | 213,142 | 48,907 |
| Response Time (avg) | 11.92s | 21.62s |
| Response Time (max) | 53.09s | 119.16s |
| Response Time (total) | 274.14s | 497.25s |
| Parameters | ~150B total (~10B active) | 816B total (42B active) |
| Availability | Closed | Weights available |
Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.
Model generation showcase
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#48 Gemini 3.5 Flash Lite
high- Cost
- $0.025
- Time
- 36.8s
- Tokens
- 9,964 tok
#53 Muse Spark Open
low- Cost
- $0.014
- Time
- 38.9s
- Tokens
- 3,372 tok
Category Breakdown
| Agentic | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash Lite | 10.0 | 10.0 | 100.0% | 0 | 53.09s | 151,483 | 900 | 14,401 | |
| Muse Spark Open | 10.0 | 10.0 | 100.0% | 0 | 55.04s | 135,775 | 2,192 | 1,792 |
| Anti-AI Tricks | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash Lite | 10.0 | 10.0 | 100.0% | 0 | 2.96s | 498 | 142 | 7,917 | |
| Muse Spark Open | 9.2 | 8.4 | 91.7% | 1 | 10.50s | 2,218 | 600 | 4,374 |
| Coding | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash Lite | 8.4 | 7.4 | 88.9% | 1 | 16.58s | 8,130 | 434 | 57,369 | |
| Muse Spark Open | 10.0 | 10.0 | 100.0% | 0 | 9.97s | 8,479 | 347 | 10,835 |
| Combined | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash Lite | 9.9 | 10.0 | 100.0% | 0 | 27.90s | 68,427 | 4,360 | 52,993 | |
| Muse Spark Open | 8.4 | 10.0 | 50.0% | 0 | 32.84s | 105,334 | 5,543 | 3,978 |
| Data parsing and extraction | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash Lite | 10.0 | 10.0 | 100.0% | 0 | 3.17s | 7,362 | 279 | 5,636 | |
| Muse Spark Open | 10.0 | 10.0 | 100.0% | 0 | 4.53s | 7,989 | 220 | 1,070 |
| Domain specific | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash Lite | 3.6 | 7.2 | 22.2% | 1 | 23.14s | 656 | 17 | 54,566 | |
| Muse Spark Open | 5.3 | 10.0 | 33.3% | 0 | 75.55s | 1,759 | 75 | 16,620 |
| General Intelligence | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash Lite | 10.0 | 10.0 | 100.0% | 0 | 3.10s | 488 | 81 | 2,124 | |
| Muse Spark Open | 6.1 | 3.1 | 66.7% | 1 | 5.85s | 877 | 137 | 1,576 |
| Instructions following | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash Lite | 9.8 | 10.0 | 100.0% | 0 | 2.16s | 625 | 69 | 3,513 | |
| Muse Spark Open | 8.0 | 6.8 | 66.7% | 1 | 10.26s | 1,467 | 99 | 2,323 |
| Puzzle Solving | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash Lite | 10.0 | 10.0 | 100.0% | 0 | 2.09s | 572 | 183 | 4,004 | |
| Muse Spark Open | 10.0 | 10.0 | 100.0% | 0 | 7.99s | 1,849 | 417 | 3,579 |
| Tool Calling | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash Lite | 10.0 | 10.0 | 100.0% | 0 | 4.55s | 6,132 | 310 | 2,955 | |
| Muse Spark Open | 10.0 | 10.0 | 100.0% | 0 | 4.37s | 12,354 | 417 | 626 |
| Trivia | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.5 Flash Lite | 3.0 | 10.0 | 0.0% | 0 | 9.68s | 156 | 9 | 7,664 | |
| Muse Spark Open | 3.0 | 10.0 | 0.0% | 0 | 14.23s | 583 | 104 | 2,134 |
Quick Compare
Switch Comparison Pair
Gemini 3.5 Flash LitehighvsMuse Spark 1.3mediumClaude Opus 5lowvsGemini 3.5 Flash LitehighMuse Spark OpenlowvsGLM 5.3 FlashmaxGemini 3.5 Flash LitehighvsGLM 5.3 FlashmaxGemini 4 ArgonmediumvsMuse Spark OpenlowGemini 3.5 Flash LitehighvsQwen3.8 Max (0902)mediumClaude Fable 5mediumvsMuse Spark OpenlowMuse Spark OpenlowvsPareto 26.9defaultGemini 3.5 Flash LitehighvsMuse Spark OpenxhighMuse Spark OpenlowvsQwen3.8 Max (0902)mediumGemini 3.5 Flash LitehighvsMuse Spark 1.2mediumGemini 3.5 Flash LitehighvsMuse Spark 1.1medium