- Rank
- #85
- Total Output Tokens
- 106,419
- Response Time (avg)
- 48.87s
- Total Cost
- $0.271
Seed-2.0-Lite (medium) vs Gemini 3.5 Flash (high)
Gemini 3.5 Flash (high) leads on average score with 8.3 vs 8.2. Seed-2.0-Lite (medium) has the lower benchmark cost at $0.271 vs $2.737. Gemini 3.5 Flash (high) is faster at 18.59s vs 48.87s, with pass rates of 71.0% vs 85.5%.
Compared models
- Rank
- #77
- Total Output Tokens
- 246,012
- Response Time (avg)
- 18.59s
- Total Cost
- $2.737
Recommended model
Seed-2.0-Lite (medium)
Its score stays close to the best score here (8.2 vs 8.3), while costing about 10.1x less than Gemini 3.5 Flash (high).
Detailed comparison
| Metric | Seed-2.0-Lite Seed-2.0-Lite medium | Gemini 3.5 Flash Gemini 3.5 Flash high |
|---|---|---|
| Score | 8.2 | 8.3 |
| Rank | #85 | #77 |
| Reliability | 10.0 | 10.0 |
| Consistency | 8.7 | 9.3 |
| Attempts | 69/69 | 69/69 |
| Tests Correct | ||
| Attempt pass rate | 71.0% | 85.5% |
| Flaky tests | 4 | 2 |
| Total Runs | 69 | 69 |
| Cost per result | 1.931 | 14.402 |
| Total Cost | $0.271 | $2.737 |
| Input Price | $0.250 / 1M | $1.500 / 1M |
| Output Price | $2.000 / 1M | $9.000 / 1M |
| Total Input Tokens | 229,530 | 348,103 |
| Output Tokens | 13,757 | 11,045 |
| Reasoning Tokens | 92,662 | 234,967 |
| Response Time (avg) | 48.87s | 18.59s |
| Response Time (max) | 254.92s | 145.92s |
| Response Time (total) | 1123.91s | 427.52s |
| Parameters | ~200B total (~20B active) | ~500B total (~20B active) |
| Availability | Closed | Closed |
Model generation showcase
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#85 Seed-2.0-Lite
medium- Cost
- $0.005
- Time
- 86.7s
- Tokens
- 2,354 tok
#77 Gemini 3.5 Flash
high- Cost
- $0.208
- Time
- 118.2s
- Tokens
- 23,158 tok
Top Models by Score
Score vs Total Cost
Response Time (avg)
Score vs Response Time (avg)
Total Output Tokens
Score vs Total Output Tokens
Category Breakdown
| Agentic | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Seed-2.0-Lite | 10.0 | 10.0 | 100.0% | 0 | 69.33s | 99,624 | 1,227 | 3,896 | |
| Gemini 3.5 Flash | 3.4 | 9.6 | 0.0% | 0 | 87.32s | 240,957 | 2,268 | 38,262 |
| Anti-AI Tricks | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Seed-2.0-Lite | 8.3 | 10.0 | 75.0% | 0 | 17.99s | 942 | 996 | 7,142 | |
| Gemini 3.5 Flash | 10.0 | 10.0 | 100.0% | 0 | 2.57s | 492 | 174 | 4,997 |
| Coding | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Seed-2.0-Lite | 8.0 | 9.8 | 66.7% | 0 | 156.74s | 8,247 | 458 | 31,890 | |
| Gemini 3.5 Flash | 10.0 | 10.0 | 100.0% | 0 | 22.96s | 8,118 | 456 | 47,129 |
| Combined | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Seed-2.0-Lite | 6.4 | 5.8 | 66.7% | 1 | 58.52s | 99,411 | 9,809 | 13,940 | |
| Gemini 3.5 Flash | 8.2 | 6.9 | 66.7% | 1 | 84.14s | 82,416 | 7,153 | 93,585 |
| Data parsing and extraction | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Seed-2.0-Lite | 10.0 | 10.0 | 100.0% | 0 | 9.07s | 8,562 | 246 | 1,742 | |
| Gemini 3.5 Flash | 10.0 | 10.0 | 100.0% | 0 | 6.43s | 7,548 | 279 | 8,466 |
| Domain specific | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Seed-2.0-Lite | 3.6 | 7.2 | 22.2% | 1 | 84.35s | 852 | 12 | 24,616 | |
| Gemini 3.5 Flash | 5.3 | 7.2 | 44.4% | 1 | 16.99s | 642 | 12 | 28,526 |
| General Intelligence | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Seed-2.0-Lite | 6.7 | 3.6 | 66.7% | 1 | 18.25s | 582 | 304 | 1,620 | |
| Gemini 3.5 Flash | 10.0 | 10.0 | 100.0% | 0 | 3.63s | 486 | 115 | 1,650 |
| Instructions following | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Seed-2.0-Lite | 10.0 | 10.0 | 100.0% | 0 | 7.26s | 834 | 71 | 1,480 | |
| Gemini 3.5 Flash | 10.0 | 10.0 | 100.0% | 0 | 3.35s | 615 | 70 | 3,799 |
| Puzzle Solving | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Seed-2.0-Lite | 9.0 | 7.9 | 88.9% | 1 | 10.23s | 894 | 403 | 3,285 | |
| Gemini 3.5 Flash | 10.0 | 10.0 | 100.0% | 0 | 3.23s | 558 | 241 | 4,940 |
| Tool Calling | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Seed-2.0-Lite | 10.0 | 10.0 | 100.0% | 0 | 12.38s | 9,306 | 222 | 1,011 | |
| Gemini 3.5 Flash | 9.8 | 10.0 | 100.0% | 0 | 4.96s | 6,115 | 265 | 1,608 |
| Trivia | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Seed-2.0-Lite | 3.0 | 10.0 | 0.0% | 0 | 48.32s | 276 | 9 | 2,040 | |
| Gemini 3.5 Flash | 10.0 | 10.0 | 100.0% | 0 | 3.94s | 156 | 12 | 2,005 |
Quick Compare
Switch Comparison Pair
Gemini 3.5 FlashhighvsKimi K3maxGemini 3.5 FlashhighvsGPT-6 LunamediumClaude Opus 4.8mediumvsGemini 3.5 FlashhighGemini 3.5 FlashhighvsQwen3.7 PlusmediumSeed-2.0-LitemediumvsGrok 4.5highGemini 3.5 FlashhighvsGLM 5.2mediumSeed-2.0-LitemediumvsDeepSeek V4 Pro 0423highGemini 3.5 FlashhighvsGPT-5.6 TerramediumSeed-2.0-LitemediumvsDeepSeek V4 Flash 0423highGemini 3.5 FlashhighvsMuse Glimmer 30BxhighGemini 3.5 FlashhighvsGPT-5 MinimediumGemini 3.5 FlashhighvsQwen3.8 2.4T A95Blow