- Rank
- #124
- Total Output Tokens
- 590,551
- Response Time (avg)
- 34.81s
- Total Cost
- $0.000
Ernie 5.5 Flash Preview (high) vs Gemini 3.5 Flash (high)
The average score is effectively tied at 8.3 vs 8.3. Ernie 5.5 Flash Preview (high) has the lower benchmark cost at $0.000 vs $2.737. Gemini 3.5 Flash (high) is faster at 18.59s vs 34.81s, with pass rates of 82.6% vs 85.5%.
Compared models
- Rank
- #127
- Total Output Tokens
- 246,012
- Response Time (avg)
- 18.59s
- Total Cost
- $2.737
Recommended model
Gemini 3.5 Flash (high)
It has the best score here (8.3), while responding about 1.9x faster than Ernie 5.5 Flash Preview (high).
Detailed comparison
| Metric | Ernie 5.5 Flash Preview Ernie 5.5 Flash Preview high Free Available | Gemini 3.5 Flash Gemini 3.5 Flash high |
|---|---|---|
| Score | 8.3 | 8.3 |
| Rank | #124 | #127 |
| Reliability | 9.7 | 10.0 |
| Consistency | 8.6 | 9.3 |
| Attempts | 69/69 | 69/69 |
| Tests Correct | ||
| Attempt pass rate | 82.6% | 85.5% |
| Flaky tests | 4 | 2 |
| Total Runs | 69 | 69 |
| Cost per result | 0.000 | 14.402 |
| Total Cost | $0.000 | $2.737 |
| Input Price | $0.000 / 1M | $1.500 / 1M |
| Output Price | $0.000 / 1M | $9.000 / 1M |
| Cache Read Price | N/A | $0.150 / 1M |
| Cache Write Price | N/A | $0.084 / 1M |
| Total Input Tokens | 341,965 | 348,103 |
| Output Tokens | 7,959 | 11,045 |
| Reasoning Tokens | 582,592 | 234,967 |
| Response Time (avg) | 34.81s | 18.59s |
| Response Time (max) | 246.40s | 145.92s |
| Response Time (total) | 800.65s | 427.52s |
| Parameters | 280B total (14B active) | ~500B total (~20B active) |
| Availability | Closed | Closed |
Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.
Model generation showcase
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#124 Ernie 5.5 Flash Preview
high- Cost
- $0.000
- Time
- 68.0s
- Tokens
- 23,880 tok
#127 Gemini 3.5 Flash
high- Cost
- $0.208
- Time
- 118.2s
- Tokens
- 23,158 tok
Category Breakdown
| Agentic | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Ernie 5.5 Flash Preview | 6.4 | 3.8 | 33.3% | 1 | 63.99s | 203,096 | 1,496 | 14,885 | |
| Gemini 3.5 Flash | 3.4 | 9.6 | 0.0% | 0 | 87.32s | 240,957 | 2,268 | 38,262 |
| Anti-AI Tricks | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Ernie 5.5 Flash Preview | 10.0 | 10.0 | 100.0% | 0 | 1.66s | 837 | 270 | 2,141 | |
| Gemini 3.5 Flash | 10.0 | 10.0 | 100.0% | 0 | 2.57s | 492 | 174 | 4,997 |
| Coding | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Ernie 5.5 Flash Preview | 10.0 | 10.0 | 100.0% | 0 | 16.70s | 7,419 | 441 | 48,063 | |
| Gemini 3.5 Flash | 10.0 | 10.0 | 100.0% | 0 | 22.96s | 8,118 | 456 | 47,129 |
| Combined | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Ernie 5.5 Flash Preview | 10.0 | 10.0 | 100.0% | 0 | 38.20s | 112,948 | 4,156 | 54,091 | |
| Gemini 3.5 Flash | 8.2 | 6.9 | 66.7% | 1 | 84.14s | 82,416 | 7,153 | 93,585 |
| Data parsing and extraction | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Ernie 5.5 Flash Preview | 7.3 | 5.8 | 83.3% | 1 | 2.66s | 7,017 | 265 | 2,576 | |
| Gemini 3.5 Flash | 10.0 | 10.0 | 100.0% | 0 | 6.43s | 7,548 | 279 | 8,466 |
| Domain specific | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Ernie 5.5 Flash Preview | 3.5 | 4.4 | 33.3% | 2 | 193.25s | 870 | 226 | 454,767 | |
| Gemini 3.5 Flash | 5.3 | 7.2 | 44.4% | 1 | 16.99s | 642 | 12 | 28,526 |
| General Intelligence | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Ernie 5.5 Flash Preview | 10.0 | 10.0 | 100.0% | 0 | 4.60s | 543 | 265 | 2,168 | |
| Gemini 3.5 Flash | 10.0 | 10.0 | 100.0% | 0 | 3.63s | 486 | 115 | 1,650 |
| Instructions following | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Ernie 5.5 Flash Preview | 9.8 | 10.0 | 100.0% | 0 | 1.55s | 777 | 63 | 1,282 | |
| Gemini 3.5 Flash | 10.0 | 10.0 | 100.0% | 0 | 3.35s | 615 | 70 | 3,799 |
| Puzzle Solving | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Ernie 5.5 Flash Preview | 10.0 | 10.0 | 100.0% | 0 | 1.52s | 813 | 293 | 1,195 | |
| Gemini 3.5 Flash | 10.0 | 10.0 | 100.0% | 0 | 3.23s | 558 | 241 | 4,940 |
| Tool Calling | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Ernie 5.5 Flash Preview | 10.0 | 10.0 | 100.0% | 0 | 4.19s | 7,390 | 224 | 674 | |
| Gemini 3.5 Flash | 9.8 | 10.0 | 100.0% | 0 | 4.96s | 6,115 | 265 | 1,608 |
| Trivia | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Ernie 5.5 Flash Preview | 3.0 | 10.0 | 0.0% | 0 | 2.01s | 255 | 260 | 750 | |
| Gemini 3.5 Flash | 10.0 | 10.0 | 100.0% | 0 | 3.94s | 156 | 12 | 2,005 |
Quick Compare
Switch Comparison Pair
Gemini 3.5 FlashhighvsKimi K3maxErnie 5.5 Flash PreviewhighFree AvailablevsParticle-1minimalGemini 3.5 FlashhighvsGPT-6 LunamediumClaude Opus 4.8mediumvsGemini 3.5 FlashhighErnie 5.5 Flash PreviewhighFree AvailablevsKimi K3maxGemini 3.5 FlashhighvsParticle-1minimalGemini 3.5 FlashhighvsLing 3.1 FlashmediumGemini 3.5 FlashhighvsQwen3.7 PlusmediumDeepSeek V4.1 Flash 1017maxvsGemini 3.5 FlashhighErnie 5.5 Flash PreviewhighFree AvailablevsGemini 3.1 Pro PreviewmediumGemini 3.5 FlashhighvsGLM 5.2mediumErnie 5.5 Flash PreviewhighFree AvailablevsGPT-6 Lunamedium