- Rank
- #124
- Total Output Tokens
- 590,551
- Response Time (avg)
- 34.81s
- Total Cost
- $0.000
Ernie 5.5 Flash Preview (high) vs Gemini 3.1 Pro Preview (medium)
Gemini 3.1 Pro Preview (medium) leads on average score with 8.4 vs 8.3. Ernie 5.5 Flash Preview (high) has the lower benchmark cost at $0.000 vs $1.585. Gemini 3.1 Pro Preview (medium) is faster at 22.71s vs 34.81s, with pass rates of 82.6% vs 89.9%.
Compared models
- Rank
- #117
- Total Output Tokens
- 102,691
- Response Time (avg)
- 22.71s
- Total Cost
- $1.585
Recommended model
Gemini 3.1 Pro Preview (medium)
It has the best score here (8.4), while responding about 1.5x faster than Ernie 5.5 Flash Preview (high).
Detailed comparison
| Metric | Ernie 5.5 Flash Preview Ernie 5.5 Flash Preview high Free Available | Gemini 3.1 Pro Preview Gemini 3.1 Pro Preview medium |
|---|---|---|
| Score | 8.3 | 8.4 |
| Rank | #124 | #117 |
| Reliability | 9.7 | 9.8 |
| Consistency | 8.6 | 9.6 |
| Attempts | 69/69 | 69/69 |
| Tests Correct | ||
| Attempt pass rate | 82.6% | 89.9% |
| Flaky tests | 4 | 1 |
| Total Runs | 69 | 69 |
| Cost per result | 0.000 | 7.924 |
| Total Cost | $0.000 | $1.585 |
| Input Price | $0.000 / 1M | $2.000 / 1M |
| Output Price | $0.000 / 1M | $12.000 / 1M |
| Cache Read Price | N/A | $0.200 / 1M |
| Cache Write Price | N/A | $0.375 / 1M |
| Total Input Tokens | 341,965 | 176,208 |
| Output Tokens | 7,959 | 6,093 |
| Reasoning Tokens | 582,592 | 96,598 |
| Response Time (avg) | 34.81s | 22.71s |
| Response Time (max) | 246.40s | 88.68s |
| Response Time (total) | 800.65s | 386.11s |
| Parameters | 280B total (14B active) | ~1.2T total (~20B active) |
| Availability | Closed | Closed |
Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.
Model generation showcase
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#124 Ernie 5.5 Flash Preview
high- Cost
- $0.000
- Time
- 68.0s
- Tokens
- 23,880 tok
#117 Gemini 3.1 Pro Preview
medium- Cost
- $0.115
- Time
- 87.2s
- Tokens
- 9,629 tok
Category Breakdown
| Agentic | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Ernie 5.5 Flash Preview | 6.4 | 3.8 | 33.3% | 1 | 63.99s | 203,096 | 1,496 | 14,885 | |
| Gemini 3.1 Pro Preview | 4.7 | 1.6 | 66.7% | 1 | 56.17s | 83,912 | 861 | 4,592 |
| Anti-AI Tricks | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Ernie 5.5 Flash Preview | 10.0 | 10.0 | 100.0% | 0 | 1.66s | 837 | 270 | 2,141 | |
| Gemini 3.1 Pro Preview | 10.0 | 10.0 | 100.0% | 0 | 7.90s | 498 | 112 | 3,218 |
| Coding | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Ernie 5.5 Flash Preview | 10.0 | 10.0 | 100.0% | 0 | 16.70s | 7,419 | 441 | 48,063 | |
| Gemini 3.1 Pro Preview | 7.9 | 9.9 | 66.7% | 0 | 40.17s | 8,124 | 435 | 41,247 |
| Combined | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Ernie 5.5 Flash Preview | 10.0 | 10.0 | 100.0% | 0 | 38.20s | 112,948 | 4,156 | 54,091 | |
| Gemini 3.1 Pro Preview | 9.8 | 10.0 | 100.0% | 0 | 40.39s | 67,910 | 3,687 | 23,111 |
| Data parsing and extraction | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Ernie 5.5 Flash Preview | 7.3 | 5.8 | 83.3% | 1 | 2.66s | 7,017 | 265 | 2,576 | |
| Gemini 3.1 Pro Preview | 10.0 | 10.0 | 100.0% | 0 | 7.72s | 7,265 | 279 | 3,904 |
| Domain specific | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Ernie 5.5 Flash Preview | 3.5 | 4.4 | 33.3% | 2 | 193.25s | 870 | 226 | 454,767 | |
| Gemini 3.1 Pro Preview | 7.7 | 10.0 | 66.7% | 0 | 20.29s | 644 | 18 | 11,704 |
| General Intelligence | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Ernie 5.5 Flash Preview | 10.0 | 10.0 | 100.0% | 0 | 4.60s | 543 | 265 | 2,168 | |
| Gemini 3.1 Pro Preview | 10.0 | 10.0 | 100.0% | 0 | 11.77s | 490 | 108 | 1,179 |
| Instructions following | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Ernie 5.5 Flash Preview | 9.8 | 10.0 | 100.0% | 0 | 1.55s | 777 | 63 | 1,282 | |
| Gemini 3.1 Pro Preview | 10.0 | 10.0 | 100.0% | 0 | 9.56s | 621 | 72 | 2,236 |
| Puzzle Solving | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Ernie 5.5 Flash Preview | 10.0 | 10.0 | 100.0% | 0 | 1.52s | 813 | 293 | 1,195 | |
| Gemini 3.1 Pro Preview | 10.0 | 10.0 | 100.0% | 0 | 6.90s | 570 | 235 | 3,128 |
| Tool Calling | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Ernie 5.5 Flash Preview | 10.0 | 10.0 | 100.0% | 0 | 4.19s | 7,390 | 224 | 674 | |
| Gemini 3.1 Pro Preview | 10.0 | 10.0 | 100.0% | 0 | 23.15s | 6,018 | 274 | 982 |
| Trivia | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Ernie 5.5 Flash Preview | 3.0 | 10.0 | 0.0% | 0 | 2.01s | 255 | 260 | 750 | |
| Gemini 3.1 Pro Preview | 10.0 | 10.0 | 100.0% | 0 | 6.27s | 156 | 12 | 1,297 |
Quick Compare
Switch Comparison Pair
Gemini 3.1 Pro PreviewmediumvsInklinghighFree AvailableErnie 5.5 Flash PreviewhighFree AvailablevsParticle-1minimalGemini 3.1 Pro PreviewmediumvsMuse Glimmer 30BxhighGemini 3.1 Pro PreviewmediumvsMuse Spark 1.1highGemini 3.1 Pro PreviewmediumvsQwen3.8 2.4T A95BlowGemini 3.1 Pro PreviewmediumvsNemotron 3.5 Super VLhighFree AvailableDeepSeek V4 Flash 0731highvsGemini 3.1 Pro PreviewmediumGemini 3.1 Pro PreviewmediumvsParticle-1highErnie 5.5 Flash PreviewhighFree AvailablevsKimi K3maxGemini 3.1 Pro PreviewmediumvsParticle-1minimalGemini 3.1 Pro PreviewmediumvsGLM 5.2highClaude Haiku 5.5maxvsGemini 3.1 Pro Previewmedium