- Rank
- #124
- Total Output Tokens
- 590,551
- Response Time (avg)
- 34.81s
- Total Cost
- $0.000
Ernie 5.5 Flash Preview (high) vs GPT-6 Luna (medium)
Ernie 5.5 Flash Preview (high) leads on average score with 8.3 vs 8.3. Ernie 5.5 Flash Preview (high) has the lower benchmark cost at $0.000 vs $0.047. GPT-6 Luna (medium) is faster at 18.07s vs 34.81s, with pass rates of 82.6% vs 73.9%.
Compared models
- Rank
- #129
- Total Output Tokens
- 53,161
- Response Time (avg)
- 18.07s
- Total Cost
- $0.047
Recommended model
GPT-6 Luna (medium)
Its score stays close to the best score here (8.3 vs 8.3), while responding about 1.9x faster than Ernie 5.5 Flash Preview (high).
Detailed comparison
| Metric | Ernie 5.5 Flash Preview Ernie 5.5 Flash Preview high Free Available | GPT-6 Luna GPT-6 Luna medium |
|---|---|---|
| Score | 8.3 | 8.3 |
| Rank | #124 | #129 |
| Reliability | 9.7 | 10.0 |
| Consistency | 8.6 | 8.9 |
| Attempts | 69/69 | 69/69 |
| Tests Correct | ||
| Attempt pass rate | 82.6% | 73.9% |
| Flaky tests | 4 | 3 |
| Total Runs | 69 | 69 |
| Cost per result | 0.000 | 0.313 |
| Total Cost | $0.000 | $0.047 |
| Input Price | $0.000 / 1M | $0.100 / 1M |
| Output Price | $0.000 / 1M | $0.500 / 1M |
| Cache Read Price | N/A | $0.010 / 1M |
| Cache Write Price | N/A | $0.125 / 1M |
| Total Input Tokens | 341,965 | 203,193 |
| Output Tokens | 7,959 | 5,751 |
| Reasoning Tokens | 582,592 | 47,410 |
| Response Time (avg) | 34.81s | 18.07s |
| Response Time (max) | 246.40s | 66.44s |
| Response Time (total) | 800.65s | 415.53s |
| Parameters | 280B total (14B active) | ~400B total (~17B active) |
| Availability | Closed | Closed |
Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.
Model generation showcase
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#124 Ernie 5.5 Flash Preview
high- Cost
- $0.000
- Time
- 68.0s
- Tokens
- 23,880 tok
#129 GPT-6 Luna
medium- Cost
- $0.002
- Time
- 23.6s
- Tokens
- 2,966 tok
Category Breakdown
| Agentic | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Ernie 5.5 Flash Preview | 6.4 | 3.8 | 33.3% | 1 | 63.99s | 203,096 | 1,496 | 14,885 | |
| GPT-6 Luna | 10.0 | 10.0 | 100.0% | 0 | 66.44s | 124,247 | 1,116 | 6,891 |
| Anti-AI Tricks | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Ernie 5.5 Flash Preview | 10.0 | 10.0 | 100.0% | 0 | 1.66s | 837 | 270 | 2,141 | |
| GPT-6 Luna | 8.3 | 10.0 | 75.0% | 0 | 4.32s | 606 | 156 | 875 |
| Coding | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Ernie 5.5 Flash Preview | 10.0 | 10.0 | 100.0% | 0 | 16.70s | 7,419 | 441 | 48,063 | |
| GPT-6 Luna | 6.6 | 4.6 | 77.8% | 2 | 23.63s | 7,302 | 438 | 10,222 |
| Combined | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Ernie 5.5 Flash Preview | 10.0 | 10.0 | 100.0% | 0 | 38.20s | 112,948 | 4,156 | 54,091 | |
| GPT-6 Luna | 10.0 | 10.0 | 100.0% | 0 | 22.65s | 55,738 | 3,052 | 4,096 |
| Data parsing and extraction | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Ernie 5.5 Flash Preview | 7.3 | 5.8 | 83.3% | 1 | 2.66s | 7,017 | 265 | 2,576 | |
| GPT-6 Luna | 10.0 | 10.0 | 100.0% | 0 | 26.09s | 7,140 | 234 | 268 |
| Domain specific | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Ernie 5.5 Flash Preview | 3.5 | 4.4 | 33.3% | 2 | 193.25s | 870 | 226 | 454,767 | |
| GPT-6 Luna | 5.9 | 7.2 | 55.6% | 1 | 22.71s | 732 | 70 | 19,191 |
| General Intelligence | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Ernie 5.5 Flash Preview | 10.0 | 10.0 | 100.0% | 0 | 4.60s | 543 | 265 | 2,168 | |
| GPT-6 Luna | 4.4 | 9.9 | 0.0% | 0 | 28.25s | 477 | 91 | 289 |
| Instructions following | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Ernie 5.5 Flash Preview | 9.8 | 10.0 | 100.0% | 0 | 1.55s | 777 | 63 | 1,282 | |
| GPT-6 Luna | 9.8 | 10.0 | 100.0% | 0 | 13.24s | 660 | 89 | 409 |
| Puzzle Solving | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Ernie 5.5 Flash Preview | 10.0 | 10.0 | 100.0% | 0 | 1.52s | 813 | 293 | 1,195 | |
| GPT-6 Luna | 7.7 | 10.0 | 66.7% | 0 | 9.78s | 642 | 211 | 3,189 |
| Tool Calling | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Ernie 5.5 Flash Preview | 10.0 | 10.0 | 100.0% | 0 | 4.19s | 7,390 | 224 | 674 | |
| GPT-6 Luna | 10.0 | 10.0 | 100.0% | 0 | 4.84s | 5,454 | 264 | 249 |
| Trivia | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Ernie 5.5 Flash Preview | 3.0 | 10.0 | 0.0% | 0 | 2.01s | 255 | 260 | 750 | |
| GPT-6 Luna | 3.0 | 10.0 | 0.0% | 0 | 6.39s | 195 | 30 | 1,731 |
Quick Compare
Switch Comparison Pair
Ernie 5.5 Flash PreviewhighFree AvailablevsParticle-1minimalGemini 4 ArgonlowvsGPT-6 LunamediumDeepSeek V4.1 Flash 1017maxvsGPT-6 LunamediumGPT-6 LunamediumvsGrok 4.5highKimi K3maxvsGPT-6 LunamediumGemini 3.5 FlashhighvsGPT-6 LunamediumErnie 5.5 Flash PreviewhighFree AvailablevsKimi K3maxClaude Haiku 5.5highvsGPT-6 LunamediumGPT-6 LunamediumvsGLM 5.3 FlashX LegalhighErnie 5.5 Flash PreviewhighFree AvailablevsGemini 3.1 Pro PreviewmediumClaude Opus 4.8mediumvsErnie 5.5 Flash PreviewhighFree AvailableErnie 5.5 Flash PreviewhighFree AvailablevsMuse Glimmer 30Bxhigh