- Rank
- #97
- Total Output Tokens
- 194,474
- Response Time (avg)
- 25.66s
- Total Cost
- $1.027
ERNIE-Light-DT-1.0 (high) vs DeepSeek V4.1 Flash (max)
The average score is effectively tied at 8.6 vs 8.6. ERNIE-Light-DT-1.0 (high) has the lower benchmark cost at $1.027 vs $1.204. ERNIE-Light-DT-1.0 (high) is faster at 25.66s vs 61.58s, with pass rates of 75.4% vs 69.6%.
Compared models
- Rank
- #98
- Total Output Tokens
- 908,171
- Response Time (avg)
- 61.58s
- Total Cost
- $1.204
Recommended model
ERNIE-Light-DT-1.0 (high)
It has the best score here (8.6), while responding about 2.4x faster than DeepSeek V4.1 Flash (max).
Detailed comparison
| Metric | ERNIE-Light-DT-1.0 ERNIE-Light-DT-1.0 high | DeepSeek V4.1 Flash DeepSeek V4.1 Flash max |
|---|---|---|
| Score | 8.6 | 8.6 |
| Rank | #97 | #98 |
| Reliability | 9.3 | 9.4 |
| Consistency | 9.3 | 9.3 |
| Attempts | 69/69 | 69/69 |
| Tests Correct | ||
| Attempt pass rate | 75.4% | 69.6% |
| Flaky tests | 2 | 2 |
| Total Runs | 69 | 69 |
| Cost per result | 6.418 | 3.715 |
| Total Cost | $1.027 | $1.204 |
| Input Price | $1.130 / 1M | $0.013 / 1M |
| Output Price | $3.941 / 1M | $1.320 / 1M |
| Cache Read Price | $0.113 / 1M | $0.013 / 1M |
| Cache Write Price | N/A | N/A |
| Total Input Tokens | 230,563 | 414,054 |
| Output Tokens | 6,576 | 7,635 |
| Reasoning Tokens | 187,898 | 900,536 |
| Response Time (avg) | 25.66s | 61.58s |
| Response Time (max) | 200.80s | 335.08s |
| Response Time (total) | 590.18s | 1416.24s |
| Parameters | ~320B total (~18B active) | 748B total (16B active) |
| Availability | Closed | Open source |
Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.
Model generation showcase
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#97 ERNIE-Light-DT-1.0
high- Cost
- $0.067
- Time
- 129.8s
- Tokens
- 16,960 tok
#98 DeepSeek V4.1 Flash
max- Cost
- $0.066
- Time
- 211.0s
- Tokens
- 54,712 tok
Category Breakdown
| Agentic | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| ERNIE-Light-DT-1.0 | 10.0 | 10.0 | 100.0% | 0 | 52.84s | 128,875 | 1,210 | 3,884 | |
| DeepSeek V4.1 Flash | 10.0 | 10.0 | 100.0% | 0 | 66.63s | 325,030 | 2,077 | 34,968 |
| Anti-AI Tricks | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| ERNIE-Light-DT-1.0 | 10.0 | 10.0 | 100.0% | 0 | 1.89s | 639 | 266 | 486 | |
| DeepSeek V4.1 Flash | 8.3 | 10.0 | 75.0% | 0 | 4.35s | 852 | 213 | 7,262 |
| Coding | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| ERNIE-Light-DT-1.0 | 10.0 | 10.0 | 100.0% | 0 | 14.96s | 7,317 | 419 | 16,035 | |
| DeepSeek V4.1 Flash | 10.0 | 10.0 | 100.0% | 0 | 62.50s | 7,509 | 373 | 132,357 |
| Combined | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| ERNIE-Light-DT-1.0 | 6.5 | 10.0 | 50.0% | 0 | 27.93s | 76,694 | 3,454 | 16,156 | |
| DeepSeek V4.1 Flash | 10.0 | 10.0 | 100.0% | 0 | 160.31s | 66,677 | 4,031 | 221,091 |
| Data parsing and extraction | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| ERNIE-Light-DT-1.0 | 10.0 | 10.0 | 100.0% | 0 | 1.72s | 7,149 | 210 | 246 | |
| DeepSeek V4.1 Flash | 6.5 | 10.0 | 50.0% | 0 | 4.56s | 2,397 | 120 | 2,047 |
| Domain specific | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| ERNIE-Light-DT-1.0 | 3.6 | 7.2 | 22.2% | 1 | 134.82s | 759 | 220 | 149,271 | |
| DeepSeek V4.1 Flash | 3.6 | 7.2 | 22.2% | 1 | 198.41s | 909 | 27 | 384,462 |
| General Intelligence | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| ERNIE-Light-DT-1.0 | 6.5 | 3.4 | 66.7% | 1 | 2.02s | 498 | 185 | 309 | |
| DeepSeek V4.1 Flash | 10.0 | 10.0 | 100.0% | 0 | 4.00s | 549 | 148 | 1,093 |
| Instructions following | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| ERNIE-Light-DT-1.0 | 10.0 | 10.0 | 100.0% | 0 | 2.04s | 678 | 72 | 166 | |
| DeepSeek V4.1 Flash | 10.0 | 10.0 | 100.0% | 0 | 7.64s | 783 | 63 | 2,293 |
| Puzzle Solving | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| ERNIE-Light-DT-1.0 | 7.7 | 10.0 | 66.7% | 0 | 2.16s | 672 | 291 | 311 | |
| DeepSeek V4.1 Flash | 5.5 | 7.1 | 44.4% | 1 | 30.82s | 828 | 339 | 54,014 |
| Tool Calling | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| ERNIE-Light-DT-1.0 | 10.0 | 10.0 | 100.0% | 0 | 4.33s | 7,075 | 231 | 149 | |
| DeepSeek V4.1 Flash | 10.0 | 10.0 | 100.0% | 0 | 9.49s | 8,259 | 228 | 693 |
| Trivia | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| ERNIE-Light-DT-1.0 | 3.0 | 10.0 | 0.0% | 0 | 4.23s | 207 | 18 | 885 | |
| DeepSeek V4.1 Flash | 3.0 | 10.0 | 0.0% | 0 | 98.48s | 261 | 16 | 60,256 |
Quick Compare
Switch Comparison Pair
ERNIE-Light-DT-1.0highvsMuse EmbermaxERNIE-Light-DT-1.0highvsMuse EmberlowDeepSeek V4.1 FlashmaxvsMuse EmberlowDeepSeek V4.1 FlashmaxvsGPT-6.1 TerranoneDeepSeek V4.1 FlashmaxvsMuse Spark 1.1lowClaude Fable 5.2lowvsDeepSeek V4.1 FlashmaxERNIE-Light-DT-1.0highvsGPT-6 SollowClaude Sonnet 5.5highvsDeepSeek V4.1 FlashmaxClaude Fable 5.2highvsDeepSeek V4.1 FlashmaxERNIE-Light-DT-1.0highvsGPT-6.1 TerranoneERNIE-Light-DT-1.0highvsMuse Spark 1.1lowClaude Fable 5.2lowvsERNIE-Light-DT-1.0high