- Rank
- #421
- Total Output Tokens
- 0
- Response Time (avg)
- 531ms
- Total Cost
- $0.003
d1-ultra (default) vs Span-02 (default)
Span-02 (default) leads on average score with 2.8 vs 2.7. Span-02 (default) has the lower benchmark cost at $0.001 vs $0.003. d1-ultra (default) is faster at 531ms vs 1.36s, with pass rates of 20.3% vs 26.1%.
Compared models
- Rank
- #419
- Total Output Tokens
- 0
- Response Time (avg)
- 1.36s
- Total Cost
- $0.001
Recommended model
Span-02 (default)
It has the best score here (2.8), while costing about 3.3x less than d1-ultra (default).
Detailed comparison
| Metric | d1-ultra d1-ultra default | Span-02 Span-02 default |
|---|---|---|
| Score | 2.7 | 2.8 |
| Rank | #421 | #419 |
| Reliability | 10.0 | 10.0 |
| Consistency | 4.9 | 5.2 |
| Attempts | 36/69 | 36/69 |
| Tests Correct | ||
| Attempt pass rate | 20.3% | 26.1% |
| Flaky tests | 1 | 0 |
| Total Runs | 36 | 36 |
| Cost per result | 0.059 | 0.012 |
| Total Cost | $0.003 | $0.001 |
| Input Price | $0.042 / 1M | $0.010 / 1M |
| Output Price | $0.000 / 1M | $0.000 / 1M |
| Cache Read Price | $0.042 / 1M | N/A |
| Cache Write Price | N/A | N/A |
| Total Input Tokens | 55,956 | 70,626 |
| Output Tokens | 0 | 0 |
| Reasoning Tokens | 0 | 0 |
| Response Time (avg) | 531ms | 1.36s |
| Response Time (max) | 697ms | 5.71s |
| Response Time (total) | 6.38s | 16.37s |
| Parameters | - | 26B total (4B active) |
| Availability | Closed | Open source |
Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.
Category Breakdown
Quick Compare
Switch Comparison Pair
Command A+lowvsSpan-02defaultCommand A+nonevsSpan-02defaultCommand A+lowvsd1-ultradefaultCommand A+nonevsd1-ultradefaultCommand A+highvsSpan-02defaultCommand A+highvsd1-ultradefaultSpan-02defaultvsXing4.0 29b A4bnoneFree AvailableCommand A+mediumvsSpan-02defaultSpan-02defaultvsGrok 4.20noned1-ultradefaultvsXing4.0 29b A4bnoneFree AvailableCommand A+mediumvsd1-ultradefaultd1-ultradefaultvsGrok 4.20none