- Rank
- #463
- Total Output Tokens
- 0
- Response Time (avg)
- 531ms
- Total Cost
- $0.003
d1-ultra (default) vs Reflex (default)
d1-ultra (default) leads on average score with 2.7 vs 2.6. d1-ultra (default) has the lower benchmark cost at $0.003 vs $0.004. d1-ultra (default) is faster at 531ms vs 888ms, with pass rates of 20.3% vs 21.7%.
Compared models
- Rank
- #467
- Total Output Tokens
- 0
- Response Time (avg)
- 888ms
- Total Cost
- $0.004
Recommended model
d1-ultra (default)
It has the best score here (2.7), while responding about 1.7x faster than Reflex (default).
Detailed comparison
| Metric | d1-ultra d1-ultra default | Reflex Reflex default |
|---|---|---|
| Score | 2.7 | 2.6 |
| Rank | #463 | #467 |
| Reliability | 10.0 | 10.0 |
| Consistency | 4.9 | 5.2 |
| Attempts | 36/69 | 36/69 |
| Tests Correct | ||
| Attempt pass rate | 20.3% | 21.7% |
| Flaky tests | 1 | 0 |
| Total Runs | 36 | 36 |
| Cost per result | 0.059 | 0.063 |
| Total Cost | $0.003 | $0.004 |
| Input Price | $0.042 / 1M | $0.042 / 1M |
| Output Price | $0.000 / 1M | $0.000 / 1M |
| Cache Read Price | $0.042 / 1M | $0.008 / 1M |
| Cache Write Price | N/A | N/A |
| Total Input Tokens | 55,956 | 73,902 |
| Output Tokens | 0 | 0 |
| Reasoning Tokens | 0 | 0 |
| Response Time (avg) | 531ms | 888ms |
| Response Time (max) | 697ms | 1.73s |
| Response Time (total) | 6.38s | 10.66s |
| Parameters | - | ~27B |
| Availability | Closed | Closed |
Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.
Category Breakdown
Quick Compare
Switch Comparison Pair
Command A+lowvsd1-ultradefaultCommand A+nonevsd1-ultradefaultCommand A+lowvsReflexdefaultCommand A+nonevsReflexdefaultCommand A+highvsd1-ultradefaultCommand A+highvsReflexdefaultd1-ultradefaultvsXing4.0 29b A4bnoneFree AvailableReflexdefaultvsXing4.0 29b A4bnoneFree AvailableCommand A+mediumvsd1-ultradefaultd1-ultradefaultvsGrok 4.20noneGemini 3 Flash PreviewhighvsReflexdefaultCommand A+mediumvsReflexdefault