Navigate
Advertise here

d1-ultra (default) vs Jev 1.13 (default)

d1-ultra (default) leads on average score with 2.7 vs 2.6. d1-ultra (default) has the lower benchmark cost at $0.003 vs $0.003. d1-ultra (default) is faster at 531ms vs 698ms, with pass rates of 20.3% vs 26.1%.

Last updated at: 2026-10-17

Compared models

Rank
#421
Total Output Tokens
0
Response Time (avg)
531ms
Total Cost
$0.003
Rank
#423
Total Output Tokens
18,927
Response Time (avg)
698ms
Total Cost
$0.003
Recommended model d1-ultra (default)

It has the strongest score in this comparison (2.7) and the best overall balance of cost and response time across 2 models.

Detailed comparison

Metric d1-ultra d1-ultra default Release: 2026-10-17 Jev 1.13 Jev 1.13 default Release: 2026-09-18
Score 2.7 2.6
Rank #421 #423
Reliability 10.0 10.0
Consistency 4.9 5.2
Attempts 36/69 36/69
Tests Correct
Attempt pass rate 20.3% 26.1%
Flaky tests 1 0
Total Runs 36 36
Cost per result 0.059 0.047
Total Cost $0.003 $0.003
Input Price $0.042 / 1M $0.042 / 1M
Output Price $0.000 / 1M $0.000 / 1M
Cache Read Price $0.042 / 1M N/A
Cache Write Price N/A N/A
Total Input Tokens 55,956 67,092
Output Tokens 0 18,927
Reasoning Tokens 0 0
Response Time (avg) 531ms 698ms
Response Time (max) 697ms 1.08s
Response Time (total) 6.38s 8.38s
Parameters - -
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
d1-ultra 5.3 4.3 55.6% 1 561ms 25,605 0 0
Jev 1.13 2.2 6.7 0.0% 0 598ms 30,072 8,130 0

Switch Comparison Pair

Command A+lowvsd1-ultradefaultCommand A+nonevsd1-ultradefaultCommand A+lowvsJev 1.13defaultCommand A+nonevsJev 1.13defaultCommand A+highvsd1-ultradefaultCommand A+highvsJev 1.13defaultd1-ultradefaultvsXing4.0 29b A4bnoneFree AvailableJev 1.13defaultvsXing4.0 29b A4bnoneFree AvailableCommand A+mediumvsd1-ultradefaultd1-ultradefaultvsGrok 4.20noneCommand A+mediumvsJev 1.13defaultJev 1.13defaultvsGrok 4.20none