Navigate
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

HeyGen Decision (default) vs d1.2-ultra (default)

HeyGen Decision (default) leads on average score with 3.2 vs 3.0. d1.2-ultra (default) has the lower benchmark cost at $0.002 vs $0.029. d1.2-ultra (default) is faster at 795ms vs 1.12s, with pass rates of 26.1% vs 27.5%.

Last updated at: 2026-11-17

Compared models

Rank
#489
Total Output Tokens
0
Response Time (avg)
1.12s
Total Cost
$0.029
Rank
#493
Total Output Tokens
0
Response Time (avg)
795ms
Total Cost
$0.002
Recommended model d1.2-ultra (default)

Its score stays close to the best score here (3.0 vs 3.2), while costing about 19.6x less than HeyGen Decision (default).

Detailed comparison

Metric HeyGen Decision HeyGen Decision default Release: 2026-11-16 d1.2-ultra d1.2-ultra default Release: 2026-11-17
Score 3.2 3.0
Rank #489 #493
Reliability 10.0 10.0
Consistency 5.2 4.5
Attempts 36/69 36/69
Tests Correct
Attempt pass rate 26.1% 27.5%
Flaky tests 0 2
Total Runs 36 36
Cost per result 0.473 0.029
Total Cost $0.029 $0.002
Input Price $0.140 / 1M $0.042 / 1M
Output Price $0.000 / 1M $0.000 / 1M
Cache Read Price N/A N/A
Cache Write Price N/A N/A
Total Input Tokens 202,431 34,410
Output Tokens 0 0
Reasoning Tokens 0 0
Response Time (avg) 1.12s 795ms
Response Time (max) 2.28s 1.19s
Response Time (total) 13.40s 9.54s
Parameters - -
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
HeyGen Decision 5.1 6.7 33.3% 0 1.58s 103,554 0 0
d1.2-ultra 4.8 6.5 33.3% 0 625ms 17,655 0 0

Switch Comparison Pair

Command A+highvsHeyGen DecisiondefaultCommand A+nonevsd1.2-ultradefaultCommand A+lowvsd1.2-ultradefaultHeyGen DecisiondefaultvsXing4.0 29b A4bnoneFree AvailableCommand A+highvsd1.2-ultradefaultCommand A+nonevsHeyGen DecisiondefaultCommand A+lowvsHeyGen DecisiondefaultCommand A+mediumvsHeyGen DecisiondefaultHeyGen DecisiondefaultvsGrok 4.20noned1.2-ultradefaultvsXing4.0 29b A4bnoneFree AvailableCommand A+mediumvsd1.2-ultradefaultd1.2-ultradefaultvsGrok 4.20none