Navigate
Advertise here

Command A+ (medium) vs HeyGen Decision (default)

Command A+ (medium) leads on average score with 3.4 vs 3.2. HeyGen Decision (default) has the lower benchmark cost at $0.029 vs $0.064. HeyGen Decision (default) is faster at 1.12s vs 91.72s, with pass rates of 0.0% vs 26.1%.

Last updated at: 2026-11-16

Compared models

Rank
#470
Total Output Tokens
18,795
Response Time (avg)
91.72s
Total Cost
$0.064
Rank
#477
Total Output Tokens
0
Response Time (avg)
1.12s
Total Cost
$0.029
Recommended model HeyGen Decision (default)

Its score stays close to the best score here (3.2 vs 3.4), while costing about 2.3x less than Command A+ (medium).

Detailed comparison

Metric Command A+ Command A+ medium Release: 2026-09-23 HeyGen Decision HeyGen Decision default Release: 2026-11-16
Score 3.4 3.2
Rank #470 #477
Reliability 3.5 10.0
Consistency 10.0 5.2
Attempts 69/69 36/69
Tests Correct
Attempt pass rate 0.0% 26.1%
Flaky tests 0 0
Total Runs 69 36
Cost per result 0.000 0.473
Total Cost $0.064 $0.029
Input Price $0.300 / 1M $0.140 / 1M
Output Price $1.500 / 1M $0.000 / 1M
Cache Read Price $0.150 / 1M N/A
Cache Write Price N/A N/A
Total Input Tokens 118,771 202,431
Output Tokens 4,127 0
Reasoning Tokens 14,668 0
Response Time (avg) 91.72s 1.12s
Response Time (max) 112.76s 2.28s
Response Time (total) 2109.54s 13.40s
Parameters 218B total (25B active) -
Availability Open source Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#470 Command A+

medium
Provider returned error
Cost
$0.000
Time
0.2s
Tokens
0 tok

#477 HeyGen Decision

default
No showcase result has been generated for this model yet.
Cost
N/A
Time
-
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Command A+ 3.0 10.0 0.0% 0 93.13s 0 0 0
HeyGen Decision 5.1 6.7 33.3% 0 1.58s 103,554 0 0

Switch Comparison Pair

Command A+mediumvsGrok 4.20noneCommand A+highvsHeyGen DecisiondefaultCommand A+mediumvsXing4.0 29b A4bnoneFree AvailableHeyGen DecisiondefaultvsXing4.0 29b A4bnoneFree AvailableCommand A+mediumvsHeyGen Decision TurbodefaultCommand A+nonevsHeyGen DecisiondefaultCommand A+lowvsHeyGen DecisiondefaultHeyGen DecisiondefaultvsGrok 4.20noneCommand A+mediumvsLing 3.0 TinylowCommand A+mediumvsLing 3.0 TinyhighCommand A+mediumvsGemini Decision 1defaultCommand A+mediumvsNemotron 3.5 LightningnoneFree Available