Navigate
Advertise here

Command A+ (high) vs d1.2-ultra (default)

Command A+ (high) leads on average score with 3.2 vs 3.0. d1.2-ultra (default) has the lower benchmark cost at $0.002 vs $0.079. d1.2-ultra (default) is faster at 795ms vs 89.96s, with pass rates of 0.0% vs 27.5%.

Last updated at: 2026-11-17

Compared models

Rank
#490
Total Output Tokens
28,663
Response Time (avg)
89.96s
Total Cost
$0.079
Rank
#493
Total Output Tokens
0
Response Time (avg)
795ms
Total Cost
$0.002
Recommended model d1.2-ultra (default)

Its score stays close to the best score here (3.0 vs 3.2), while costing about 54.2x less than Command A+ (high).

Detailed comparison

Metric Command A+ Command A+ high Release: 2026-09-23 d1.2-ultra d1.2-ultra default Release: 2026-11-17
Score 3.2 3.0
Rank #490 #493
Reliability 3.5 10.0
Consistency 10.0 4.5
Attempts 69/69 36/69
Tests Correct
Attempt pass rate 0.0% 27.5%
Flaky tests 0 2
Total Runs 69 36
Cost per result 0.000 0.029
Total Cost $0.079 $0.002
Input Price $0.300 / 1M $0.042 / 1M
Output Price $1.500 / 1M $0.000 / 1M
Cache Read Price $0.150 / 1M N/A
Cache Write Price N/A N/A
Total Input Tokens 117,966 34,410
Output Tokens 5,149 0
Reasoning Tokens 23,514 0
Response Time (avg) 89.96s 795ms
Response Time (max) 156.00s 1.19s
Response Time (total) 2069.01s 9.54s
Parameters 218B total (25B active) -
Availability Open source Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#490 Command A+

high
Provider returned error
Cost
$0.000
Time
0.2s
Tokens
0 tok

#493 LiquidAI: d1.2-ultra

default
No showcase result has been generated for this model yet.
Cost
N/A
Time
-
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Command A+ 3.0 10.0 0.0% 0 92.74s 0 0 0
d1.2-ultra 4.8 6.5 33.3% 0 625ms 17,655 0 0

Switch Comparison Pair

Command A+highvsHeyGen DecisiondefaultCommand A+nonevsd1.2-ultradefaultCommand A+lowvsd1.2-ultradefaultCommand A+highvsHeyGen Decision TurbodefaultCommand A+highvsXing4.0 29b A4bnoneFree AvailableCommand A+highvsGemini Decision 1defaultCommand A+highvsGrok 4.20noned1.2-ultradefaultvsXing4.0 29b A4bnoneFree AvailableCommand A+mediumvsd1.2-ultradefaultd1.2-ultradefaultvsGrok 4.20noneCommand A+highvsSpan-02defaultCommand A+highvsPplx Decider V1.3defaultFree Available