Navigate
Advertise here

Command A+ (medium) vs Kev 4B (default)

Command A+ (medium) leads on average score with 3.4 vs 2.4. Kev 4B (default) has the lower benchmark cost at $0.002 vs $0.064. Kev 4B (default) is faster at 5.63s vs 91.72s, with pass rates of 0.0% vs 15.9%.

Last updated at: 2026-11-16

Compared models

Rank
#470
Total Output Tokens
18,795
Response Time (avg)
91.72s
Total Cost
$0.064
Rank
#495
Total Output Tokens
28,061
Response Time (avg)
5.63s
Total Cost
$0.002
Recommended model Command A+ (medium)

It has the strongest score in this comparison (3.4) and the best overall balance of cost and response time across 2 models.

Detailed comparison

Metric Command A+ Command A+ medium Release: 2026-09-23 Kev 4B Kev 4B default Release: 2026-09-28
Score 3.4 2.4
Rank #470 #495
Reliability 3.5 10.0
Consistency 10.0 4.9
Attempts 69/69 36/69
Tests Correct
Attempt pass rate 0.0% 15.9%
Flaky tests 0 1
Total Runs 69 36
Cost per result 0.000 0.060
Total Cost $0.064 $0.002
Input Price $0.300 / 1M $0.042 / 1M
Output Price $1.500 / 1M $0.000 / 1M
Cache Read Price $0.150 / 1M N/A
Cache Write Price N/A N/A
Total Input Tokens 118,771 42,804
Output Tokens 4,127 28,061
Reasoning Tokens 14,668 0
Response Time (avg) 91.72s 5.63s
Response Time (max) 112.76s 17.79s
Response Time (total) 2109.54s 67.61s
Parameters 218B total (25B active) 4B
Availability Open source Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#470 Command A+

medium
Provider returned error
Cost
$0.000
Time
0.2s
Tokens
0 tok

#495 Jared Palmer: Kev 4B

default
No showcase result has been generated for this model yet.
Cost
N/A
Time
-
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Command A+ 3.0 10.0 0.0% 0 93.13s 0 0 0
Kev 4B 4.5 6.7 33.3% 0 771ms 21,603 12,207 0

Switch Comparison Pair